Apr 24 10:19:40.232929 np0000170011 systemd[1]: Started devstack@neutron-ovn-maintenance-worker.service - Devstack devstack@neutron-ovn-maintenance-worker.service.
Apr 24 10:19:40.553062 np0000170011 neutron-ovn-maintenance-worker[105599]: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:41: EventletDeprecationWarning:
Apr 24 10:19:40.553062 np0000170011 neutron-ovn-maintenance-worker[105599]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 24 10:19:40.553062 np0000170011 neutron-ovn-maintenance-worker[105599]: we strongly recommend against using it for new projects.
Apr 24 10:19:40.553062 np0000170011 neutron-ovn-maintenance-worker[105599]: If you are already using Eventlet, we recommend migrating to a different
Apr 24 10:19:40.553062 np0000170011 neutron-ovn-maintenance-worker[105599]: framework.  For more detail see
Apr 24 10:19:40.553062 np0000170011 neutron-ovn-maintenance-worker[105599]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 24 10:19:40.553062 np0000170011 neutron-ovn-maintenance-worker[105599]:   import eventlet
Apr 24 10:19:41.618423 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.common.config [-] Logging enabled!
Apr 24 10:19:41.619020 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-ovn-maintenance-worker version 28.1.0.dev155
Apr 24 10:19:41.619020 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-ovn-maintenance-worker --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=105599) setup_logging /opt/stack/neutron/neutron/common/config.py:124}}
Apr 24 10:19:41.619020 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.server.ovn_maintenance [-] OVN maintenance process starting...
Apr 24 10:19:41.619020 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "plugin-directory" by "neutron_lib.plugins.directory._create_plugin_directory" {{(pid=105599) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 10:19:41.619267 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=105599) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 10:19:41.619267 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.000s {{(pid=105599) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 10:19:41.619267 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "manager" by "neutron.manager.NeutronManager._create_instance" {{(pid=105599) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 10:19:41.619267 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=105599) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 10:19:41.619496 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.manager [-] Loading core plugin: ml2
Apr 24 10:19:41.917100 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:41.917199 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:41.917250 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:41.919230 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:41.919301 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:41.919398 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:41.953267 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:41.953424 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:41.953424 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:41.959259 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:41.959526 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:41.959526 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.082603 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.082603 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.082927 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.106767 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.106868 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.106868 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.154500 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7eec14ca0540> agent after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.154652 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7eec14ca0540> agent after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.154652 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7eec14ca05e0> segment precommit_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.154861 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7eec14ca0680> network precommit_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.154953 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7eec14ca18a0> segment before_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.206491 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> network before_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.206562 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7eec14c6d3a0> agent before_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.206638 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> network before_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.206698 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> port before_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.206745 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> port before_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.206814 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> segment precommit_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.206871 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> segment precommit_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.206921 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> segment after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.206980 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> segment after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.207042 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> network after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.207101 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> network precommit_delete 0, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.207178 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> port provisioning_complete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.207223 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> rbac-policy before_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.207288 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> rbac-policy after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.207452 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> agent after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.207452 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> subnet after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.207530 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> subnet precommit_delete 0, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.207569 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_project of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> rbac-policy before_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.207608 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_project of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> rbac-policy before_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.207677 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> segment_host_mapping after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.207751 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin.delete_agent_notified of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> agent after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.207853 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> rbac-policy before_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.207907 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> rbac-policy before_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.207955 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7eec165535f0>> rbac-policy before_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.208305 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=105599) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 24 10:19:42.208352 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=105599) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 24 10:19:42.208436 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=105599) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 24 10:19:42.208491 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=105599) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 24 10:19:42.208530 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=105599) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 24 10:19:42.208578 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=105599) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 24 10:19:42.208824 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'geneve']
Apr 24 10:19:42.209559 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['public']
Apr 24 10:19:42.210139 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
Apr 24 10:19:42.210661 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict({'public': [(1, 4094)]})
Apr 24 10:19:42.210761 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'local', 'vlan']
Apr 24 10:19:42.210872 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'local', 'vlan'])
Apr 24 10:19:42.210941 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [-] Project network_types: ['geneve']
Apr 24 10:19:42.211061 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security', 'qos']
Apr 24 10:19:42.211559 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security', 'qos']
Apr 24 10:19:42.211631 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security', 'qos']
Apr 24 10:19:42.211714 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['ovn']
Apr 24 10:19:42.249612 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['ovn']
Apr 24 10:19:42.249743 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['ovn']
Apr 24 10:19:42.249743 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [-] No mechanism drivers provide segment reachability information for agent scheduling.
Apr 24 10:19:42.250510 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7eec149d2c90>> floatingip before_response 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.250578 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7eec149d2c90>> port before_response 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:42.274780 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
Apr 24 10:19:42.274919 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
Apr 24 10:19:42.274919 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
Apr 24 10:19:42.275046 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 65536)]
Apr 24 10:19:42.322571 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO dbcounter [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Registered counter for database neutron
Apr 24 10:19:42.338055 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG oslo_db.sqlalchemy.engines [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105599) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 24 10:19:42.744915 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG dbcounter [-] [105599] Writer thread running {{(pid=105599) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 24 10:19:42.938620 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Initializing driver for type 'local'
Apr 24 10:19:42.938795 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Initializing driver for type 'vlan'
Apr 24 10:19:43.050207 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] VlanTypeDriver initialization complete
Apr 24 10:19:43.050328 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Initializing extension driver 'port_security'
Apr 24 10:19:43.050449 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.extensions.port_security [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] PortSecurityExtensionDriver initialization complete
Apr 24 10:19:43.050534 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Initializing extension driver 'qos'
Apr 24 10:19:43.050596 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.plugins.ml2.extensions.qos [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] QosExtensionDriver initialization complete {{(pid=105599) initialize /opt/stack/neutron/neutron/plugins/ml2/extensions/qos.py:31}}
Apr 24 10:19:43.050652 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Initializing mechanism driver 'ovn'
Apr 24 10:19:43.050720 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Starting OVNMechanismDriver
Apr 24 10:19:43.052148 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver.pre_fork_initialize of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> process before_spawn 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.052253 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver.post_fork_initialize of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> process after_init 55550000, True {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.052312 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver._add_segment_host_mapping_for_segment of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> segment after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.052586 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver.create_segment_provnet_port of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> segment after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.052586 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver.delete_segment_provnet_port of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> segment after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.052586 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver._validate_allowed_address_pairs of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> allowed_address_pair before_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.052761 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver._create_security_group_precommit of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> security_group precommit_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.052761 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver._update_security_group of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> security_group after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.052886 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver._create_security_group of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> security_group after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.052886 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver._delete_security_group_precommit of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> security_group precommit_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.053017 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver._delete_security_group of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> security_group after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.053085 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver._create_sg_rule_precommit of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> security_group_rule precommit_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.053145 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver._process_sg_rule_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> security_group_rule after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.053269 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver._process_sg_rule_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> security_group_rule before_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.053349 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver._process_ag_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> address_group after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.053477 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver._process_ag_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> address_group after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.053477 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNMechanismDriver._process_ag_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x7eec149d2c30>> address_group after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.053652 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.ovn.driver.OVNQosDriver object at 0x7eec146671a0>> qos_plugin after_init 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.053805 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNTrunkDriver.register of <neutron.services.trunk.drivers.ovn.trunk_driver.OVNTrunkDriver object at 0x7eec14ecd400>> trunk_plugin after_init 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.053979 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.ovn.driver.OVNDriver object at 0x7eec132f9160>> logging-plugin after_init 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.054540 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.services.logapi.drivers.ovn.driver [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] OVN logging driver registered
Apr 24 10:19:43.055755 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.plugins.ml2.plugin [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=105599) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_log/helpers.py:77}}
Apr 24 10:19:43.055947 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f93d0>> port after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.056026 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f93d0>> port after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.056098 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f93d0>> port after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.056175 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f9340>> subnet after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.056319 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f9340>> subnet after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.056319 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f9340>> subnet after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.056575 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f92e0>> network after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.056575 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f92e0>> network after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.056575 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f92e0>> network after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.056740 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f92b0>> security_group after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.056740 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f92b0>> security_group after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.056849 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f92b0>> security_group after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.056849 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f9310>> security_group_rule after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.056973 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f9310>> security_group_rule after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.057034 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f9310>> security_group_rule after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.057092 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f9220>> address_group after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.057151 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f9220>> address_group after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.057258 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7eec132f9220>> address_group after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.057333 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ML2 OVO RPC backend initialized. {{(pid=105599) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:117}}
Apr 24 10:19:43.058030 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.quota [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded quota_driver: <neutron.db.quota.driver_nolock.DbQuotaNoLockDriver object at 0x7eec132f91f0>.
Apr 24 10:19:43.058030 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.plugin [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Modular L2 Plugin initialization complete
Apr 24 10:19:43.058190 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading services supported by the core plugin {{(pid=105599) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:170}}
Apr 24 10:19:43.058251 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.plugins.ml2.managers [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Got port-security extension from driver 'port_security'
Apr 24 10:19:43.058536 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading service plugins: ['ovn-router', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=105599) _load_service_plugins /opt/stack/neutron/neutron/manager.py:195}}
Apr 24 10:19:43.058646 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading Plugin: ovn-router
Apr 24 10:19:43.065779 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method ExtraGatewaysDbOnlyMixin._delete_router_remove_external_gateways of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x7eec132fab40>> router before_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.065863 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7eec14aedb20> port after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.065942 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7eec14aedc60> port after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.066036 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7eec14aedbc0> subnet after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.066109 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7eec14aeda80> subnetpool_address_scope after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.066203 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <function OVNL3RouterPlugin._port_update at 0x7eec12ea51c0> port before_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.066269 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <function OVNL3RouterPlugin._port_update at 0x7eec12ea51c0> port after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.066355 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x7eec132fab40>> port precommit_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.066468 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip at 0x7eec14ad5580> port before_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.066524 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7eec14ad54e0> port before_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.066598 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x7eec132fab40>> router precommit_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.066679 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method ExtraGatewaysDbOnlyMixin._process_bfd_ecmp_create of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x7eec132fab40>> router precommit_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.066756 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method ExtraGatewaysDbOnlyMixin._process_bfd_ecmp_update of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x7eec132fab40>> router precommit_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.066853 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <function OVNL3RouterPlugin._subnet_update at 0x7eec12ea5120> subnet after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.067432 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.quota.resource_registry [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Tracking information for resource: router configured {{(pid=105599) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 24 10:19:43.067502 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.quota.resource_registry [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Tracking information for resource: floatingip configured {{(pid=105599) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 24 10:19:43.067572 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.services.ovn_l3.plugin [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Starting OVNL3RouterPlugin
Apr 24 10:19:43.067750 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNPortForwarding.register of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x7eec132fa480>> port_forwarding_plugin after_init 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.067917 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x7eec132fb080>> router before_create 55550100, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.067996 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x7eec132fb080>> router precommit_delete 55550100, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.068089 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x7eec132fb080>> router precommit_create 55550100, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.068165 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x7eec132fb080>> router precommit_update 55550100, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.070506 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.services.provider_configuration [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Service providers = [] {{(pid=105599) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:170}}
Apr 24 10:19:43.070579 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.db.servicetype_db [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=105599) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
Apr 24 10:19:43.071607 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVN_L3_HA_db_mixin._precommit_router_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7eec12ebfa10>> router precommit_create 55549900, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.071729 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OvnDriver._process_add_router_interface of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7eec12ebfa10>> router_interface after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.071801 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OvnDriver._process_floatingip_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7eec12ebfa10>> floatingip after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.071965 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OvnDriver._process_floatingip_create_update_precommit of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7eec12ebfa10>> floatingip precommit_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.072067 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OvnDriver._process_floatingip_create_update_precommit of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7eec12ebfa10>> floatingip precommit_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.072211 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OvnDriver._process_floatingip_delete of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7eec12ebfa10>> floatingip after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.072328 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OvnDriver._process_floatingip_status_update of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7eec12ebfa10>> floatingip after_status_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.072434 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OvnDriver._process_floatingip_update of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7eec12ebfa10>> floatingip after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.072563 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OvnDriver._process_portforwarding_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7eec12ebfa10>> port_forwarding after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.072636 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OvnDriver._process_remove_router_interface of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7eec12ebfa10>> router_interface after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.072723 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OvnDriver._process_router_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7eec12ebfa10>> router after_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.072792 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OvnDriver._process_router_create_precommit of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7eec12ebfa10>> router precommit_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.072857 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OvnDriver._process_router_delete of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7eec12ebfa10>> router after_delete 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.072933 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OvnDriver._process_router_update of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x7eec12ebfa10>> router after_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.073032 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.services.service_base [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded 'neutron.services.ovn_l3.service_providers.ovn.OvnDriver' provider for service L3_ROUTER_NAT {{(pid=105599) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Apr 24 10:19:43.073100 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <bound method OVNL3RouterPlugin._post_fork_initialize of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x7eec132fab40>> process after_init 55550001, True {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.073236 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding using OVN {{(pid=105599) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 24 10:19:43.073326 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading Plugin: auto_allocate
Apr 24 10:19:43.074020 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7eec12ea74c0> network precommit_update 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.074104 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron_lib.callbacks.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7eec12ea74c0> network precommit_create 55550000, False {{(pid=105599) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.074268 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=105599) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 24 10:19:43.074344 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading Plugin: tag
Apr 24 10:19:43.076359 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=105599) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 24 10:19:43.076469 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading Plugin: timestamp
Apr 24 10:19:43.077435 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=105599) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 24 10:19:43.077546 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading Plugin: network_ip_availability
Apr 24 10:19:43.078693 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=105599) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 24 10:19:43.078780 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading Plugin: flavors
Apr 24 10:19:43.079503 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=105599) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 24 10:19:43.079610 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading Plugin: revisions
Apr 24 10:19:43.080336 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.manager [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=105599) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 24 10:19:43.080465 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG oslo_concurrency.lockutils [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.461s {{(pid=105599) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 10:19:43.080628 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] get_extension_paths = OrderedDict({'/opt/stack/neutron/neutron/extensions': 1}) {{(pid=105599) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}}
Apr 24 10:19:43.080706 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Initializing extension manager.
Apr 24 10:19:43.080953 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: __init__.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.081017 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: __pycache__ {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.081103 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: address_group.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.081416 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.081614 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: address-group
Apr 24 10:19:43.081687 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: address_scope.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.081940 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.082099 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: address-scope
Apr 24 10:19:43.082169 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: admin_state_down_before_update.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.082381 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.082526 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension router-admin-state-down-before-update not supported by any of loaded plugins
Apr 24 10:19:43.082601 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: agent.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.082842 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.082982 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: agent
Apr 24 10:19:43.083055 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: agent_resources_synced.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.083253 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.083414 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension agent-resources-synced not supported by any of loaded plugins
Apr 24 10:19:43.083500 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: allowedaddresspairs.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.084087 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.084250 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: allowed-address-pairs
Apr 24 10:19:43.084327 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: auto_allocated_topology.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.084550 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.084691 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: auto-allocated-topology
Apr 24 10:19:43.084759 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: availability_zone.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.084994 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.085129 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: availability_zone
Apr 24 10:19:43.085258 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: availability_zone_filter.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.085534 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.085686 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension availability_zone_filter not supported by any of loaded plugins
Apr 24 10:19:43.085753 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: data_plane_status.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.085950 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.086090 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension data-plane-status not supported by any of loaded plugins
Apr 24 10:19:43.086157 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: default_subnetpools.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.086348 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.086506 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: default-subnetpools
Apr 24 10:19:43.086594 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: dhcpagentscheduler.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.086901 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.087094 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: dhcp_agent_scheduler
Apr 24 10:19:43.087094 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: dns.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.087305 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.087466 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: dns-integration
Apr 24 10:19:43.087539 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: dns_domain_ports.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.087730 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.087850 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: dns-domain-ports
Apr 24 10:19:43.087914 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.088110 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like <project_id>, <project_name>, <user_id> and <user_name> as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.088236 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: dns-integration-domain-keywords
Apr 24 10:19:43.088303 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: dvr.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.088542 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.088672 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension dvr not supported by any of loaded plugins
Apr 24 10:19:43.088737 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: ecmp_routes.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.088922 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.089057 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension ecmp_routes not supported by any of loaded plugins
Apr 24 10:19:43.089138 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: empty_string_filtering.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.089416 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.089545 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: empty-string-filtering
Apr 24 10:19:43.089631 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.089799 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.089933 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
Apr 24 10:19:43.089998 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.090204 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.090341 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
Apr 24 10:19:43.090436 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: external_net.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.090646 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.090786 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: external-net
Apr 24 10:19:43.090851 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: extra_dhcp_opt.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.091035 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.091170 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: extra_dhcp_opt
Apr 24 10:19:43.091233 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: extraroute.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.091441 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.091577 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: extraroute
Apr 24 10:19:43.091642 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: extraroute_atomic.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.091839 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.091974 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: extraroute-atomic
Apr 24 10:19:43.092037 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: filter_validation.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.092235 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.092397 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: filter-validation
Apr 24 10:19:43.092465 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: fip_pf_description.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.092629 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.092762 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
Apr 24 10:19:43.092840 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: fip_pf_detail.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.093053 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Floating IP port forwarding detail" alias="floating-ip-port-forwarding-detail" description="Allow list floating ip return more port forwarding data, include'id' and 'internal_port_id'" updated="2022-05-06T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.093268 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: floating-ip-port-forwarding-detail
Apr 24 10:19:43.093353 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: fip_pf_port_range.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.093548 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Floating IP Port Forwarding support port ranges" alias="floating-ip-port-forwarding-port-ranges" description="Add support to port ranges" updated="2020-07-01T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.093708 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension floating-ip-port-forwarding-port-ranges not supported by any of loaded plugins
Apr 24 10:19:43.093807 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: fip_port_details.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.094091 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.094286 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: fip-port-details
Apr 24 10:19:43.094467 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: flavors.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.095680 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.095911 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: flavors
Apr 24 10:19:43.096030 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.096511 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.096709 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
Apr 24 10:19:43.096815 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: floatingip_pools.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.097125 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.097420 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: floatingip-pools
Apr 24 10:19:43.097469 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: ip_allocation.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.097706 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.097841 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension ip_allocation not supported by any of loaded plugins
Apr 24 10:19:43.097899 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.098091 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.098220 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension ip-substring-filtering not supported by any of loaded plugins
Apr 24 10:19:43.098300 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: l2_adjacency.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.098535 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.098712 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension l2_adjacency not supported by any of loaded plugins
Apr 24 10:19:43.098830 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: l3.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.099194 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.099338 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: router
Apr 24 10:19:43.099422 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: l3_conntrack_helper.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.099963 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.100113 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension l3-conntrack-helper not supported by any of loaded plugins
Apr 24 10:19:43.100177 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: l3_enable_default_route_bfd.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.100388 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Enable Default Route BFD" alias="enable-default-route-bfd" description="Enables configurable BFD behavior for default routes" updated="2023-02-27T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.100534 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: enable-default-route-bfd
Apr 24 10:19:43.100608 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: l3_enable_default_route_ecmp.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.100806 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Enable Default Route ECMP" alias="enable-default-route-ecmp" description="Enables configurable ECMP behavior for default routes" updated="2023-02-27T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.100938 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: enable-default-route-ecmp
Apr 24 10:19:43.100998 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.101228 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.101358 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: ext-gw-mode
Apr 24 10:19:43.101445 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.101632 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.101822 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: l3-ha
Apr 24 10:19:43.101896 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: l3_ext_ndp_proxy.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.102074 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Router support to enable NDP proxy" alias="l3-ext-ndp-proxy" description="Router extension to enable ndp proxy" updated="2020-08-25T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.102206 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension l3-ext-ndp-proxy not supported by any of loaded plugins
Apr 24 10:19:43.102289 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: l3_extra_gws.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.102512 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Neutron L3 External Gateway Multihoming" alias="external-gateway-multihoming" description="Allow multiple external gateway ports per router" updated="2023-01-18T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.102687 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: external-gateway-multihoming
Apr 24 10:19:43.102742 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: l3_flavors.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.102933 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.103066 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: l3-flavors
Apr 24 10:19:43.103138 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: l3_ndp_proxy.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.103380 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="name" alias="l3-ndp-proxy" description="description" updated="2021-06-29T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.103523 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension l3-ndp-proxy not supported by any of loaded plugins
Apr 24 10:19:43.103591 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.103774 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.103906 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension l3-port-ip-change-not-allowed not supported by any of loaded plugins
Apr 24 10:19:43.103972 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: l3agentscheduler.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.104460 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.104603 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension l3_agent_scheduler not supported by any of loaded plugins
Apr 24 10:19:43.104674 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: local_ip.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.104931 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.105064 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension local_ip not supported by any of loaded plugins
Apr 24 10:19:43.105128 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: logging.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.105480 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.105622 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension logging not supported by any of loaded plugins
Apr 24 10:19:43.105687 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: metering.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.106069 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.106210 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension metering not supported by any of loaded plugins
Apr 24 10:19:43.106288 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.106529 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.106663 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension metering_source_and_destination_fields not supported by any of loaded plugins
Apr 24 10:19:43.106729 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: multiprovidernet.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.106928 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.107059 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: multi-provider
Apr 24 10:19:43.107123 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: netmtu.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.107320 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.107766 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: net-mtu
Apr 24 10:19:43.107834 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: netmtu_writable.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.108031 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.108170 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: net-mtu-writable
Apr 24 10:19:43.108260 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: network_availability_zone.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.108462 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.108589 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: network_availability_zone
Apr 24 10:19:43.108649 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: network_ha.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.108847 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Network HA creation flag" alias="network_ha" description="Network high availability creation flag." updated="2023-04-27T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.108974 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension network_ha not supported by any of loaded plugins
Apr 24 10:19:43.109037 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: network_ip_availability.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.109285 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.109418 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: network-ip-availability
Apr 24 10:19:43.109487 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: network_ip_availability_details.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.109689 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Network IP Availability Details Extension" alias="network-ip-availability-details" description="Add ip_availability_details attribute to network-ip-availabilities resource." updated="2025-10-31T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.109823 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: network-ip-availability-details
Apr 24 10:19:43.109895 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: network_segment_range.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.110151 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.110294 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension network-segment-range not supported by any of loaded plugins
Apr 24 10:19:43.110383 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: pagination.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.110555 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.110630 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: pagination
Apr 24 10:19:43.110697 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: port_device_profile.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.110868 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.111001 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: port-device-profile
Apr 24 10:19:43.111071 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: port_hardware_offload_type.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.111244 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Port hardware offload" alias="port-hardware-offload-type" description="Expose port hardware offload extension" updated="2023-05-09T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.111384 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension port-hardware-offload-type not supported by any of loaded plugins
Apr 24 10:19:43.111451 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: port_hint_ovs_tx_steering.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.111630 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Port hint: Open vSwitch Tx steering" alias="port-hint-ovs-tx-steering" description="Enable Port hint: Open vSwitch Tx steering" updated="2023-01-01T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.111759 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension port-hint-ovs-tx-steering not supported by any of loaded plugins
Apr 24 10:19:43.111828 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: port_hints.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.112001 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Port hints" alias="port-hints" description="Backend specific port hints to allow backend specific tuning" updated="2023-01-01T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.112149 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension port-hints not supported by any of loaded plugins
Apr 24 10:19:43.112221 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: port_mac_address_override.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.112420 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Neutron Port MAC address override" alias="port-mac-override" description="Allow overriding the MAC address of a direct-physical Port via the active binding profile" updated="2022-03-18T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.112565 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension port-mac-override not supported by any of loaded plugins
Apr 24 10:19:43.112647 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.112826 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.112960 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: port-mac-address-regenerate
Apr 24 10:19:43.113031 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.113257 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.113417 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: port-numa-affinity-policy
Apr 24 10:19:43.113478 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: port_numa_affinity_policy_socket.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.113655 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Port NUMA affinity policy "socket"" alias="port-numa-affinity-policy-socket" description="Adds "socket" to the supported port NUMA affinity policies" updated="2024-02-09T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.113785 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: port-numa-affinity-policy-socket
Apr 24 10:19:43.113854 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: port_resource_request.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.114026 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.114155 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension port-resource-request not supported by any of loaded plugins
Apr 24 10:19:43.114223 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: port_resource_request_groups.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.114427 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.114554 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension port-resource-request-groups not supported by any of loaded plugins
Apr 24 10:19:43.114638 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: port_trusted_vif.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.114835 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Port trusted vif" alias="port-trusted-vif" description="Expose port 'trusted' attribute in the API" updated="2024-07-10T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.114971 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension port-trusted-vif not supported by any of loaded plugins
Apr 24 10:19:43.115040 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: portbindings.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.115214 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.115393 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: binding
Apr 24 10:19:43.115477 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: portbindings_extended.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.115726 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.115917 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: binding-extended
Apr 24 10:19:43.116015 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: portsecurity.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.116240 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.116384 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: port-security
Apr 24 10:19:43.116476 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: project_id.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.116664 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.116739 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: project-id
Apr 24 10:19:43.116811 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: providernet.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.116984 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.117122 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: provider
Apr 24 10:19:43.117193 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: qinq.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.117450 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="QinQ networks" alias="qinq" description="Expose network 'qinq' attribute in the API. This allows to configure network to allow vlan in vlan configuration using 0x8a88 ethertype (QinQ)." updated="2024-12-02T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.117588 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: qinq
Apr 24 10:19:43.117672 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: qos.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.118627 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.118627 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension qos not supported by any of loaded plugins
Apr 24 10:19:43.118627 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.118800 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.118945 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
Apr 24 10:19:43.119029 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.119214 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.119381 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
Apr 24 10:19:43.119465 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: qos_default.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.119647 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.119782 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension qos-default not supported by any of loaded plugins
Apr 24 10:19:43.119854 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: qos_fip.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.120031 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.120165 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension qos-fip not supported by any of loaded plugins
Apr 24 10:19:43.120236 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: qos_fip_network_policy.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.120439 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="QoS floating IP network policy ID" alias="qos-fip-network-policy" description="Adds a the QoS network ID to the floating IP definition" updated="2021-11-15T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.120582 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension qos-fip-network-policy not supported by any of loaded plugins
Apr 24 10:19:43.120653 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: qos_gateway_ip.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.120829 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.120961 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension qos-gateway-ip not supported by any of loaded plugins
Apr 24 10:19:43.121031 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: qos_port_network_policy.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.121204 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.121380 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension qos-port-network-policy not supported by any of loaded plugins
Apr 24 10:19:43.121462 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.121650 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.121838 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension qos-pps-minimum not supported by any of loaded plugins
Apr 24 10:19:43.121914 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: qos_pps_minimum_rule_alias.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.122102 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="QoS minimum packet rate rule alias" alias="qos-pps-minimum-rule-alias" description="API to enable GET, PUT and DELETE operations on QoS minimum packet rate rule without specifying policy ID" updated="2021-10-22T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.122235 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension qos-pps-minimum-rule-alias not supported by any of loaded plugins
Apr 24 10:19:43.122306 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: qos_pps_rule.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.122580 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.122716 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension qos-pps not supported by any of loaded plugins
Apr 24 10:19:43.122787 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: qos_rule_type_details.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.122967 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.123100 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension qos-rule-type-details not supported by any of loaded plugins
Apr 24 10:19:43.123172 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: qos_rule_type_filter.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.123352 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Allow to filter the list of QoS rule types" alias="qos-rule-type-filter" description="Allows to filter the QoS rule type list adding two new flags. "all_rules" prints all implemented QoS rule types."all_supported" prints all supported QoS rule types by the loaded mechanism drivers" updated="2022-02-02T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.123515 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension qos-rule-type-filter not supported by any of loaded plugins
Apr 24 10:19:43.123588 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: qos_rules_alias.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.123775 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.123908 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension qos-rules-alias not supported by any of loaded plugins
Apr 24 10:19:43.123978 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: quota_check_limit.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.124155 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.124289 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: quota-check-limit
Apr 24 10:19:43.124359 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: quota_check_limit_default.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.124569 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Quota engine limit check by default" alias="quota-check-limit-default" description="By default, the Neutron quota engine checks the resource usage before applying a new quota limit" updated="2024-08-21T16:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.124700 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: quota-check-limit-default
Apr 24 10:19:43.124772 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: quotasv2.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.125176 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.125473 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: quotas
Apr 24 10:19:43.125557 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: quotasv2_detail.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.125822 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.125896 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: quota_details
Apr 24 10:19:43.125965 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: rbac.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.126344 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control project access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.126526 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: rbac-policies
Apr 24 10:19:43.126593 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: rbac_address_group.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.126824 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.126966 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension rbac-address-group not supported by any of loaded plugins
Apr 24 10:19:43.127036 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: rbac_address_scope.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.127222 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.127375 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: rbac-address-scope
Apr 24 10:19:43.127474 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: rbac_security_groups.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.127665 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.127815 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: rbac-security-groups
Apr 24 10:19:43.127889 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: rbac_subnetpool.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.128068 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.128204 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension rbac-subnetpool not supported by any of loaded plugins
Apr 24 10:19:43.128278 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: revisionifmatch.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.128476 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.128614 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: revision-if-match
Apr 24 10:19:43.128684 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: revisions.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.128881 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.129015 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: standard-attr-revisions
Apr 24 10:19:43.129088 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: router_availability_zone.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.129315 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.129464 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: router_availability_zone
Apr 24 10:19:43.129536 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: router_enable_snat.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.129722 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Exposes the router "enable_snat" read-only configuration flag" alias="router-enable-snat" description="Exposes the router "enable_snat" read-only configuration flag" updated="2025-09-18T18:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.129859 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: router-enable-snat
Apr 24 10:19:43.129932 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: routerservicetype.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.130110 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.130242 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension router-service-type not supported by any of loaded plugins
Apr 24 10:19:43.130319 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: security_groups_default_rules.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.130734 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Default rules for security groups" alias="security-groups-default-rules" description="Configure set of security group rules used as default rules for every new security group" updated="2022-12-19T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.130876 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: security-groups-default-rules
Apr 24 10:19:43.130941 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.131134 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.131271 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: security-groups-normalized-cidr
Apr 24 10:19:43.131337 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: security_groups_port_filtering.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.131542 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.131669 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension port-security-groups-filtering not supported by any of loaded plugins
Apr 24 10:19:43.131742 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.131928 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.132056 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: security-groups-remote-address-group
Apr 24 10:19:43.132127 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: security_groups_rules_belongs_to_default_sg.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.132304 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Security group rule belongs to the project's default security group" alias="security-groups-rules-belongs-to-default-sg" description="Flag to determine if the security group rule belongs to the project's default security group" updated="2023-05-23T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.132455 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: security-groups-rules-belongs-to-default-sg
Apr 24 10:19:43.132525 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.132706 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.132840 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: security-groups-shared-filtering
Apr 24 10:19:43.132910 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: securitygroup.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.134332 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.134496 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: security-group
Apr 24 10:19:43.134553 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: segment.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.134805 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.134942 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension segment not supported by any of loaded plugins
Apr 24 10:19:43.135007 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.135194 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.135321 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
Apr 24 10:19:43.135409 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: servicetype.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.135606 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.135734 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: service-type
Apr 24 10:19:43.135803 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: sorting.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.135981 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.136054 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: sorting
Apr 24 10:19:43.136123 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: standard_attr_segment.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.136293 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.136448 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension standard-attr-segment not supported by any of loaded plugins
Apr 24 10:19:43.136517 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: standardattrdescription.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.136712 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.136845 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: standard-attr-description
Apr 24 10:19:43.136913 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: stateful_security_group.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.137086 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.137253 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: stateful-security-group
Apr 24 10:19:43.137317 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: stdattrs_common.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.137502 np0000170011 neutron-ovn-maintenance-worker[105599]: WARNING neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
Apr 24 10:19:43.137571 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.137743 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.137878 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: subnet-dns-publish-fixed-ip
Apr 24 10:19:43.137946 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: subnet_external_network.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.138118 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Subnet belongs to an external network" alias="subnet-external-network" description="Informs if the subnet belongs to an external network" updated="2024-02-05T18:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.138248 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: subnet-external-network
Apr 24 10:19:43.138318 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: subnet_onboard.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.138527 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.138782 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension subnet_onboard not supported by any of loaded plugins
Apr 24 10:19:43.138852 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.139028 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.139163 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
Apr 24 10:19:43.139235 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: subnet_service_types.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.139432 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.139569 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: subnet-service-types
Apr 24 10:19:43.139632 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: subnetallocation.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.139829 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.139956 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: subnet_allocation
Apr 24 10:19:43.140025 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.140307 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.140453 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: subnetpool-prefix-ops
Apr 24 10:19:43.140511 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: tag_creation.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.140694 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Tag creation extension" alias="tag-creation" description="Allow to create multiple tags for a resource" updated="2024-23-07T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.140827 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: tag-creation
Apr 24 10:19:43.140892 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.141071 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.141196 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
Apr 24 10:19:43.141279 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: tagging.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.141997 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.142171 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: standard-attr-tag
Apr 24 10:19:43.142231 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: timestamp.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.142480 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.142619 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: standard-attr-timestamp
Apr 24 10:19:43.142688 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: trunk.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.142889 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.143021 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension trunk not supported by any of loaded plugins
Apr 24 10:19:43.143096 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: trunk_details.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.143281 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.143440 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension trunk-details not supported by any of loaded plugins
Apr 24 10:19:43.143515 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: uplink_status_propagation.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.143695 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.143829 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension uplink-status-propagation not supported by any of loaded plugins
Apr 24 10:19:43.143891 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: uplink_status_propagation_updatable.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.144075 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Uplink status propagation updatable extension" alias="uplink-status-propagation-updatable" description="Provides ability to update the port uplink status." updated="2024-09-03T18:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.144218 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Extension uplink-status-propagation-updatable not supported by any of loaded plugins
Apr 24 10:19:43.144289 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loading extension file: vlantransparent.py {{(pid=105599) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 24 10:19:43.144525 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=105599) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 24 10:19:43.144648 np0000170011 neutron-ovn-maintenance-worker[105599]: INFO neutron.api.extensions [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Loaded extension: vlan-transparent
Apr 24 10:19:43.147061 np0000170011 neutron-ovn-maintenance-worker[105599]: WARNING oslo_service.backend._threading.service [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Service MaintenanceWorker is not picklable with spawn; falling back to fork. Please make the service spawn-safe to avoid this fallback.
Apr 24 10:19:43.147391 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Full set of CONF: {{(pid=105599) _load_service_manager_options /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/oslo_config_glue.py:59}}
Apr 24 10:19:43.147515 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ******************************************************************************** {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 24 10:19:43.147615 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Configuration options gathered from: {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 24 10:19:43.147794 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 24 10:19:43.147860 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 24 10:19:43.147927 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ================================================================================ {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 24 10:19:43.148099 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] agent_down_time                = 75 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.148217 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] allow_automatic_dhcp_failover  = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.148308 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] allow_bulk                     = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.148539 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.148657 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] api_extensions_path            =  {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.148739 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] api_paste_config               = api-paste.ini {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.148815 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] api_workers                    = 4 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.148904 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] auth_strategy                  = keystone {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.148991 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] base_mac                       = fa:16:3e:00:00:00 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.149106 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] bind_host                      = 0.0.0.0 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.149191 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] bind_port                      = 9696 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.149298 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] client_socket_timeout          = 900 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.149425 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] config_dir                     = [] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.149511 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.149607 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] config_source                  = [] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.149697 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] control_exchange               = neutron {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.149785 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] core_plugin                    = ml2 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.149874 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] debug                          = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.149959 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] default_availability_zones     = [] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.150110 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.150190 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] dhcp_agent_notification        = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.150271 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] dhcp_agents_per_network        = 1 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.150354 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] dhcp_lease_duration            = 86400 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.150473 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] dhcp_load_type                 = networks {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.150563 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] dns_domain                     = openstacklocal {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.150652 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.150736 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] enable_default_route_bfd       = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.150823 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] enable_default_route_ecmp      = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.150901 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] enable_dvr                     = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.150984 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] enable_new_agents              = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.151066 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.151149 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] enable_snat_by_default         = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.151260 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] enable_traditional_dhcp        = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.151391 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] external_dns_driver            = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.151455 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] filter_validation              = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.151551 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] global_physnet_mtu             = 1430 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.151616 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] graceful_shutdown_timeout      = 60 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.151747 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] host                           = np0000170011 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.151835 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] host_dvr_for_dhcp              = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.151947 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] http_retries                   = 3 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.152038 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] instance_format                = [instance: %(uuid)s]  {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.152088 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.152177 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ipam_driver                    = internal {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.152267 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ipv6_pd_enabled                = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.152351 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] l3_ha                          = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.152458 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.152546 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] l3_ha_network_physical_name    =  {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.152635 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] l3_ha_network_type             =  {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.152729 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] log_color                      = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.152818 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] log_config_append              = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.152907 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.152991 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] log_dir                        = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.153075 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] log_file                       = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.153141 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] log_options                    = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.153599 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] log_rotate_interval            = 1 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.153599 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] log_rotate_interval_type       = days {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.153599 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] log_rotation_type              = none {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.153599 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.153599 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.153781 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.153820 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.153899 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.153997 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] max_allowed_address_pair       = 10 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.154085 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] max_dns_nameservers            = 5 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.154169 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] max_header_line                = 16384 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.154252 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] max_l3_agents_per_router       = 3 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.154337 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] max_logfile_count              = 30 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.154439 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] max_logfile_size_mb            = 200 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.154525 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] max_routes                     = 30 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.154608 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] max_subnet_host_routes         = 20 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.154697 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] my_ip                          = 199.204.45.227 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.154784 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] my_ipv6                        = 2604:e100:1:0:f816:3eff:fe5d:e9e5 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.154868 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] network_auto_schedule          = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.154957 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] network_link_prefix            = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.155047 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.155134 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] notify_nova_on_port_data_changes = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.155220 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] notify_nova_on_port_status_changes = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.155314 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] pagination_max_limit           = -1 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.155417 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] periodic_fuzzy_delay           = 5 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.155501 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] periodic_interval              = 40 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.155593 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] publish_errors                 = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.155724 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] rate_limit_burst               = 0 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.155819 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] rate_limit_except_level        = CRITICAL {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.155904 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] rate_limit_interval            = 0 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.155989 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] router_distributed             = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.156075 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] rpc_resources_processing_step  = 20 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.156642 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] rpc_response_max_timeout       = 600 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.156642 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] rpc_response_timeout           = 60 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.156642 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] rpc_state_report_workers       = 0 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.156642 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] rpc_workers                    = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.156642 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] send_events_interval           = 2 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.156642 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] service_plugins                = ['ovn-router'] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.157008 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] setproctitle                   = on {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.157008 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] shell_completion               = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.157008 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] state_path                     = /opt/stack/data/neutron {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.157008 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] syslog_log_facility            = LOG_USER {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.157008 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] tcp_keepidle                   = 600 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.157177 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] transport_url                  = **** {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.157177 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] use_journal                    = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.157285 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] use_json                       = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.157328 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] use_stderr                     = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.157451 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] use_syslog                     = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.157532 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] vlan_qinq                      = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.157615 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] vlan_transparent               = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.157699 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] wsgi_default_pool_size         = 100 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.157782 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] wsgi_keep_alive                = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.157870 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.157953 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] wsgi_server_debug              = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.158055 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_concurrency.disable_process_locking = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.158150 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.158250 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] profiler.connection_string     = messaging:// {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.158339 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] profiler.enabled               = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.158452 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] profiler.es_doc_type           = notification {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.158586 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] profiler.es_scroll_size        = 10000 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.158695 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] profiler.es_scroll_time        = 2m {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.158781 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] profiler.filter_error_trace    = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.158874 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] profiler.hmac_keys             = **** {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.158963 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] profiler.sentinel_service_name = mymaster {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.159060 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] profiler.socket_timeout        = 0.1 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.159147 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] profiler.trace_requests        = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.159232 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] profiler.trace_sqlalchemy      = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.159325 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] profiler_jaeger.process_tags   = {} {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.159429 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] profiler_jaeger.service_name_prefix = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.159517 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] profiler_otlp.service_name_prefix = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.159609 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.159695 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.159785 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.159874 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.159960 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.160059 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_policy.enforce_new_defaults = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.160237 np0000170011 neutron-ovn-maintenance-worker[105599]: WARNING oslo_config.cfg [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 24 10:19:43.160388 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_policy.enforce_scope      = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.160470 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_policy.policy_default_rule = default {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.160573 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.160663 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.160790 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.160890 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.160975 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.161059 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.161145 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.161261 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.161385 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.161482 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] service_providers.service_provider = [] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.161576 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.auth_section              = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.161670 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.auth_type                 = password {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.161761 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.auth_url                  = https://199.204.45.227/identity {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.161868 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.cafile                    = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.161978 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.certfile                  = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.162080 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.collect_timing            = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.162166 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.default_domain_id         = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.162250 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.default_domain_name       = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.162508 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.domain_id                 = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.162593 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.domain_name               = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.162685 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.endpoint_type             = public {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.162769 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.insecure                  = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.162906 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.keyfile                   = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.162952 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.password                  = **** {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.163018 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.project_domain_id         = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.163106 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.project_domain_name       = Default {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.163234 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.project_id                = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.163332 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.project_name              = service {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.163447 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.region_name               = RegionOne {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.163534 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.split_loggers             = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.163618 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.system_scope              = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.163712 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.timeout                   = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.163796 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.trust_id                  = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.163935 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.user_domain_id            = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.163976 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.user_domain_name          = Default {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.164037 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.user_id                   = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.164127 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] nova.username                  = nova {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.164258 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] placement.auth_section         = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.164304 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] placement.auth_type            = password {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.164403 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] placement.cafile               = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.164495 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] placement.certfile             = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.164582 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] placement.collect_timing       = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.164735 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] placement.endpoint_type        = public {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.164735 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] placement.insecure             = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.164810 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] placement.keyfile              = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.164899 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] placement.region_name          = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.164984 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] placement.split_loggers        = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.165077 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] placement.timeout              = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.165163 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.auth_section            = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.165267 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.auth_type               = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.165352 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.cafile                  = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.165450 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.certfile                = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.165538 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.collect_timing          = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.165623 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.connect_retries         = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.165707 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.connect_retry_delay     = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.165792 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.enable_notifications    = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.165877 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.endpoint_override       = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.165962 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.insecure                = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.166044 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.interface               = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.166128 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.keyfile                 = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.166212 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.max_version             = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.166294 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.min_version             = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.166398 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.region_name             = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.166487 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.retriable_status_codes  = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.166570 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.service_name            = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.166653 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.service_type            = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.166739 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.split_loggers           = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.166821 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.status_code_retries     = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.166904 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.status_code_retry_delay = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.166987 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.timeout                 = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.167070 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.valid_interfaces        = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.167152 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ironic.version                 = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.167242 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] cli_script.dry_run             = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.167337 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.167439 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.167527 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.167618 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.167705 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.167789 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.167875 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.167961 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.168081 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.168188 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.hostname = np0000170011 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.168275 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.168379 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.168475 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.168564 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.168652 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.168742 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.processname = neutron-ovn-maintenance-worker {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.168828 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.168915 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.169006 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.169092 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.169213 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.169407 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.169510 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.169601 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.169690 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.169779 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.169867 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.169956 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.170061 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.170125 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.170218 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.ssl      = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.170529 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.170638 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.170729 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.170817 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.170913 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.170996 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.171089 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_notifications.driver = [] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.171178 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_notifications.retry = -1 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.171275 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.171377 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_messaging_notifications.transport_url = **** {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.171471 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_reports.file_event_handler = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.171558 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.171644 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_reports.log_dir           = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.171734 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.171826 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] QUOTAS.default_quota           = -1 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.171918 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] QUOTAS.quota_driver            = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.172006 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] QUOTAS.quota_floatingip        = 50 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.172092 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] QUOTAS.quota_network           = 100 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.172178 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] QUOTAS.quota_port              = 500 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.172265 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] QUOTAS.quota_rbac_policy       = 10 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.172350 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] QUOTAS.quota_router            = 10 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.172457 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] QUOTAS.quota_security_group    = 10 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.172543 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.172630 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] QUOTAS.quota_subnet            = 100 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.172716 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] QUOTAS.track_quota_usage       = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.172811 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.172897 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep.group                  = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.172982 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep.helper_command         = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.173069 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep.log_daemon_traceback   = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.173158 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep.logger_name            = oslo_privsep.daemon {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.173300 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep.thread_pool_size       = 16 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.173397 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep.user                   = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.173489 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.173574 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_dhcp_release.group     = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.173664 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_dhcp_release.helper_command = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.173749 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.173837 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.173924 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_dhcp_release.thread_pool_size = 16 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.174007 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_dhcp_release.user      = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.174098 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.174182 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_ovs_vsctl.group        = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.174267 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_ovs_vsctl.helper_command = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.174381 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.174483 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_ovs_vsctl.logger_name  = oslo_privsep.daemon {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.174571 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_ovs_vsctl.thread_pool_size = 16 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.174655 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_ovs_vsctl.user         = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.174746 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_namespace.capabilities = [21] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.174829 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_namespace.group        = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.174914 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_namespace.helper_command = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.175000 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_namespace.log_daemon_traceback = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.175089 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_namespace.logger_name  = oslo_privsep.daemon {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.175176 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_namespace.thread_pool_size = 16 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.175260 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_namespace.user         = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.175349 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_conntrack.capabilities = [12] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.175452 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_conntrack.group        = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.175536 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_conntrack.helper_command = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.175622 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.175711 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_conntrack.logger_name  = oslo_privsep.daemon {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.175798 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_conntrack.thread_pool_size = 16 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.175879 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_conntrack.user         = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.175992 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_link.capabilities      = [12, 21] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.176054 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_link.group             = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.176139 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_link.helper_command    = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.176226 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_link.log_daemon_traceback = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.176314 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_link.logger_name       = oslo_privsep.daemon {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.176417 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_link.thread_pool_size  = 16 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.176503 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] privsep_link.user              = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.176599 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] AGENT.root_helper              = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.176692 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] AGENT.root_helper_daemon       = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.176780 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] AGENT.use_helper_for_ns_read   = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.176873 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] SECURITYGROUP.enable_ipset     = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.176963 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] SECURITYGROUP.enable_security_group = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.177049 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] SECURITYGROUP.firewall_driver  = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.177141 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.177233 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] experimental.ipv6_pd_enabled   = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.177378 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ml2.extension_drivers          = ['port_security', 'qos'] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.177484 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ml2.external_network_type      = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.177582 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ml2.mechanism_drivers          = ['ovn'] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.177718 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ml2.overlay_ip_version         = 4 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.177845 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ml2.path_mtu                   = 0 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.177974 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ml2.physical_network_mtus      = {} {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.178112 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ml2.project_network_types      = ['geneve'] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.178244 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ml2.tunnelled_network_rp_name  = rp_tunnelled {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.178429 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ml2.type_drivers               = ['local', 'flat', 'vlan', 'geneve'] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.178581 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ml2_type_flat.flat_networks    = ['public'] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.178724 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ml2_type_geneve.max_header_size = 38 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.178863 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ml2_type_geneve.vni_ranges     = ['1:65536'] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.179003 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ml2_type_vlan.network_vlan_ranges = ['public'] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.179135 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] network_log.burst_limit        = 25 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.179278 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] network_log.local_output_log_base = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.179439 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] network_log.rate_limit         = 100 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.179583 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.asyncio_connection    = **** {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.179742 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.asyncio_slave_connection = **** {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.179914 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.backend               = sqlalchemy {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.180084 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.connection            = **** {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.180244 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.connection_debug      = 0 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.180402 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.connection_parameters =  {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.180535 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.connection_recycle_time = 3600 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.180669 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.connection_trace      = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.180795 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.db_inc_retry_interval = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.180926 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.db_max_retries        = 20 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.181072 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.db_max_retry_interval = 10 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.181202 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.db_retry_interval     = 1 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.181376 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.max_overflow          = 50 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.181525 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.max_pool_size         = 5 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.181644 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.max_retries           = 10 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.181735 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.181821 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.mysql_wsrep_sync_wait = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.181909 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.pool_timeout          = None {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.181996 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.retry_interval        = 10 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.182084 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.slave_connection      = **** {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.182172 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.sqlite_synchronous    = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.182260 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.synchronous_reader    = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.182361 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] database.use_db_reconnect      = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.182476 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.bfd_min_rx                 = 1000 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.182564 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.bfd_min_tx                 = 100 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.182651 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.bfd_mult                   = 3 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.182739 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.broadcast_arps_to_all_routers = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.182840 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.dhcp_default_lease_time    = 43200 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.182935 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.183043 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.dns_records_ovn_owned      = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.183158 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.dns_servers                = [] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.183268 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.enable_distributed_floating_ip = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.183361 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.fdb_age_threshold          = 300 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.183473 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ha_failover_strategy       = normal {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.183567 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.live_migration_activation_strategy = rarp {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.183657 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.localnet_learn_fdb         = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.183748 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.mac_binding_age_threshold  = 300 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.183841 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.neutron_sync_mode          = log {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.183933 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovn_dhcp4_global_options   = {} {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.184025 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovn_dhcp6_global_options   = {} {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.184124 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovn_l3_scheduler           = leastloaded {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.184219 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovn_metadata_enabled       = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.184318 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovn_nb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.184430 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovn_nb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.184528 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovn_nb_connection          = ['ssl:199.204.45.227:6641'] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.184619 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovn_nb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.184711 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovn_router_indirect_snat   = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.184800 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovn_sb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.184890 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovn_sb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.184983 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovn_sb_connection          = ['ssl:199.204.45.227:6642'] {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.185074 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovn_sb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.185160 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovs_create_tap             = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.185263 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovsdb_connection_timeout   = 180 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.185362 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovsdb_log_level            = INFO {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.185469 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovsdb_probe_interval       = 60000 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.185558 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.ovsdb_retry_max_interval   = 180 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.185649 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.stateless_nat_enabled      = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.185740 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn.vhost_sock_dir             = /var/run/openvswitch {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.185835 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] OVS.bridge_mac_table_size      = 50000 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.185923 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] OVS.igmp_flood                 = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.186010 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] OVS.igmp_flood_reports         = True {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.186097 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] OVS.igmp_flood_unregistered    = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.186190 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] OVS.igmp_snooping_enable       = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.186280 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] OVS.ovsdb_timeout              = 10 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.186414 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn_nb_global.fdb_removal_limit = 0 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.186508 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn_nb_global.ignore_lsp_down  = False {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.186603 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.186676 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG cotyledon.oslo_config_glue [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] ******************************************************************************** {{(pid=105599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 24 10:19:43.186765 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG oslo_service.backend._threading.service [None req-feffe747-83cc-4e99-be7f-08b586ff6046 None None] Selected the multiprocessing context: <multiprocessing.context.ForkContext object at 0x7eec19166ba0> and updated it in Cotyledon ServiceManager: <multiprocessing.context.ForkContext object at 0x7eec19166ba0> {{(pid=105599) launch_service /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/service.py:394}}
Apr 24 10:19:43.219470 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] Full set of CONF: {{(pid=106381) _load_service_options /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/oslo_config_glue.py:65}}
Apr 24 10:19:43.219470 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ******************************************************************************** {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 24 10:19:43.220172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] Configuration options gathered from: {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 24 10:19:43.220172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 24 10:19:43.220172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 24 10:19:43.220172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ================================================================================ {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 24 10:19:43.220172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] agent_down_time                = 75 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.220172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] allow_automatic_dhcp_failover  = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.220172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] allow_bulk                     = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] api_extensions_path            =  {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] api_paste_config               = api-paste.ini {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] api_workers                    = 4 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] auth_strategy                  = keystone {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.221037 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.221037 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] bind_host                      = 0.0.0.0 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.221037 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] bind_port                      = 9696 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.221234 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] client_socket_timeout          = 900 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.221234 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] config_dir                     = [] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.221234 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.221508 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] config_source                  = [] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.221606 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] control_exchange               = neutron {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.221606 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] core_plugin                    = ml2 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.221738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] debug                          = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.221819 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] default_availability_zones     = [] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.222010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.222174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] dhcp_agent_notification        = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.222174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] dhcp_agents_per_network        = 1 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.222174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] dhcp_lease_duration            = 86400 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.222436 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] dhcp_load_type                 = networks {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.222436 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] dns_domain                     = openstacklocal {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.222568 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.222635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] enable_default_route_bfd       = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.222700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] enable_default_route_ecmp      = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.222803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] enable_dvr                     = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.222880 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] enable_new_agents              = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.222940 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] enable_services_on_agents_with_admin_state_down = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.223039 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] enable_snat_by_default         = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.223118 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] enable_traditional_dhcp        = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.223178 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] external_dns_driver            = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.223248 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] fatal_deprecations             = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.223306 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] filter_validation              = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.223402 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] global_physnet_mtu             = 1430 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.223489 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] graceful_shutdown_timeout      = 60 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.223737 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] host                           = np0000170011 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.223842 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] host_dvr_for_dhcp              = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.223842 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] http_retries                   = 3 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.223973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] instance_format                = [instance: %(uuid)s]  {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.224033 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.224089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ipam_driver                    = internal {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.224147 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ipv6_pd_enabled                = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.224357 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] l3_ha                          = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.224357 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.224357 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_network_physical_name    =  {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.224560 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_network_type             =  {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.224560 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] log_color                      = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.224560 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] log_config_append              = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.224737 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.224737 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] log_dir                        = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.224863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] log_file                       = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.224863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] log_options                    = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.224863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] log_rotate_interval            = 1 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.225075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] log_rotate_interval_type       = days {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.225075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] log_rotation_type              = none {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.225075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.225232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.225232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.225232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.225569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.225569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] max_allowed_address_pair       = 10 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.225569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] max_dns_nameservers            = 5 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.225569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] max_header_line                = 16384 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.225569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] max_l3_agents_per_router       = 3 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.225760 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] max_logfile_count              = 30 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.225760 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] max_logfile_size_mb            = 200 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.225760 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] max_routes                     = 30 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.225878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] max_subnet_host_routes         = 20 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.225919 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] my_ip                          = 199.204.45.227 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.226003 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] my_ipv6                        = 2604:e100:1:0:f816:3eff:fe5d:e9e5 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.226075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] network_auto_schedule          = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.226145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] network_link_prefix            = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.226238 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.226301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] notify_nova_on_port_data_changes = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.226422 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] notify_nova_on_port_status_changes = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.226499 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] pagination_max_limit           = -1 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.226580 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] periodic_fuzzy_delay           = 5 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.226651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] periodic_interval              = 40 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.226723 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] publish_errors                 = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.226792 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_burst               = 0 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.226865 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_except_level        = CRITICAL {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.226920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_interval            = 0 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.226998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] router_distributed             = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.227054 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] rpc_resources_processing_step  = 20 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.227137 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] rpc_response_max_timeout       = 600 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.227216 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] rpc_response_timeout           = 60 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.227285 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] rpc_state_report_workers       = 0 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.227357 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] rpc_workers                    = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.227439 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] send_events_interval           = 2 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.227522 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] service_plugins                = ['ovn-router'] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.227603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] setproctitle                   = on {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.227680 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] shell_completion               = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.227748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] state_path                     = /opt/stack/data/neutron {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.227817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] syslog_log_facility            = LOG_USER {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.227896 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] tcp_keepidle                   = 600 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.227977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] transport_url                  = **** {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.228035 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] use_journal                    = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.228104 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] use_json                       = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.228169 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] use_stderr                     = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.228238 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] use_syslog                     = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.228298 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] vlan_qinq                      = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.228347 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] vlan_transparent               = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.228435 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] wsgi_default_pool_size         = 100 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.228491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] wsgi_keep_alive                = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.228591 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.228653 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] wsgi_server_debug              = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 24 10:19:43.228811 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_concurrency.disable_process_locking = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.228936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.229103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] profiler.connection_string     = messaging:// {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.229187 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] profiler.enabled               = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.229307 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_doc_type           = notification {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.229442 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_scroll_size        = 10000 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.229523 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_scroll_time        = 2m {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.229628 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] profiler.filter_error_trace    = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.229731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] profiler.hmac_keys             = **** {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.229816 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] profiler.sentinel_service_name = mymaster {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.229914 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] profiler.socket_timeout        = 0.1 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.229989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] profiler.trace_requests        = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.230063 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] profiler.trace_sqlalchemy      = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.230152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] profiler_jaeger.process_tags   = {} {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.230225 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] profiler_jaeger.service_name_prefix = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.230292 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] profiler_otlp.service_name_prefix = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.230423 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.230502 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.230574 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_process_name =  {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.230661 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.230717 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.230818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.enforce_new_defaults = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.230869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.enforce_scope      = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.230912 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_default_rule = default {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.230953 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.230993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231105 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231149 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231190 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231282 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_timeout     = 60.0 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231435 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] service_providers.service_provider = [] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_section              = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231549 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_type                 = password {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_url                  = https://199.204.45.227/identity {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.cafile                    = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.certfile                  = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231726 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.collect_timing            = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.default_domain_id         = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231811 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.default_domain_name       = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.domain_id                 = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231893 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.domain_name               = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.endpoint_type             = public {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.231973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.insecure                  = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232012 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.keyfile                   = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.password                  = **** {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232100 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.project_domain_id         = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232147 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.project_domain_name       = Default {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232147 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.project_id                = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232223 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.project_name              = service {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232264 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.region_name               = RegionOne {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232304 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.split_loggers             = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232304 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.system_scope              = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232394 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.timeout                   = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.trust_id                  = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.user_domain_id            = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232527 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.user_domain_name          = Default {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232527 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.user_id                   = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232606 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] nova.username                  = nova {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232606 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] placement.auth_section         = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] placement.auth_type            = password {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232718 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] placement.cafile               = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232759 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] placement.certfile             = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232799 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] placement.collect_timing       = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] placement.endpoint_type        = public {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232893 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] placement.insecure             = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232893 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] placement.keyfile              = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232965 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] placement.region_name          = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.232965 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] placement.split_loggers        = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233037 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] placement.timeout              = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233078 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.auth_section            = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.auth_type               = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233158 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.cafile                  = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233204 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.certfile                = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233251 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.collect_timing          = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233324 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.connect_retries         = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233386 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.connect_retry_delay     = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233439 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.enable_notifications    = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.endpoint_override       = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.insecure                = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.interface               = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.keyfile                 = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.max_version             = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.min_version             = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233725 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.region_name             = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233725 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.retriable_status_codes  = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.service_name            = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.service_type            = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.split_loggers           = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.status_code_retries     = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.status_code_retry_delay = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.timeout                 = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.233993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.valid_interfaces        = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ironic.version                 = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] cli_script.dry_run             = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234328 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234425 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234477 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234477 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234549 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234590 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.hostname = np0000170011 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234670 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234750 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234844 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.processname = neutron-ovn-maintenance-worker {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234889 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234930 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.234970 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235009 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235048 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235094 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235134 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235295 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235295 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235396 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235438 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235567 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl      = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235567 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235567 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235567 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235724 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235724 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_version =  {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235724 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235829 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.driver = [] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235829 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.retry = -1 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235829 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.transport_url = **** {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.235936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.file_event_handler = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236060 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236060 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.log_dir           = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236137 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236137 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.default_quota           = -1 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236208 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_driver            = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_floatingip        = 50 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_network           = 100 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236331 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_port              = 500 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236390 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236447 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_router            = 10 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_security_group    = 10 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_security_group_rule = 100 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_subnet            = 100 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.track_quota_usage       = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236859 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep.group                  = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236916 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep.helper_command         = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep.log_daemon_traceback   = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.236979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep.logger_name            = oslo_privsep.daemon {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep.thread_pool_size       = 16 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep.user                   = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.group     = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.helper_command = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.log_daemon_traceback = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.thread_pool_size = 16 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.user      = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.group        = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.helper_command = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.logger_name  = oslo_privsep.daemon {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.thread_pool_size = 16 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.user         = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.capabilities = [21] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.group        = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.helper_command = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.237870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.log_daemon_traceback = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238063 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.logger_name  = oslo_privsep.daemon {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238063 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.thread_pool_size = 16 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238063 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.user         = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238063 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.capabilities = [12] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238063 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.group        = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238184 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.helper_command = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238184 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.log_daemon_traceback = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238184 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.logger_name  = oslo_privsep.daemon {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.thread_pool_size = 16 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.user         = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.capabilities      = [12, 21] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.group             = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.helper_command    = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.log_daemon_traceback = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238554 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.logger_name       = oslo_privsep.daemon {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238554 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.thread_pool_size  = 16 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238554 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.user              = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238638 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] AGENT.root_helper              = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238669 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] AGENT.root_helper_daemon       = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] AGENT.use_helper_for_ns_read   = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238785 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.enable_ipset     = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.enable_security_group = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.firewall_driver  = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.238948 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239008 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] experimental.ipv6_pd_enabled   = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239069 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ml2.extension_drivers          = ['port_security', 'qos'] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239123 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ml2.external_network_type      = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239175 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ml2.mechanism_drivers          = ['ovn'] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ml2.overlay_ip_version         = 4 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239238 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ml2.path_mtu                   = 0 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239300 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ml2.physical_network_mtus      = {} {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239337 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ml2.project_network_types      = ['geneve'] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239410 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ml2.tunnelled_network_rp_name  = rp_tunnelled {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'geneve'] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239528 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_flat.flat_networks    = ['public'] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239595 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_geneve.max_header_size = 38 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239650 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_geneve.vni_ranges     = ['1:65536'] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_vlan.network_vlan_ranges = ['public'] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239759 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] network_log.burst_limit        = 25 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239791 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] network_log.local_output_log_base = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] network_log.rate_limit         = 100 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.239920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.asyncio_connection    = **** {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.asyncio_slave_connection = **** {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.backend               = sqlalchemy {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.connection            = **** {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240120 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.connection_debug      = 0 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240149 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.connection_parameters =  {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240209 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.connection_recycle_time = 3600 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240247 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.connection_trace      = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.db_inc_retry_interval = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.db_max_retries        = 20 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240446 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.db_max_retry_interval = 10 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240498 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.db_retry_interval     = 1 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.max_overflow          = 50 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.max_pool_size         = 5 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240679 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.max_retries           = 10 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240718 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.mysql_wsrep_sync_wait = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.pool_timeout          = None {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240842 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.retry_interval        = 10 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240885 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.slave_connection      = **** {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.sqlite_synchronous    = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240967 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.synchronous_reader    = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.240967 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] database.use_db_reconnect      = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_min_rx                 = 1000 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241097 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_min_tx                 = 100 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241143 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_mult                   = 3 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241187 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.broadcast_arps_to_all_routers = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241225 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.dhcp_default_lease_time    = 43200 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241262 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241379 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.dns_records_ovn_owned      = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241426 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.dns_servers                = [] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241463 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.enable_distributed_floating_ip = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.fdb_age_threshold          = 300 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ha_failover_strategy       = normal {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241597 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.live_migration_activation_strategy = rarp {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241597 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.localnet_learn_fdb         = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241671 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.mac_binding_age_threshold  = 300 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.neutron_sync_mode          = log {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241749 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_dhcp4_global_options   = {} {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241787 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_dhcp6_global_options   = {} {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241823 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_l3_scheduler           = leastloaded {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_metadata_enabled       = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.241958 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242001 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_connection          = ['ssl:199.204.45.227:6641'] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242044 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_router_indirect_snat   = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242123 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_connection          = ['ssl:199.204.45.227:6642'] {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovs_create_tap             = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242321 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_connection_timeout   = 180 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242357 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_log_level            = INFO {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242428 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_probe_interval       = 60000 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242462 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_retry_max_interval   = 180 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242521 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.stateless_nat_enabled      = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn.vhost_sock_dir             = /var/run/openvswitch {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] OVS.bridge_mac_table_size      = 50000 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood                 = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242718 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood_reports         = True {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood_unregistered    = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242820 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_snooping_enable       = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] OVS.ovsdb_timeout              = 10 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242917 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.fdb_removal_limit = 0 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.242970 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.ignore_lsp_down  = False {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.243001 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 24 10:19:43.243054 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon.oslo_config_glue [-] ******************************************************************************** {{(pid=106381) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 24 10:19:43.243227 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG cotyledon._service_worker [-] Run service ServiceWrapper(0) [106381] {{(pid=106381) wait_forever /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/_service_worker.py:218}}
Apr 24 10:19:43.244680 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver.post_fork_initialize-1024773', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._post_fork_initialize-1859326'] for process (None), after_init {{(pid=106381) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Apr 24 10:19:43.246339 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbNbOvnIdl for MaintenanceWorker with retry
Apr 24 10:19:43.306254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Logical_Switch.name {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 24 10:19:43.306254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Logical_Router.name {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 24 10:19:43.306491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Load_Balancer.name {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 24 10:19:43.306491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Copp.name {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 24 10:19:43.306491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Meter.name {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 24 10:19:43.306491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Load_Balancer_Group.name {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 24 10:19:43.306767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index HA_Chassis_Group.name {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 24 10:19:43.306767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Address_Set.name {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 24 10:19:43.306767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Connection.target {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 24 10:19:43.306767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Gateway_Chassis.name {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 24 10:19:43.306767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Mirror.name {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 24 10:19:43.306767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Template_Var.chassis {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 24 10:19:43.307213 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Logical_Router_Port.name {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 24 10:19:43.307213 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port_Group.name {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 24 10:19:43.307213 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Logical_Switch_Port.name {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 24 10:19:43.309705 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.227:6641: connecting...
Apr 24 10:19:43.317496 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.227:6641: connected
Apr 24 10:19:43.348209 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbSbOvnIdl for MaintenanceWorker with retry
Apr 24 10:19:43.378233 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Chassis.name {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 24 10:19:43.378587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Port_Binding.logical_port {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 24 10:19:43.378587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Private.name {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 24 10:19:43.378587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Datapath_Binding.tunnel_key {{(pid=106381) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 24 10:19:43.381193 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.227:6642: connecting...
Apr 24 10:19:43.386765 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.227:6642: connected
Apr 24 10:19:43.423907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_floatingip_request of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x7eec133f8530>> floatingip precommit_update 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.424062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_floatingip_request of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x7eec133f8530>> floatingip precommit_delete 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.424292 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_port_has_port_forwarding of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x7eec133f8530>> floatingip before_create 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.424360 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_port_has_port_forwarding of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x7eec133f8530>> floatingip before_update 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.424443 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._process_port_request_handler of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x7eec133f8530>> port after_update 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.424500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._process_port_request_handler of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x7eec133f8530>> port precommit_delete 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.424743 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding.register-1850758'] for port_forwarding_plugin (None), after_init {{(pid=106381) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Apr 24 10:19:43.424809 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_notification of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x7eec132fa480>> port_forwarding after_create 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.424885 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_lb_on_ls of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x7eec132fa480>> router_interface after_create 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.424943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_notification of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x7eec132fa480>> port_forwarding after_update 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.425056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_notification of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x7eec132fa480>> port_forwarding after_delete 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.425119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_lb_on_ls of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x7eec132fa480>> router_interface after_delete 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.425214 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension
Apr 24 10:19:43.425303 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.placement [-] Starting OVNClientPlacementExtension
Apr 24 10:19:43.425718 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7eec133f84a0>> segment before_delete 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.425841 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7eec133f84a0>> subnet precommit_delete_associations 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.426136 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7eec133fab40>> segment_host_mapping after_create 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.426216 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_host_removal_from_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7eec133fab40>> segment_host_mapping after_delete 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.426281 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7eec133fab40>> port after_create 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.426334 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7eec133fab40>> port after_delete 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.426414 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7eec133fab40>> port after_update 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.426469 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7eec133fab40>> segment after_delete 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.426525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7eec133fab40>> subnet after_create 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.426601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7eec133fab40>> subnet after_delete 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.426660 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7eec133fab40>> subnet after_update 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.489873 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7eec13367680>> subnet after_create 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.490072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7eec13367680>> subnet after_delete 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.490072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7eec13367680>> subnet before_create 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.490072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7eec13367680>> subnet before_update 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.492573 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method LoggingPlugin._clean_logs_by_resource_id of <neutron.services.logapi.logging_plugin.LoggingPlugin object at 0x7eec141dfb00>> security_group after_delete 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.492703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method LoggingPlugin._clean_logs_by_target_id of <neutron.services.logapi.logging_plugin.LoggingPlugin object at 0x7eec141dfb00>> port after_delete 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.492786 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.services.logapi.drivers.ovn.driver.DriverBase._register-7657078'] for logging-plugin (None), after_init {{(pid=106381) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Apr 24 10:19:43.492867 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupRuleCallBack.handle_event of <neutron.services.logapi.common.sg_callback.SecurityGroupRuleCallBack object at 0x7eec133676e0>> security_group_rule after_create 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.492943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupRuleCallBack.handle_event of <neutron.services.logapi.common.sg_callback.SecurityGroupRuleCallBack object at 0x7eec133676e0>> security_group_rule after_update 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:43.493025 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupRuleCallBack.handle_event of <neutron.services.logapi.common.sg_callback.SecurityGroupRuleCallBack object at 0x7eec133676e0>> security_group_rule after_delete 55550000, False {{(pid=106381) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 24 10:19:52.945304 np0000170011 neutron-ovn-maintenance-worker[105599]: DEBUG dbcounter [-] [105599] Writing DB stats neutron:SELECT=4 {{(pid=105599) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:19:53.494280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [-] OVN-Northbound DB sync process started @ 2026-04-24 10:19:53.493878 {{(pid=106381) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:99}}
Apr 24 10:19:53.496755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync port groups started @ 2026-04-24 10:19:53.496287 {{(pid=106381) sync_port_groups /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:132}}
Apr 24 10:19:53.513962 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writer thread running {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 24 10:19:53.526630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync port groups completed @ 2026-04-24 10:19:53.526138 {{(pid=106381) sync_port_groups /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:196}}
Apr 24 10:19:53.526791 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync networks, ports and DHCP options started @ 2026-04-24 10:19:53.526615 {{(pid=106381) sync_networks_ports_and_dhcp_opts /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1150}}
Apr 24 10:19:53.634593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.services.segments.db [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7eec1326ecc0>,) {'filters': {'network_id': ['412fe0fb-d3c8-41ef-b742-c7e091bf5e56'], 'is_dynamic': False}} {{(pid=106381) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_log/helpers.py:77}}
Apr 24 10:19:53.639969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync metadata ports started {{(pid=106381) _sync_metadata_ports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1095}}
Apr 24 10:19:53.859863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync metadata ports completed {{(pid=106381) _sync_metadata_ports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1147}}
Apr 24 10:19:53.859863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync DHCP options for Neutron subnets started {{(pid=106381) _sync_subnet_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:947}}
Apr 24 10:19:53.917822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync DHCP options for Neutron subnets completed @ 2026-04-24 10:19:53.917488 {{(pid=106381) _sync_subnet_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1020}}
Apr 24 10:19:53.918500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 24 10:19:53.918852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync DHCP options for Neutron ports with extra dhcp options assigned started {{(pid=106381) _sync_port_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1025}}
Apr 24 10:19:53.918958 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync DHCP options for Neutron ports with extra dhcp options assigned completed {{(pid=106381) _sync_port_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1084}}
Apr 24 10:19:53.919121 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync networks, ports and DHCP options completed @ 2026-04-24 10:19:53.918954 {{(pid=106381) sync_networks_ports_and_dhcp_opts /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1319}}
Apr 24 10:19:53.919287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync ACLs started @ 2026-04-24 10:19:53.919122 {{(pid=106381) sync_acls /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:239}}
Apr 24 10:19:53.958013 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync ACLs completed @ 2026-04-24 10:19:53.957739 {{(pid=106381) sync_acls /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:429}}
Apr 24 10:19:53.958259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync routers and router ports started @ 2026-04-24 10:19:53.958000 {{(pid=106381) sync_routers_and_rports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:734}}
Apr 24 10:19:54.011457 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 24 10:19:54.011874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync routers and router ports completed @ 2026-04-24 10:19:54.011529 {{(pid=106381) sync_routers_and_rports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:942}}
Apr 24 10:19:54.011998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync port QoS policies started @ 2026-04-24 10:19:54.011877 {{(pid=106381) sync_port_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1367}}
Apr 24 10:19:54.012063 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] Starting OVNClientQosExtension
Apr 24 10:19:54.027840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync port QoS policies completed @ 2026-04-24 10:19:54.027624 {{(pid=106381) sync_port_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1390}}
Apr 24 10:19:54.027964 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync Floating IP QoS policies started @ 2026-04-24 10:19:54.027829 {{(pid=106381) sync_fip_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1395}}
Apr 24 10:19:54.028031 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] Starting OVNClientQosExtension
Apr 24 10:19:54.048256 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync Floating IP QoS policies completed @ 2026-04-24 10:19:54.047982 {{(pid=106381) sync_fip_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1418}}
Apr 24 10:19:54.048256 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync Floating IP NAT rules started @ 2026-04-24 10:19:54.048126 {{(pid=106381) sync_fip_dnat_rules /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1423}}
Apr 24 10:19:54.048683 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-NB Sync Floating IP NAT rules completed @ 2026-04-24 10:19:54.048343 {{(pid=106381) sync_fip_dnat_rules /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1446}}
Apr 24 10:19:54.049677 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-9bd78d6f-0633-45d1-a351-122c1bc75f26 None None] OVN-Northbound DB sync process completed @ 2026-04-24 10:19:54.049502 {{(pid=106381) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:112}}
Apr 24 10:20:03.496002 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [-] OVN-Southbound DB sync process started @ 2026-04-24 10:20:03.495702 {{(pid=106381) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1474}}
Apr 24 10:20:03.496759 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension
Apr 24 10:20:03.498131 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-673b2fdb-9a8e-4a34-a12f-2467d45a873b None None] OVN-SB Sync hostname and physical networks started @ 2026-04-24 10:20:03.497815 {{(pid=106381) sync_hostname_and_physical_networks /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1501}}
Apr 24 10:20:03.503092 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.add_provnet_ext_id_to_localnet_ports {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.503195 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.503268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_dhcp_options_consistency {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.503341 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_fair_meter_consistency {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.503445 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_fdb_aging_settings {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.503516 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_igmp_snoop_support {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.503674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_inconsistencies {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.503752 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_global_dhcp_opts {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.503826 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.503900 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.503971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_provider_distributed_ports {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.504014 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.504075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.504126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.cleanup_old_hash_ring_nodes {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.504180 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.configure_nb_global {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.504227 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.migrate_lrp_gateway_chassis_to_ha_chassis_group {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.504290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_fip_distributed_flag {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.504347 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_network_type_and_physnet {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.504406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_ovn_owned_dns_option {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.504465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_ha_failover {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.504516 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.504562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_mac_aging_settings {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.504626 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_router_distributed_flag {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.504690 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_router_static_routes {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.504734 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_security_group_with_address_group {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.504792 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_virtual_port_parent_hostname {{(pid=106381) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}}
Apr 24 10:20:03.507030 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.add_provnet_ext_id_to_localnet_ports' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.507865 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] Maintenance task thread has started
Apr 24 10:20:03.510194 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.513084 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] MaintenanceWorker process has finished the post initialization
Apr 24 10:20:03.513336 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_dhcp_options_consistency' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.513856 np0000170011 neutron-ovn-maintenance-worker[106381]: WARNING neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-673b2fdb-9a8e-4a34-a12f-2467d45a873b None None] New host np0000170011 found in OVN SB DB, but not in Neutron. Add its SegmentHostMapping in Neutron
Apr 24 10:20:03.517911 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fair_meter_consistency' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.518096 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.518197 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_igmp_snoop_support' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.518327 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.518440 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_global_dhcp_opts' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.518567 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.518688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.518770 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_provider_distributed_ports' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.518870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.518983 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.521361 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.cleanup_old_hash_ring_nodes' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.521487 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.configure_nb_global' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.521595 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.migrate_lrp_gateway_chassis_to_ha_chassis_group' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.521696 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.521797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_network_type_and_physnet' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.521894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_ovn_owned_dns_option' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.522001 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.522111 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.522195 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.522195 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_distributed_flag' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.522338 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_static_routes' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.522431 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_security_group_with_address_group' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.522539 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_virtual_port_parent_hostname' {{(pid=106381) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}}
Apr 24 10:20:03.532838 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.add_provnet_ext_id_to_localnet_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:03.533068 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_baremetal_ports_dhcp_options {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:03.533191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Sync baremetal port DHCP options with configuration. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:03.560153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG oslo_concurrency.lockutils [None req-673b2fdb-9a8e-4a34-a12f-2467d45a873b None None] Acquiring lock "update_segment_host_mapping" by "neutron.services.segments.db.update_segment_host_mapping" {{(pid=106381) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 24 10:20:03.560390 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG oslo_concurrency.lockutils [None req-673b2fdb-9a8e-4a34-a12f-2467d45a873b None None] Lock "update_segment_host_mapping" acquired by "neutron.services.segments.db.update_segment_host_mapping" :: waited 0.000s {{(pid=106381) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 24 10:20:03.593740 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_baremetal_ports_dhcp_options finished in 0.060 seconds
Apr 24 10:20:03.595167 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:03.595444 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_dhcp_options_consistency {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:03.595535 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Backfill network_id on DHCP_Options external_ids. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:03.598250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron_lib.callbacks.manager [None req-673b2fdb-9a8e-4a34-a12f-2467d45a873b None None] Publish callbacks ['neutron.plugins.ml2.plugin.DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments-2657633', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_host_addition_to_aggregate-8013658'] for segment_host_mapping (None), after_create {{(pid=106381) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Apr 24 10:20:03.625205 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.services.segments.db [None req-673b2fdb-9a8e-4a34-a12f-2467d45a873b None None] Segments {'b792be55-4fbf-4e4f-a9dc-10cee932ceea'} mapped to the host np0000170011 {{(pid=106381) update_segment_host_mapping /opt/stack/neutron/neutron/services/segments/db.py:249}}
Apr 24 10:20:03.631987 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG oslo_concurrency.lockutils [None req-673b2fdb-9a8e-4a34-a12f-2467d45a873b None None] Lock "update_segment_host_mapping" "released" by "neutron.services.segments.db.update_segment_host_mapping" :: held 0.072s {{(pid=106381) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 24 10:20:03.632169 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-673b2fdb-9a8e-4a34-a12f-2467d45a873b None None] OVN-SB Sync hostname and physical networks completed @ 2026-04-24 10:20:03.631957 {{(pid=106381) sync_hostname_and_physical_networks /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1528}}
Apr 24 10:20:03.653260 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_dhcp_options_consistency finished in 0.057 seconds
Apr 24 10:20:03.653693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_dhcp_options_consistency' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:03.653977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fair_meter_consistency {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:03.654179 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Refresh ACL logging fair meter after configuration reload. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:03.654691 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fair_meter_consistency finished in 0.000 seconds
Apr 24 10:20:03.654910 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fair_meter_consistency' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:03.655141 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:03.655325 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:03.659497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:03.740232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:03.740553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:03.743644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:03.743644 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:03.743644 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:03.743644 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:03.743644 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:03.743644 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:03.743644 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:03.743644 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:03.752344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.091 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:03.752344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:03.752344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:03.752344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:03.752344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:03.752344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:03.752344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:03.752344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:03.752344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:03.752344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:03.752344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:03.752344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:03.753080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:03.753080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:03.753080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:03.753080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:03.753080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:03.753080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:03.753080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:03.753080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:03.753080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:03.753080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:03.753080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:03.753080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:03.753080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:03.753829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:03.753829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:03.755265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:03.755265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:03.755265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:03.755265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:03.755265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:03.755265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:03.755265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:03.755265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:03.755265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:03.755265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:03.755265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:03.755265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:03.755265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:03.755265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:03.755265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:03.755265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:03.756221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:03.757255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:03.757255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:03.757255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:03.757255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_for_igmp_snoop_support {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:03.757255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Check for IGMP snoop support. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:03.757255 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_for_igmp_snoop_support finished in 0.000 seconds
Apr 24 10:20:03.757255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_igmp_snoop_support' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:03.757255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_for_inconsistencies {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:03.757775 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Checking Neutron and OVN revision consistency. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:03.800124 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: No inconsistencies found. Skipping {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:437}}
Apr 24 10:20:03.800425 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_for_inconsistencies finished in 0.043 seconds
Apr 24 10:20:03.800845 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_global_dhcp_opts {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:03.801015 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Check global DHCP options consistency. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:03.801333 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_global_dhcp_opts finished in 0.000 seconds
Apr 24 10:20:03.801594 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_global_dhcp_opts' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:03.802097 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_localnet_port_has_learn_fdb {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:03.802344 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Ensure localnet ports have learn-fdb set per configuration. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:03.803685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 24 10:20:03.804264 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_localnet_port_has_learn_fdb finished in 0.002 seconds
Apr 24 10:20:03.804401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:03.804672 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_network_broadcast_arps_to_all_routers {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:03.804834 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Sync broadcast-arps-to-all-routers on external networks. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:03.911490 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_network_broadcast_arps_to_all_routers finished in 0.106 seconds
Apr 24 10:20:03.911671 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:03.911882 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_provider_distributed_ports {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:03.912066 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Align reside-on-redirect-chassis on VLAN/FLAT distributed ports. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:04.018065 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_provider_distributed_ports finished in 0.106 seconds
Apr 24 10:20:04.018255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_provider_distributed_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:04.018463 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_redirect_type_router_gateway_ports {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:04.018575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Align router gateway redirect-type for provider VLAN/FLAT networks. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:04.143285 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 24 10:20:04.145082 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-673b2fdb-9a8e-4a34-a12f-2467d45a873b None None] OVN-Southbound DB sync process completed @ 2026-04-24 10:20:04.144743 {{(pid=106381) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1482}}
Apr 24 10:20:04.156504 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_redirect_type_router_gateway_ports finished in 0.138 seconds
Apr 24 10:20:04.157072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:04.157072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:04.157072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:04.158363 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:04.158517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.159188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:04.159188 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.159188 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:04.159188 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.159188 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.159188 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:04.159188 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.159188 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:04.160272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.160272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:04.160272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:04.160272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:04.160272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.160272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:04.160272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:04.160272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.160272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:04.160272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:04.160272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:04.160272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.160881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:04.160881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:04.160881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:04.160881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:04.160881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:04.160881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:04.160881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:04.160881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:04.160881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.160881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:04.160881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.160881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.160881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:04.161475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.161475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:04.161475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.161475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:04.161475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:04.161475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:04.161475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:04.161475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:04.161475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.161475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:04.161475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:04.161475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.161475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:04.161475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:04.161475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:04.162091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.162981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:04.162981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.162981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.162981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:04.162981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.162981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:04.162981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: cleanup_old_hash_ring_nodes {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:04.162981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Purge stale hash ring nodes older than five days. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:04.166952 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.db.ovn_hash_ring_db [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Cleaned up Hash Ring nodes older than 5 days
Apr 24 10:20:04.167084 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task cleanup_old_hash_ring_nodes finished in 0.006 seconds
Apr 24 10:20:04.167277 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: configure_nb_global {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:04.167408 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply ovn_nb_global settings to NB_Global options. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:04.167782 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'ignore_lsp_down': 'false', 'fdb_removal_limit': '0', 'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:04.168148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'ignore_lsp_down': 'false', 'fdb_removal_limit': '0', 'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:04.168635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.169523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:04.169523 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.169523 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:04.169523 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.169523 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.169523 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:04.169523 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.169523 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:04.170469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.170469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:04.170469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:04.170469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:04.170469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.170469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:04.170469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:04.170469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:04.170469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.170469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:04.170469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:04.170469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:04.170469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:04.170469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:04.170469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:04.171001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:04.171001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:04.171001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.171001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:04.171001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.171001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.171001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:04.171001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.171001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:04.171576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task configure_nb_global failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.171576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:04.171576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:04.171576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:04.171576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.171576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1038, in configure_nb_global
Apr 24 10:20:04.171576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:04.171576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:04.171576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:04.171576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.171576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:04.172048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:04.172048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:04.172048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.172048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:04.172048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:04.172048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:04.172048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:04.172048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:04.172048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:04.172048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:04.172048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:04.172048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.172048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:04.172048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.172507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.172507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:04.172507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.172507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:04.172637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.configure_nb_global' (it runs every 86400.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.172637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:04.172637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:04.172637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:04.172637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:04.172637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:04.172637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.172637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:04.172637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:04.172637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.172637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:04.172637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:04.172637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.172637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:04.172637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:04.172637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1038, in configure_nb_global
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.173113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:04.173922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.173922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.173922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:04.173922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.173922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:04.173922 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 24 10:20:04.173922 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.migrate_lrp_gateway_chassis_to_ha_chassis_group' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:04.173922 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:04.173922 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:04.174206 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:20:04.174393 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:04.174578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.175095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:04.175095 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.175095 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:04.175095 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.175095 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.175095 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:04.175095 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.175095 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:04.175837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.175837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:04.175837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:04.175837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:04.175837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.175837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:04.175837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:04.175837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:04.175837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.175837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:04.175837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:04.175837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:04.175837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:04.175837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:04.175837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:04.176323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:04.176323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:04.176323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.176323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:04.176323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.176323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.176323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:04.176323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.176323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:04.176667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.176667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:04.176667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:04.176667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:04.176667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.176667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:04.176667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:04.176667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:20:04.176667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:04.176667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:04.176667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.176667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:04.177063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:04.177063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:04.177063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.177063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:04.177063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:04.177063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:04.177063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:04.177063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:04.177063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:04.177063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:04.177063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:04.177063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.177063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:04.177063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.177502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.177502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:04.177502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.177502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:04.177630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.177630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:04.177630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:04.177630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:04.177630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:04.177630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:04.177630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.177630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:04.177630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:04.177630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.177630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:04.177630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:04.177630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.177630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:04.177630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:04.177630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:04.178067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:04.178608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.178608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:04.178608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.178608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.178608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:04.178608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.178608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:04.178608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_network_type_and_physnet {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:04.178608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set network type and physnet external_ids on logical switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:04.184462 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_network_type_and_physnet finished in 0.006 seconds
Apr 24 10:20:04.184613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_network_type_and_physnet' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:04.184777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_ovn_owned_dns_option {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:04.184935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply ovn_owned option on DNS records per configuration. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:04.185142 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_ovn_owned_dns_option finished in 0.000 seconds
Apr 24 10:20:04.185264 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_ovn_owned_dns_option' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:04.185452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:04.185544 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:04.185736 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:04.186268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:04.186666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.187381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:04.187381 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.187381 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:04.187381 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.187381 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.187381 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:04.187381 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.187381 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:04.188188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.188188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:04.188188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:04.188188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:04.188188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.188188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:04.188188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:04.188188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:04.188188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.188188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:04.188188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:04.188188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:04.188188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:04.188188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:04.188188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:04.188676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:04.188676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:04.188676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.188676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:04.188676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.188676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.188676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:04.188676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.188676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:04.189078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.189078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:04.189078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:04.189078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:04.189078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.189078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:04.189078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:04.189078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:04.189078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:04.189078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.189078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:04.189455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:04.189455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:04.189455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.189455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:04.189455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:04.189455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:04.189455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:04.189455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:04.189455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:04.189455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:04.189455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:04.189455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.189455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:04.189455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.189875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.189875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:04.189875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.189875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.190130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:04.190653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.191221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.191221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:04.191221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.191221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:04.191221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_lrouter_ports_ext_ids_name_prefix {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:04.191221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: ('Check missing prefix router_name', 'in external_ids of LRPs.') {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:04.191221 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_lrouter_ports_ext_ids_name_prefix finished in 0.000 seconds
Apr 24 10:20:04.191614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:04.191614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:04.191698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:04.191785 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:04.192318 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:04.192776 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:04.192974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.193695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:04.193695 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.193695 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:04.193695 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.193695 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.193695 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:04.193695 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.193695 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:04.194310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.194310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:04.194310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:04.194310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:04.194310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.194310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:04.194310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:04.194310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.194310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:04.194310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:04.194310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:04.194310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.194691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:04.194691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:04.194691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:04.194691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:04.194691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:04.194691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:04.194691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:04.194691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:04.194691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.194691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:04.194691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.194691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.194691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:04.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:04.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:04.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:04.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:04.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:04.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:04.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:04.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:04.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:04.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:04.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:04.195595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.196160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:04.196160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.196160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.196160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:04.196160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.196160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:04.196160 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_router_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:04.196160 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Sync router.distributed with distributed floating IP config. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:04.198050 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_router_distributed_flag finished in 0.003 seconds
Apr 24 10:20:04.198119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_distributed_flag' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:04.198250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_router_static_routes {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:04.198319 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Mark Neutron-owned static routes in OVN external_ids. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:04.198972 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_router_static_routes finished in 0.001 seconds
Apr 24 10:20:04.199072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_static_routes' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:04.199183 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_security_group_with_address_group {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:04.199244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Repair Address_Sets and ACLs for address group rules. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:04.264971 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_security_group_with_address_group finished in 0.065 seconds
Apr 24 10:20:04.265101 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_security_group_with_address_group' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:04.265938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_virtual_port_parent_hostname' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=106381) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}}
Apr 24 10:20:04.749641 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=e21ac9d2-c376-449d-bfef-2891a5e18eba, enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b', 'neutron:subnet_ids': 'd98dd98c-3740-4b7b-9054-95b7f384275a'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={'address_mode': 'slaac', 'mtu': '1372', 'send_periodic': 'true'}, mac='fa:16:3e:a6:52:0d', name='lrp-0de21292-12b4-400e-a412-1098eea498dc', networks=['fd75:b46:bbb9::1/64'], options={}, peer=[], status={}) old= {{(pid=106381) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 24 10:20:04.751426 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension
Apr 24 10:20:04.793402 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56 synchronized; highest priority chassis 6fdfe3a3-a87b-4dc6-9165-fd6037b04f84
Apr 24 10:20:04.793727 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': '412fe0fb-d3c8-41ef-b742-c7e091bf5e56', 'neutron:router_id': '6ae0d4e8-0009-4462-b695-a01da30fdd3b'}),), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:04.793908 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, chassis=6fdfe3a3-a87b-4dc6-9165-fd6037b04f84, priority=1, columns={}) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:04.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.794481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 24 10:20:04.794481 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.794481 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:04.794481 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.794481 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.794481 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:04.794481 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.794481 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event Traceback (most recent call last):
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     match.run(event, row, updates)
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 86, in run
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.link_network_ha_chassis_group(
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2411, in link_network_ha_chassis_group
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     next(self.gen)
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     next(self.gen)
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     with self.create_transaction(
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     self.result = self.commit()
Apr 24 10:20:04.795858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Apr 24 10:20:04.796795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:04.796795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     raise result.ex
Apr 24 10:20:04.796795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:04.796795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Apr 24 10:20:04.796795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Apr 24 10:20:04.796795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:04.796795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Apr 24 10:20:04.796795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:04.796795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event 
Apr 24 10:20:07.042971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=d7484be2-c355-48dc-bb05-b1c95d10c0cb, enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83', 'neutron:revision_number': '10', 'neutron:router_name': 'neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b', 'neutron:subnet_ids': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7 4daf396b-50dc-4100-9154-fd24fc0e5f1d'}, gateway_chassis=[], ha_chassis_group=8e0a2cd8-9797-4150-a19f-781499cf6e33, ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:f6:02:d4', name='lrp-3738d422-18d6-477c-84ad-89cf0b4072c5', networks=['172.24.5.18/24', '2001:db8::186/64'], options={'gateway_mtu': '1372', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=106381) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 24 10:20:07.043633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=ea458ddc-79d1-47e7-9576-7aa31e201fb1, enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b', 'neutron:subnet_ids': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7'}, gateway_chassis=[], ha_chassis_group=8e0a2cd8-9797-4150-a19f-781499cf6e33, ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:f6:02:d4', name='lrp-3738d422-18d6-477c-84ad-89cf0b4072c5', networks=['172.24.5.18/24'], options={'gateway_mtu': '1372', 'reside-on-redirect-chassis': 'true'}, peer=[], status={'hosting-chassis': '6fdfe3a3-a87b-4dc6-9165-fd6037b04f84'}) old= {{(pid=106381) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 24 10:20:07.080338 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56 synchronized; highest priority chassis 6fdfe3a3-a87b-4dc6-9165-fd6037b04f84
Apr 24 10:20:07.081025 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': '412fe0fb-d3c8-41ef-b742-c7e091bf5e56', 'neutron:router_id': '6ae0d4e8-0009-4462-b695-a01da30fdd3b'}),), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:07.081354 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, chassis=6fdfe3a3-a87b-4dc6-9165-fd6037b04f84, priority=1, columns={}) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:07.081578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:07.082156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 24 10:20:07.082156 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:07.082156 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:07.082156 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:07.082156 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:07.082156 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:07.082156 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:07.082156 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event Traceback (most recent call last):
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     match.run(event, row, updates)
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 89, in run
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.update_router_ha_chassis_group(
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1664, in update_router_ha_chassis_group
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     self.link_network_ha_chassis_group(context, network_id, router_id)
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2411, in link_network_ha_chassis_group
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     next(self.gen)
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     next(self.gen)
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:07.083456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     with self.create_transaction(
Apr 24 10:20:07.084306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:07.084306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     self.result = self.commit()
Apr 24 10:20:07.084306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Apr 24 10:20:07.084306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:07.084306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     raise result.ex
Apr 24 10:20:07.084306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:07.084306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Apr 24 10:20:07.084306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Apr 24 10:20:07.084306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:07.084306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Apr 24 10:20:07.084306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:07.084306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event 
Apr 24 10:20:07.112284 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56 synchronized; highest priority chassis 6fdfe3a3-a87b-4dc6-9165-fd6037b04f84
Apr 24 10:20:07.113140 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': '412fe0fb-d3c8-41ef-b742-c7e091bf5e56', 'neutron:router_id': '6ae0d4e8-0009-4462-b695-a01da30fdd3b'}),), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:07.113628 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, chassis=6fdfe3a3-a87b-4dc6-9165-fd6037b04f84, priority=1, columns={}) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:07.113920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:07.114876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 24 10:20:07.114876 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:07.114876 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:07.114876 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:07.114876 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:07.114876 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:07.114876 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:07.114876 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event Traceback (most recent call last):
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     match.run(event, row, updates)
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 81, in run
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.update_router_ha_chassis_group(
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1664, in update_router_ha_chassis_group
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     self.link_network_ha_chassis_group(context, network_id, router_id)
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2411, in link_network_ha_chassis_group
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     next(self.gen)
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     next(self.gen)
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:07.116009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     with self.create_transaction(
Apr 24 10:20:07.116864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:07.116864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     self.result = self.commit()
Apr 24 10:20:07.116864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Apr 24 10:20:07.116864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:07.116864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     raise result.ex
Apr 24 10:20:07.116864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:07.116864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Apr 24 10:20:07.116864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Apr 24 10:20:07.116864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:07.116864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Apr 24 10:20:07.116864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:07.116864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event 
Apr 24 10:20:08.655432 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:08.656223 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:08.656496 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:08.657941 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:08.849994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:08.850268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:08.851223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:08.851223 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:08.851223 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:08.851223 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:08.851223 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:08.851223 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:08.851223 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:08.851223 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:08.853447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.195 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:08.853447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:08.853447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:08.853447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:08.853447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:08.853447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:08.853447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:08.853447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:08.853447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:08.853447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:08.853447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:08.853447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:08.853825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:08.853825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:08.853825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:08.853825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:08.853825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:08.853825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:08.853825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:08.853825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:08.853825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:08.853825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:08.853825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:08.853825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:08.853825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:08.854383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:08.854383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:08.854383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:08.854383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:08.854383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:08.854383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:08.854383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:08.854383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:08.854383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:08.854383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:08.854383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:08.854383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:08.854383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:08.854383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:08.854383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:08.854835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:08.855363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:08.855363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:08.855363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:08.855363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:08.855363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:08.855363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:09.157220 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:09.158834 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:09.158834 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:09.159222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:09.159588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.160570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:09.160570 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:09.160570 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:09.160570 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:09.160570 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:09.160570 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:09.160570 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.160570 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:09.162240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.162240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:09.162240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:09.162240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:09.162240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.162240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:09.162240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:09.162240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.162240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:09.162240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:09.162240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:09.162240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.162751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:09.162751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:09.162751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:09.162751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:09.162751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:09.162751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:09.162751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:09.162751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:09.162751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:09.162751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:09.162751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:09.162751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:09.162751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:09.163292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.163292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:09.164944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.164944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:09.164944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:09.164944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:09.164944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:09.164944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:09.164944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.164944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:09.164944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:09.164944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.164944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:09.164944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:09.164944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.164944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:09.164944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:09.164944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:09.165698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:09.166539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:09.166539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.166539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:09.173763 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:09.174104 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:09.174239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:09.174456 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:20:09.174828 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:09.175116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:09.175824 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:09.175824 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:09.175824 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:09.175824 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:09.175824 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:09.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:09.176714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.176714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:09.176714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:09.176714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:09.176714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.176714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:09.176714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:09.176714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:09.176714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.176714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:09.176714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:09.176714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:09.176714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:09.176714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:09.176714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:09.177200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:09.177200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:09.177200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:09.177200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:09.177200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:09.177200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:09.177200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:09.177200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.177200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:09.177967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.177967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:09.177967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:09.177967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:09.177967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.177967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:09.177967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:09.177967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:20:09.177967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:09.177967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:09.177967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.177967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:09.178301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:09.178301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:09.178301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.178301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:09.178301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:09.178301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:09.178301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:09.178301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:09.178301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:09.178301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:09.178301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:09.178301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:09.178301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:09.178301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:09.178693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:09.178693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:09.178693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.178693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:09.179794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.179794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:09.179794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:09.179794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:09.179794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:09.179794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:09.179794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.179794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:09.179794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:09.179794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.179794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:09.179794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:09.179794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.179794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:09.179794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:09.179794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:09.180341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:09.180867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:09.180867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:09.180867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:09.180867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:09.180867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:09.180867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.180867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:09.185615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:09.186058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:09.186164 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:09.186313 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:09.186769 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:09.187108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.187811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:09.187811 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:09.187811 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:09.187811 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:09.187811 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:09.187811 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:09.187811 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.187811 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:09.188703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.188703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:09.188703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:09.188703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:09.188703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.188703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:09.188703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:09.188703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:09.188703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.188703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:09.188703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:09.188703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:09.188703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:09.188703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:09.188703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:09.189141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:09.189141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:09.189141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:09.189141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:09.189141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:09.189141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:09.189141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:09.189141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.189141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:09.189690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.189690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:09.189690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:09.189690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:09.189690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.189690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:09.189690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:09.189690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:09.189690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:09.189690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.189690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:09.190014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:09.190014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:09.190014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.190014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:09.190014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:09.190014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:09.190014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:09.190014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:09.190014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:09.190014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:09.190014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:09.190014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:09.190014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:09.190014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:09.190416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:09.190416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:09.190416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.190416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.191142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:09.191608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:09.192088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:09.192088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:09.192088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.192088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:09.192088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:09.192088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:09.192088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:09.192304 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:09.192677 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:09.193004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:09.193181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.193878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:09.193878 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:09.193878 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:09.193878 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:09.193878 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:09.193878 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:09.193878 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.193878 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:09.194828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.194828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:09.194828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:09.194828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:09.194828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.194828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:09.194828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:09.194828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.194828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:09.194828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:09.194828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:09.194828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.195177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:09.195177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:09.195177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:09.195177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:09.195177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:09.195177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:09.195177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:09.195177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:09.195177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:09.195177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:09.195177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:09.195177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:09.195177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:09.195621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.195621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:09.196025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.196025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:09.196025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:09.196025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:09.196025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:09.196025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:09.196025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.196025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:09.196025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:09.196025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.196025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:09.196025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:09.196025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.196025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:09.196025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:09.196025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:09.196553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:09.197156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:09.197156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:09.197156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:13.656194 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:13.657775 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:13.657864 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:13.658486 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:13.701586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:13.701976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:13.702743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:13.702743 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:13.702743 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:13.702743 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:13.702743 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:13.702743 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:13.702743 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:13.702743 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:13.703755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.045 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:13.703755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:13.703755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:13.703755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:13.703755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:13.703755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:13.703755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:13.703755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:13.703755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:13.703755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:13.703755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:13.703755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:13.704161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:13.704161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:13.704161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:13.704161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:13.704161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:13.704161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:13.704161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:13.704161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:13.704161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:13.704161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:13.704161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:13.704161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:13.704161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:13.704636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:13.704636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:13.704901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:13.704901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:13.704901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:13.704901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:13.704901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:13.704901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:13.704901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:13.704901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:13.704901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:13.704901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:13.704901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:13.704901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:13.704901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:13.704901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:13.704901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:13.704901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:13.705383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:13.706861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:13.706861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:13.706861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:14.158053 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:14.158509 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:14.158670 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:14.159676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:14.160017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.161109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:14.161109 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:14.161109 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:14.161109 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:14.161109 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:14.161109 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:14.161109 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.161109 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:14.162284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.162284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:14.162284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:14.162284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:14.162284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.162284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:14.162284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:14.162284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.162284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:14.162284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:14.162284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:14.162284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.162827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:14.162827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:14.162827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:14.162827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:14.162827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:14.162827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:14.162827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:14.162827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:14.162827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:14.162827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:14.162827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:14.162827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:14.162827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:14.163260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.163260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:14.163808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.163808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:14.163808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:14.163808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:14.163808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:14.163808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:14.163808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.163808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:14.163808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:14.163808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.163808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:14.163808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:14.163808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.163808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:14.163808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:14.163808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:14.164298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:14.164917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:14.164917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.164917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:14.174266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:14.174693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:14.174897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:14.175096 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:20:14.175577 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:14.175817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.176509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:14.176509 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:14.176509 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:14.176509 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:14.176509 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:14.176509 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:14.176509 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.176509 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:14.177843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.177843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:14.177843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:14.177843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:14.177843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.177843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:14.177843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:14.177843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:14.177843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.177843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:14.177843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:14.177843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:14.177843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:14.177843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:14.177843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:14.178607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:14.178607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:14.178607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:14.178607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:14.178607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:14.178607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:14.178607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:14.178607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.178607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:14.179354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.179354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:14.179354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:14.179354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:14.179354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.179354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:14.179354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:14.179354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:20:14.179354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:14.179354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:14.179354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.179354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:14.180030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:14.180030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:14.180030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.180030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:14.180030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:14.180030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:14.180030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:14.180030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:14.180030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:14.180030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:14.180030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:14.180030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:14.180030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:14.180030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:14.180884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:14.180884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:14.180884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.180884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:14.181240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.181240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:14.181240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:14.181240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:14.181240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:14.181240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:14.181240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.181240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:14.181240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:14.181240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.181240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:14.181240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:14.181240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.181240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:14.181240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:14.181240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:14.181719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:14.182243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:14.182243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:14.182243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:14.182243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:14.182243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:14.182243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.182243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:14.186035 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:14.186289 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:14.186418 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:14.186539 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:14.186977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:14.187285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.187739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:14.187739 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:14.187739 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:14.187739 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:14.187739 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:14.187739 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:14.187739 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.187739 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:14.188483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.188483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:14.188483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:14.188483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:14.188483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.188483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:14.188483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:14.188483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:14.188483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.188483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:14.188483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:14.188483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:14.188483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:14.188483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:14.188483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:14.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:14.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:14.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:14.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:14.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:14.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:14.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:14.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:14.189321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.189321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:14.189321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:14.189321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:14.189321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.189321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:14.189321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:14.189321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:14.189321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:14.189321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.189321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:14.189922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:14.189922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:14.189922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.189922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:14.189922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:14.189922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:14.189922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:14.189922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:14.189922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:14.189922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:14.189922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:14.189922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:14.189922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:14.189922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:14.190390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:14.190390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:14.190390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.190390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.190521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:14.190982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:14.191518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:14.191518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:14.191518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.191518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:14.192013 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:14.192258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:14.192404 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:14.192585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:14.192932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:14.193169 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:14.193295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.193759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:14.193759 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:14.193759 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:14.193759 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:14.193759 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:14.193759 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:14.193759 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.193759 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:14.194537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.194537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:14.194537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:14.194537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:14.194537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.194537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:14.194537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:14.194537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.194537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:14.194537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:14.194537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:14.194537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.194880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:14.194880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:14.194880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:14.194880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:14.194880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:14.194880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:14.194880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:14.194880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:14.194880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:14.194880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:14.194880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:14.194880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:14.194880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:14.195229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.195229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:14.195773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.195773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:14.195773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:14.195773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:14.195773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:14.195773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:14.195773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.195773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:14.195773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:14.195773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.195773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:14.195773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:14.195773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.195773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:14.195773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:14.195773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:14.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:14.196757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:14.196757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:14.196757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:18.658021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:18.658937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:18.658937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:18.659919 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:18.693507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:18.694253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:18.695276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:18.695276 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:18.695276 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:18.695276 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:18.695276 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:18.695276 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:18.695276 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:18.695276 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:18.696232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:18.696232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:18.696232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:18.696232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:18.696232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:18.696232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:18.696232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:18.696232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:18.696232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:18.696232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:18.696232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:18.696232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:18.696922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:18.696922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:18.696922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:18.696922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:18.696922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:18.696922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:18.696922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:18.696922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:18.696922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:18.696922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:18.696922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:18.696922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:18.696922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:18.697573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:18.697573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:18.697573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:18.697573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:18.697573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:18.697573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:18.697573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:18.697573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:18.697573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:18.697573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:18.697573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:18.697573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:18.697573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:18.697573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:18.697573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:18.698274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:18.699342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:18.699342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:18.699342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:18.699342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:18.699342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:18.699342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:19.158487 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:19.159131 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:19.159336 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:19.160320 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:19.160661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.161429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:19.161429 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:19.161429 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:19.161429 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:19.161429 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:19.161429 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:19.161429 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.161429 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:19.162512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.162512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:19.162512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:19.162512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:19.162512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.162512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:19.162512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:19.162512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.162512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:19.162512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:19.162512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:19.162512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.162896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:19.162896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:19.162896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:19.162896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:19.162896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:19.162896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:19.162896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:19.162896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:19.162896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:19.162896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:19.162896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:19.162896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:19.162896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:19.163249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.163249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:19.163623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.163623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:19.163623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:19.163623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:19.163623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:19.163623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:19.163623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.163623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:19.163623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:19.163623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.163623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:19.163623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:19.163623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.163623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:19.163623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:19.163623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:19.164127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:19.165080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:19.165080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.165080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:19.174577 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:19.174850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:19.174970 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:19.175102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:20:19.177915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:19.179217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.180208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:19.180208 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:19.180208 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:19.180208 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:19.180208 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:19.180208 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:19.180208 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.180208 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:19.181505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.181505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:19.181505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:19.181505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:19.181505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.181505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:19.181505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:19.181505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:19.181505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.181505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:19.181505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:19.181505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:19.181505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:19.181505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:19.181505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:19.182188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:19.182188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:19.182188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:19.182188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:19.182188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:19.182188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:19.182188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:19.182188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.182188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:19.182921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.007 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.182921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:19.182921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:19.182921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:19.182921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.182921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:19.182921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:19.182921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:20:19.182921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:19.182921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:19.182921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.182921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:19.183514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:19.183514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:19.183514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.183514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:19.183514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:19.183514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:19.183514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:19.183514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:19.183514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:19.183514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:19.183514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:19.183514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:19.183514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:19.183514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:19.184130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:19.184130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:19.184130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.184130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:19.184747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.184747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:19.184747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:19.184747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:19.184747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:19.184747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:19.184747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.184747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:19.184747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:19.184747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.184747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:19.184747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:19.184747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.184747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:19.184747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:19.184747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:19.185543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:19.186335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:19.186335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:19.186335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:19.186335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:19.186335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:19.186335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.186335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:19.186335 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:19.186708 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:19.186931 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:19.187132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:19.187574 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:19.187774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.188337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:19.188337 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:19.188337 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:19.188337 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:19.188337 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:19.188337 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:19.188337 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.188337 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:19.189118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.189118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:19.189118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:19.189118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:19.189118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.189118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:19.189118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:19.189118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:19.189118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.189118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:19.189118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:19.189118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:19.189118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:19.189118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:19.189118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:19.189614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:19.189614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:19.189614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:19.189614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:19.189614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:19.189614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:19.189614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:19.189614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.189614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:19.190040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.190040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:19.190040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:19.190040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:19.190040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.190040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:19.190040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:19.190040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:19.190040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:19.190040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.190040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:19.190404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:19.190404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:19.190404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.190404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:19.190404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:19.190404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:19.190404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:19.190404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:19.190404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:19.190404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:19.190404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:19.190404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:19.190404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:19.190404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:19.190855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:19.190855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:19.190855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.190855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.191651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:19.192191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:19.192742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:19.192742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:19.192742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.192742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:19.193546 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:19.193866 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:19.194042 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:19.194274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:19.194656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:19.194953 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:19.195127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.195768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:19.195768 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:19.195768 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:19.195768 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:19.195768 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:19.195768 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:19.195768 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.195768 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:19.197109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.197109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:19.197109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:19.197109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:19.197109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.197109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:19.197109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:19.197109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.197109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:19.197109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:19.197109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:19.197109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.197492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:19.197492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:19.197492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:19.197492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:19.197492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:19.197492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:19.197492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:19.197492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:19.197492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:19.197492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:19.197492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:19.197492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:19.197492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:19.197851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.197851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:19.198162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.198162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:19.198162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:19.198162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:19.198162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:19.198162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:19.198162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.198162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:19.198162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:19.198162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.198162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:19.198162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:19.198162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.198162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:19.198162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:19.198162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:19.198679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:19.199340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:19.199340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:19.199340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:23.658667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:23.659511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:23.659755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:23.661159 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:23.696103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:23.696555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:23.697476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:23.697476 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:23.697476 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:23.697476 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:23.697476 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:23.697476 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:23.697476 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:23.697476 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:23.698452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:23.698452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:23.698452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:23.698452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:23.698452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:23.698452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:23.698452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:23.698452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:23.698452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:23.698452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:23.698452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:23.698452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:23.699273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:23.699273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:23.699273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:23.699273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:23.699273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:23.699273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:23.699273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:23.699273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:23.699273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:23.699273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:23.699273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:23.699273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:23.699273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:23.699844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:23.699844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:23.699844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:23.699844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:23.699844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:23.699844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:23.699844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:23.699844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:23.699844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:23.699844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:23.699844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:23.699844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:23.699844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:23.699844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:23.699844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:23.700533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:23.701338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:23.701338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:23.701338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:23.701338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:23.701338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:23.701338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:24.159217 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:24.159996 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:24.160325 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:24.161516 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:24.161883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.162858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:24.162858 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:24.162858 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:24.162858 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:24.162858 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:24.162858 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:24.162858 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.162858 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:24.164543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.164543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:24.164543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:24.164543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:24.164543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.164543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:24.164543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:24.164543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.164543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:24.164543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:24.164543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:24.164543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.165288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:24.165288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:24.165288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:24.165288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:24.165288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:24.165288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:24.165288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:24.165288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:24.165288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:24.165288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:24.165288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:24.165288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:24.165288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:24.165905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.165905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:24.166268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.166268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:24.166268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:24.166268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:24.166268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:24.166268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:24.166268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.166268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:24.166268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:24.166268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.166268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:24.166268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:24.166268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.166268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:24.166268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:24.166268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:24.166957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:24.168013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:24.168013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.168013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:24.175294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:24.175294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:24.175553 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:24.175740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:20:24.176330 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:24.176703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.177574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:24.177574 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:24.177574 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:24.177574 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:24.177574 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:24.177574 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:24.177574 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.177574 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:24.178782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.178782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:24.178782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:24.178782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:24.178782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.178782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:24.178782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:24.178782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:24.178782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.178782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:24.178782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:24.178782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:24.178782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:24.178782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:24.178782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:24.179199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:24.179199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:24.179199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:24.179199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:24.179199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:24.179199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:24.179199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:24.179199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.179199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:24.180122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.180122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:24.180122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:24.180122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:24.180122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.180122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:24.180122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:24.180122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:20:24.180122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:24.180122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:24.180122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.180122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:24.180482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:24.180482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:24.180482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.180482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:24.180482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:24.180482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:24.180482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:24.180482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:24.180482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:24.180482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:24.180482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:24.180482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:24.180482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:24.180482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:24.180834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:24.180834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:24.180834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.180834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:24.181784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.181784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:24.181784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:24.181784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:24.181784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:24.181784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:24.181784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.181784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:24.181784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:24.181784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.181784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:24.181784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:24.181784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.181784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:24.181784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:24.181784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:24.182210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:24.182674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:24.182674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:24.182674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:24.182674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:24.182674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:24.182674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.182674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:24.186825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:24.187121 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:24.187230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:24.187355 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:24.187906 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:24.188258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.189049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:24.189049 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:24.189049 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:24.189049 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:24.189049 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:24.189049 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:24.189049 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.189049 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:24.189836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.189836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:24.189836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:24.189836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:24.189836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.189836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:24.189836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:24.189836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:24.189836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.189836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:24.189836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:24.189836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:24.189836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:24.189836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:24.189836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:24.190241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:24.190241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:24.190241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:24.190241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:24.190241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:24.190241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:24.190241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:24.190241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.190241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:24.190694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.190694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:24.190694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:24.190694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:24.190694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.190694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:24.190694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:24.190694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:24.190694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:24.190694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.190694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:24.191004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:24.191004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:24.191004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.191004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:24.191004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:24.191004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:24.191004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:24.191004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:24.191004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:24.191004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:24.191004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:24.191004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:24.191004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:24.191004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:24.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:24.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:24.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.191803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:24.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:24.193042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:24.193042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:24.193042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.193042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:24.194110 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:24.194205 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:24.194311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:24.194754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:24.195242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:24.195670 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:24.196020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.197092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:24.197092 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:24.197092 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:24.197092 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:24.197092 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:24.197092 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:24.197092 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.197092 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:24.197961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.197961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:24.197961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:24.197961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:24.197961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.197961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:24.197961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:24.197961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.197961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:24.197961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:24.197961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:24.197961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.198297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:24.198297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:24.198297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:24.198297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:24.198297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:24.198297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:24.198297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:24.198297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:24.198297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:24.198297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:24.198297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:24.198297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:24.198297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:24.198690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.198690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:24.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:24.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:24.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:24.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:24.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:24.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:24.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:24.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:24.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:24.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:24.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:24.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:24.199334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:24.199931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:24.199931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:24.199931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:28.659252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:28.659893 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:28.659893 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:28.660647 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:28.696845 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:28.696845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:28.697065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:28.697065 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:28.697065 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:28.697065 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:28.697065 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:28.697065 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:28.697065 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:28.697065 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:28.697851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:28.697851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:28.697851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:28.697851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:28.697851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:28.697851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:28.697851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:28.697851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:28.697851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:28.697851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:28.697851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:28.697851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:28.698686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:28.698686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:28.698686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:28.698686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:28.698686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:28.698686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:28.698686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:28.698686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:28.698686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:28.698686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:28.698686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:28.698686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:28.698686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:28.699872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:28.699872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:28.699872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:28.699872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:28.699872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:28.699872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:28.699872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:28.699872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:28.699872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:28.699872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:28.699872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:28.699872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:28.699872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:28.699872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:28.699872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:28.700868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:28.701869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:28.701869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:28.701869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:28.701869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:28.701869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:28.701869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:29.159817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:29.161130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:29.161397 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:29.162101 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:29.162302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.163034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:29.163034 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:29.163034 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:29.163034 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:29.163034 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:29.163034 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:29.163034 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.163034 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:29.164721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.164721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:29.164721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:29.164721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:29.164721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.164721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:29.164721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:29.164721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.164721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:29.164721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:29.164721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:29.164721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.165120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:29.165120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:29.165120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:29.165120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:29.165120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:29.165120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:29.165120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:29.165120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:29.165120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:29.165120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:29.165120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:29.165120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:29.165120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:29.165495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.165495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:29.166810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.166810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:29.166810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:29.166810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:29.166810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:29.166810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:29.166810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.166810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:29.166810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:29.166810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.166810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:29.166810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:29.166810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.166810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:29.166810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:29.166810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:29.167266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:29.167763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:29.167763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.167763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:29.176674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:29.176674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:29.176674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:29.176674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:20:29.177121 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:29.177577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.179103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:29.179103 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:29.179103 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:29.179103 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:29.179103 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:29.179103 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:29.179103 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.179103 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:29.181334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.181334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:29.181334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:29.181334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:29.181334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.181334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:29.181334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:29.181334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:29.181334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.181334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:29.181334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:29.181334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:29.181334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:29.181334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:29.181334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:29.181824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:29.181824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:29.181824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:29.181824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:29.181824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:29.181824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:29.181824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:29.181824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.181824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:29.182271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.182271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:29.182271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:29.182271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:29.182271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.182271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:29.182271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:29.182271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:20:29.182271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:29.182271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:29.182271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.182271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:29.182645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:29.182645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:29.182645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.182645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:29.182645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:29.182645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:29.182645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:29.182645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:29.182645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:29.182645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:29.182645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:29.182645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:29.182645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:29.182645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:29.183016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:29.183016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:29.183016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.183016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:29.184872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.184872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:29.184872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:29.184872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:29.184872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:29.184872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:29.184872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.184872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:29.184872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:29.184872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.184872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:29.184872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:29.184872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.184872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:29.184872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:29.184872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:29.185337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:29.185857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:29.185857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:29.185857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:29.185857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:29.185857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:29.185857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.185857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:29.187287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:29.187594 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:29.187697 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:29.187792 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:29.188218 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:29.188841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.189013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:29.189013 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:29.189013 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:29.189013 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:29.189013 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:29.189013 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:29.189013 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.189013 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:29.189589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.189589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:29.189589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:29.189589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:29.189589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.189589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:29.189589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:29.189589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:29.189589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.189589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:29.189589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:29.189589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:29.189589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:29.189589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:29.189589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:29.189987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:29.189987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:29.189987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:29.189987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:29.189987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:29.189987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:29.189987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:29.189987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.189987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:29.190259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.190259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:29.190259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:29.190259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:29.190259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.190259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:29.190259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:29.190259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:29.190259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:29.190259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.190259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:29.190634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:29.190634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:29.190634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.190634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:29.190634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:29.190634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:29.190634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:29.190634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:29.190634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:29.190634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:29.190634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:29.190634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:29.190634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:29.190634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:29.191024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:29.191024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:29.191024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.191024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:29.191024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.191024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:29.191024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:29.191024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:29.191024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:29.191024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:29.191024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.191024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:29.191024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:29.191024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:29.191459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:29.192012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:29.192012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:29.192012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:29.192012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:29.192012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:29.192012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:29.192012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:29.192012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:29.192012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:29.192012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.192012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:29.194628 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:29.194891 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:29.195016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:29.195185 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:29.195600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:29.196057 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:29.196291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.197140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:29.197140 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:29.197140 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:29.197140 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:29.197140 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:29.197140 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:29.197140 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.197140 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:29.198121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.198121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:29.198121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:29.198121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:29.198121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.198121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:29.198121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:29.198121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.198121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:29.198121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:29.198121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:29.198121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.198602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:29.198602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:29.198602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:29.198602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:29.198602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:29.198602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:29.198602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:29.198602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:29.198602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:29.198602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:29.198602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:29.198602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:29.198602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:29.199036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.199036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:29.199262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.199262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:29.199262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:29.199262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:29.199262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:29.199262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:29.199262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.199262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:29.199262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:29.199262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.199262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:29.199262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:29.199262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.199262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:29.199262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:29.199262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:29.199732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:29.200317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:29.200317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:29.200317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:33.659945 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:33.660733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:33.660733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:33.661973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:33.696960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:33.696960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:33.697203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:33.697203 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:33.697203 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:33.697203 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:33.697203 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:33.697203 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:33.697203 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:33.697203 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:33.698280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:33.698280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:33.698280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:33.698280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:33.698280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:33.698280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:33.698280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:33.698280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:33.698280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:33.698280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:33.698280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:33.698280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:33.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:33.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:33.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:33.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:33.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:33.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:33.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:33.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:33.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:33.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:33.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:33.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:33.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:33.699425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:33.699425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:33.699784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:33.699784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:33.699784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:33.699784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:33.699784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:33.699784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:33.699784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:33.699784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:33.699784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:33.699784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:33.699784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:33.699784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:33.699784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:33.699784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:33.699784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:33.699784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:33.700398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:33.700931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:33.700931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:33.700931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:34.160699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:34.161228 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:34.161423 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:34.163237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:34.163237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.163538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:34.163538 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:34.163538 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:34.163538 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:34.163538 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:34.163538 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:34.163538 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.163538 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:34.164965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.164965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:34.164965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:34.164965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:34.164965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.164965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:34.164965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:34.164965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.164965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:34.164965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:34.164965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:34.164965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.165748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:34.165748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:34.165748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:34.165748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:34.165748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:34.165748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:34.165748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:34.165748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:34.165748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:34.165748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:34.165748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:34.165748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:34.165748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:34.166791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.166791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:34.166791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.166791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:34.166791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:34.166791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:34.166791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:34.166791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:34.166791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.166791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:34.166791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:34.166791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.166791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:34.166791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:34.166791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:34.167498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:34.168118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:34.168118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:34.168118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:34.168118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:34.168118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.168118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:34.176029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:34.176247 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:34.176334 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:34.176449 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:20:34.176777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:34.177069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.177813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:34.177813 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:34.177813 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:34.177813 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:34.177813 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:34.177813 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:34.177813 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.177813 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:34.179094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.179094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:34.179094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:34.179094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:34.179094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.179094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:34.179094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:34.179094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:34.179094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.179094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:34.179094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:34.179094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:34.179094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:34.179094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:34.179094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:34.179580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:34.179580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:34.179580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:34.179580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:34.179580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:34.179580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:34.179580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:34.179580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.179580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:34.180614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.180614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:34.180614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:34.180614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:34.180614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.180614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:34.180614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:34.180614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:20:34.180614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:34.180614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:34.180614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.180614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:34.181004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:34.181004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:34.181004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.181004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:34.181004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:34.181004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:34.181004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:34.181004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:34.181004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:34.181004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:34.181004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:34.181004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:34.181004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:34.181004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:34.181492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:34.181492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:34.181492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.181492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:34.182333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.182333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:34.182333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:34.182333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:34.182333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:34.182333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:34.182333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.182333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:34.182333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:34.182333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.182333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:34.182333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:34.182333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.182333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:34.182333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:34.182333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:34.182837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:34.183393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:34.183393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:34.183393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:34.183393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:34.183393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:34.183393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.183393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:34.187910 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:34.188010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:34.188084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:34.188290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:34.189998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:34.189998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.190177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:34.190177 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:34.190177 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:34.190177 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:34.190177 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:34.190177 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:34.190177 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.190177 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:34.190970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.190970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:34.190970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:34.190970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:34.190970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.190970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:34.190970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:34.190970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:34.190970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.190970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:34.190970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:34.190970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:34.190970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:34.190970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:34.190970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:34.191742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:34.191742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:34.191742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:34.191742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:34.191742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:34.191742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:34.191742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:34.191742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.191742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:34.192213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.192213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:34.192213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:34.192213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:34.192213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.192213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:34.192213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:34.192213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:34.192213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:34.192213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.192213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:34.192791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:34.192791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:34.192791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.192791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:34.192791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:34.192791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:34.192791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:34.192791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:34.192791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:34.192791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:34.192791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:34.192791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:34.192791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:34.192791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:34.193690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:34.193690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:34.193690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.193690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:34.193690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.193690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:34.193690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:34.193690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:34.193690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:34.193690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:34.193690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.193690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:34.193690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:34.193690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:34.194415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:34.195408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:34.195408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:34.195408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:34.195408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:34.195408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:34.195408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:34.195408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:34.195408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:34.195408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:34.195408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.195408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:34.195408 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:34.195408 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:34.196092 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:34.196092 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:34.196648 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:34.197171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:34.197612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.198503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:34.198503 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:34.198503 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:34.198503 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:34.198503 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:34.198503 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:34.198503 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.198503 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:34.199305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.199305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:34.199305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:34.199305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:34.199305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.199305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:34.199305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:34.199305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.199305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:34.199305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:34.199305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:34.199305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.199587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:34.199587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:34.199587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:34.199587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:34.199587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:34.199587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:34.199587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:34.199587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:34.199587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:34.199587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:34.199587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:34.199587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:34.199587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:34.199859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.199859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:34.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:34.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:34.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:34.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:34.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:34.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:34.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:34.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:34.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:34.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:34.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:34.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:34.200626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:34.201016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:34.201016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:34.201016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:38.661633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:38.662477 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:38.662477 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:38.663568 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:38.694221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:38.694221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:38.694471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:38.694471 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:38.694471 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:38.694471 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:38.694471 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:38.694471 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:38.694471 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:38.694471 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:38.695230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.032 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:38.695230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:38.695230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:38.695230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:38.695230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:38.695230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:38.695230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:38.695230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:38.695230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:38.695230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:38.695230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:38.695230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:38.695587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:38.695587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:38.695587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:38.695587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:38.695587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:38.695587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:38.695587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:38.695587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:38.695587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:38.695587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:38.695587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:38.695587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:38.695587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:38.695892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:38.695892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:38.696047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:38.696047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:38.696047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:38.696047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:38.696047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:38.696047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:38.696047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:38.696047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:38.696047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:38.696047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:38.696047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:38.696047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:38.696047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:38.696047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:38.696047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:38.696047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:38.696495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:38.697104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:38.697104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:38.697104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:39.161247 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:39.161927 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:39.162086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:39.162878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:39.163171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.164104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:39.164104 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:39.164104 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:39.164104 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:39.164104 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:39.164104 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:39.164104 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.164104 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:39.165756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.165756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:39.165756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:39.165756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:39.165756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.165756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:39.165756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:39.165756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.165756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:39.165756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:39.165756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:39.165756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.166559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:39.166559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:39.166559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:39.166559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:39.166559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:39.166559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:39.166559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:39.166559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:39.166559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:39.166559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:39.166559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:39.166559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:39.166559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:39.167415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.167415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:39.167729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.167729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:39.167729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:39.167729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:39.167729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:39.167729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:39.167729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.167729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:39.167729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:39.167729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.167729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:39.167729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:39.167729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.167729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:39.167729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:39.167729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:39.168648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:39.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:39.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:39.176505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:39.177024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:39.177274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:39.177548 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:20:39.178163 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:39.178508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.179482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:39.179482 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:39.179482 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:39.179482 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:39.179482 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:39.179482 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:39.179482 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.179482 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:39.181049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.181049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:39.181049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:39.181049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:39.181049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.181049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:39.181049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:39.181049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:39.181049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.181049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:39.181049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:39.181049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:39.181049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:39.181049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:39.181049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:39.181537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:39.181537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:39.181537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:39.181537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:39.181537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:39.181537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:39.181537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:39.181537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.181537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:39.183208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.183208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:39.183208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:39.183208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:39.183208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.183208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:39.183208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:39.183208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:20:39.183208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:39.183208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:39.183208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.183208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:39.183703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:39.183703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:39.183703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.183703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:39.183703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:39.183703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:39.183703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:39.183703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:39.183703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:39.183703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:39.183703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:39.183703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:39.183703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:39.183703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:39.184145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:39.184145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:39.184145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.184145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:39.184911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.184911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:39.184911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:39.184911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:39.184911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:39.184911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:39.184911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.184911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:39.184911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:39.184911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.184911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:39.184911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:39.184911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.184911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:39.184911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:39.184911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:39.185460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:39.186016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:39.186016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:39.186016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:39.186016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:39.186016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:39.186016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.186016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:39.188225 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:39.188550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:39.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:39.188778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:39.189480 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:39.189906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.190715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:39.190715 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:39.190715 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:39.190715 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:39.190715 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:39.190715 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:39.190715 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.190715 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:39.191260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.191260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:39.191260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:39.191260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:39.191260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.191260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:39.191260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:39.191260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:39.191260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.191260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:39.191260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:39.191260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:39.191260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:39.191260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:39.191260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:39.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:39.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:39.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:39.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:39.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:39.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:39.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:39.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:39.192478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:39.192478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:39.192478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.192478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:39.192478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:39.192478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:39.192478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:39.192478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:39.192478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:39.192478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:39.192478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:39.192478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:39.192478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:39.192478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:39.192915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:39.192915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:39.192915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.192915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:39.192915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.192915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:39.192915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:39.192915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:39.192915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:39.192915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:39.192915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.192915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:39.192915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:39.192915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:39.193497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:39.194037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:39.194037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:39.194037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:39.194037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:39.194037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:39.194037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:39.194037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:39.194037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:39.194037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:39.194037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.194037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:39.195542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:39.195831 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:39.195945 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:39.196100 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:39.196615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:39.196950 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:39.197129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.197845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:39.197845 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:39.197845 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:39.197845 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:39.197845 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:39.197845 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:39.197845 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.197845 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:39.198696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.198696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:39.198696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:39.198696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:39.198696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.198696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:39.198696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:39.198696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.198696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:39.198696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:39.198696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:39.198696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:39.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:39.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:39.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:39.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:39.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:39.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:39.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:39.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:39.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:39.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:39.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:39.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:39.199592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.199592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:39.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:39.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:39.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:39.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:39.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:39.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:39.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:39.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:39.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:39.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:39.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:39.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:39.200346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:39.201062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:39.201062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:39.201062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:43.662290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:43.663494 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:43.663494 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:43.664541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:43.697947 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:43.698278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:43.699265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:43.699265 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:43.699265 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:43.699265 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:43.699265 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:43.699265 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:43.699265 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:43.699265 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:43.700388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:43.700388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:43.700388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:43.700388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:43.700388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:43.700388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:43.700388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:43.700388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:43.700388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:43.700388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:43.700388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:43.700388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:43.701013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:43.701013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:43.701013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:43.701013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:43.701013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:43.701013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:43.701013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:43.701013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:43.701013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:43.701013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:43.701013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:43.701013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:43.701013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:43.701672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:43.701672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:43.701672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:43.701672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:43.701672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:43.701672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:43.701672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:43.701672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:43.701672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:43.701672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:43.701672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:43.701672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:43.701672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:43.701672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:43.701672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:43.702434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:43.703398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:43.703398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:43.703398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:43.703398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:43.703398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:43.703398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:44.161814 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:44.162514 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:44.162706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:44.164089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:44.164388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.165261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:44.165261 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:44.165261 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:44.165261 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:44.165261 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:44.165261 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:44.165261 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.165261 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:44.166864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.166864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:44.166864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:44.166864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:44.166864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.166864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:44.166864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:44.166864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.166864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:44.166864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:44.166864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:44.166864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.167677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:44.167677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:44.167677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:44.167677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:44.167677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:44.167677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:44.167677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:44.167677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:44.167677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:44.167677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:44.167677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:44.167677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:44.167677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:44.168482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.168482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:44.168482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.168482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:44.168482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:44.168482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:44.168482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:44.168482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:44.168482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.168482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:44.168482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:44.168482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.168482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:44.168482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:44.168482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:44.169241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:44.170428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:44.170428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:44.170428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:44.170428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:44.170428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.170428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:44.177026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:44.177401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:44.177611 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:44.177793 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:20:44.178320 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:44.178634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.179488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:44.179488 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:44.179488 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:44.179488 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:44.179488 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:44.179488 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:44.179488 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.179488 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:44.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:44.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:44.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:44.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:44.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:44.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:44.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:44.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:44.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:44.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:44.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:44.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:44.181280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:44.181280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:44.181280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:44.181280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:44.181280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:44.181280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:44.181280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:44.181280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.181280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:44.181973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.181973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:44.181973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:44.181973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:44.181973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.181973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:44.181973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:44.181973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:20:44.181973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:44.181973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:44.181973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.181973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:44.182425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:44.182425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:44.182425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.182425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:44.182425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:44.182425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:44.182425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:44.182425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:44.182425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:44.182425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:44.182425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:44.182425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:44.182425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:44.182425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:44.182845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:44.182845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:44.182845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.182845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:44.183878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.183878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:44.183878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:44.183878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:44.183878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:44.183878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:44.183878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.183878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:44.183878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:44.183878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.183878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:44.183878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:44.183878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.183878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:44.183878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:44.183878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:44.184549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:44.185290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:44.185290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:44.185290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:44.185290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:44.185290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:44.185290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.185290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:44.188743 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:44.188991 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:44.189103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:44.189232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:44.189716 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:44.190103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.190842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:44.190842 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:44.190842 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:44.190842 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:44.190842 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:44.190842 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:44.190842 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.190842 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:44.191778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.191778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:44.191778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:44.191778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:44.191778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.191778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:44.191778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:44.191778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:44.191778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.191778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:44.191778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:44.191778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:44.191778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:44.191778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:44.191778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:44.192297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:44.192297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:44.192297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:44.192297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:44.192297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:44.192297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:44.192297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:44.192297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.192297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:44.192786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.192786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:44.192786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:44.192786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:44.192786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.192786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:44.192786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:44.192786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:44.192786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:44.192786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.192786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:44.193187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:44.193187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:44.193187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.193187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:44.193187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:44.193187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:44.193187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:44.193187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:44.193187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:44.193187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:44.193187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:44.193187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:44.193187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:44.193187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:44.193639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:44.193639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:44.193639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.193639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.193864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:44.194387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:44.194944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:44.194944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:44.194944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.194944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:44.195999 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:44.196291 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:44.196456 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:44.196615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:44.197036 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:44.197663 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:44.197843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.198589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:44.198589 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:44.198589 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:44.198589 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:44.198589 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:44.198589 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:44.198589 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.198589 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:44.199818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.199818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:44.199818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:44.199818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:44.199818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.199818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:44.199818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:44.199818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.199818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:44.199818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:44.199818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:44.199818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.200222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:44.200222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:44.200222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:44.200222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:44.200222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:44.200222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:44.200222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:44.200222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:44.200222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:44.200222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:44.200222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:44.200222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:44.200222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:44.200815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.200815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:44.201038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.201038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:44.201038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:44.201038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:44.201038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:44.201038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:44.201038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.201038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:44.201038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:44.201038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.201038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:44.201038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:44.201038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.201038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:44.201038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:44.201038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:44.201572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:44.202153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:44.202153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:44.202153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:48.663057 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:48.663908 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:48.663999 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:48.665234 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:48.706564 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:48.707053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:48.708133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:48.708133 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:48.708133 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:48.708133 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:48.708133 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:48.708133 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:48.708133 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:48.708133 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:48.708942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.044 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:48.708942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:48.708942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:48.708942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:48.708942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:48.708942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:48.708942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:48.708942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:48.708942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:48.708942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:48.708942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:48.708942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:48.709385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:48.709385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:48.709385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:48.709385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:48.709385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:48.709385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:48.709385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:48.709385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:48.709385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:48.709385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:48.709385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:48.709385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:48.709385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:48.709835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:48.709835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:48.709835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:48.709835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:48.709835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:48.709835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:48.709835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:48.709835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:48.709835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:48.709835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:48.709835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:48.709835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:48.709835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:48.709835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:48.709835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:48.710361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:48.710987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:48.710987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:48.710987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:48.710987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:48.710987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:48.710987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:49.162398 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:49.162621 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:49.162721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:49.163420 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:49.163729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.164475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:49.164475 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:49.164475 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:49.164475 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:49.164475 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:49.164475 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:49.164475 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.164475 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:49.165342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.165342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:49.165342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:49.165342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:49.165342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.165342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:49.165342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:49.165342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.165342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:49.165342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:49.165342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:49.165342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.165994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:49.165994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:49.165994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:49.165994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:49.165994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:49.165994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:49.165994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:49.165994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:49.165994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:49.165994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:49.165994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:49.165994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:49.165994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:49.166596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.166596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:49.166596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.166596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:49.166596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:49.166596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:49.166596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:49.166596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:49.166596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.166596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:49.166596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:49.166596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.166596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:49.166596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:49.166596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:49.167308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:49.168175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:49.168175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:49.168175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:49.168175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:49.168175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.168175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:49.177383 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:49.178247 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:49.178418 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:49.178700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:20:49.179385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:49.179797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:49.180651 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:49.180651 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:49.180651 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:49.180651 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:49.180651 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:49.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.180651 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:49.181472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.181472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:49.181472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:49.181472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:49.181472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.181472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:49.181472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:49.181472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:49.181472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.181472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:49.181472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:49.181472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:49.181472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:49.181472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:49.181472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:49.182249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:49.182249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:49.182249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:49.182249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:49.182249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:49.182249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:49.182249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:49.182249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.182249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:49.182707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.182707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:49.182707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:49.182707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:49.182707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.182707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:49.182707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:49.182707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:20:49.182707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:49.182707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:49.182707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.182707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:49.183254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:49.183254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:49.183254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.183254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:49.183254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:49.183254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:49.183254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:49.183254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:49.183254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:49.183254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:49.183254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:49.183254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:49.183254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:49.183254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:49.183895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:49.183895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:49.183895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.183895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:49.183895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.183895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:49.183895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:49.183895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:49.183895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:49.183895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:49.183895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.183895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:49.183895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:49.183895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:49.184737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:49.186035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:49.186035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:49.186035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:49.186035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:49.186035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:49.186035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:49.186035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:49.186035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:49.186035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:49.186035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:49.186035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.186035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:49.188984 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:49.189182 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:49.189295 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:49.189444 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:49.189895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:49.190268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.190958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:49.190958 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:49.190958 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:49.190958 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:49.190958 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:49.190958 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:49.190958 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.190958 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:49.191683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.191683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:49.191683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:49.191683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:49.191683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.191683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:49.191683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:49.191683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:49.191683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.191683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:49.191683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:49.191683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:49.191683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:49.191683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:49.191683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:49.192140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:49.192140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:49.192140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:49.192140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:49.192140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:49.192140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:49.192140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:49.192140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.192140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:49.192683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.192683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:49.192683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:49.192683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:49.192683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.192683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:49.192683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:49.192683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:49.192683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:49.192683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.192683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:49.193035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:49.193035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:49.193035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.193035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:49.193035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:49.193035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:49.193035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:49.193035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:49.193035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:49.193035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:49.193035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:49.193035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:49.193035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:49.193035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:49.193512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:49.193512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:49.193512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.193512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.193732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:49.194258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:49.194892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:49.194892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:49.194892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.194892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:49.196307 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:49.196496 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:49.196603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:49.196750 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:49.197172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:49.197573 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:49.197802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.198461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:49.198461 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:49.198461 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:49.198461 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:49.198461 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:49.198461 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:49.198461 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.198461 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:49.199254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.199254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:49.199254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:49.199254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:49.199254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.199254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:49.199254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:49.199254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.199254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:49.199254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:49.199254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:49.199254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.199628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:49.199628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:49.199628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:49.199628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:49.199628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:49.199628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:49.199628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:49.199628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:49.199628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:49.199628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:49.199628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:49.199628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:49.199628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:49.200006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.200006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:49.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:49.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:49.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:49.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:49.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:49.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:49.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:49.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:49.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:49.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:49.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:49.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:49.200679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:49.201201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:49.201201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:49.201201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:53.663800 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:53.664757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:53.664757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:53.665658 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:53.667341 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=580,neutron:INSERT=1,neutron:UPDATE=2,neutron:DELETE=1 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:20:53.700883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:53.701316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:53.702285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:53.702285 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:53.702285 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:53.702285 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:53.702285 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:53.702285 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:53.702285 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:53.702285 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:53.703057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:53.703057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:53.703057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:53.703057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:53.703057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:53.703057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:53.703057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:53.703057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:53.703057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:53.703057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:53.703057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:53.703057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:53.703629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:53.703629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:53.703629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:53.703629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:53.703629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:53.703629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:53.703629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:53.703629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:53.703629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:53.703629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:53.703629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:53.703629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:53.703629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:53.704298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:53.704298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:53.704298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:53.704298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:53.704298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:53.704298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:53.704298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:53.704298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:53.704298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:53.704298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:53.704298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:53.704298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:53.704298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:53.704298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:53.704298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:53.704967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:53.706024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:53.706024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:53.706024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:53.706024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:53.706024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:53.706024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:54.163006 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:54.163345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:54.163528 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:54.164550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:54.164873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.165683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:54.165683 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:54.165683 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:54.165683 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:54.165683 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:54.165683 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:54.165683 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.165683 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:54.166913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.166913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:54.166913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:54.166913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:54.166913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.166913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:54.166913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:54.166913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.166913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:54.166913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:54.166913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:54.166913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.167475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:54.167475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:54.167475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:54.167475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:54.167475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:54.167475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:54.167475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:54.167475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:54.167475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:54.167475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:54.167475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:54.167475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:54.167475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:54.168087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.168087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:54.168203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.168203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:54.168203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:54.168203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:54.168203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:54.168203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:54.168203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.168203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:54.168203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:54.168203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.168203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:54.168203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:54.168203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.168203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:54.168203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:54.168203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:54.168975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:54.169825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:54.169825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.169825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:54.178726 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:54.179264 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:54.179461 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:54.179655 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:20:54.180466 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:54.180739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.181482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:54.181482 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:54.181482 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:54.181482 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:54.181482 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:54.181482 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:54.181482 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.181482 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:54.182381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.182381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:54.182381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:54.182381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:54.182381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.182381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:54.182381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:54.182381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:54.182381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.182381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:54.182381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:54.182381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:54.182381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:54.182381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:54.182381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:54.183046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:54.183046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:54.183046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:54.183046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:54.183046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:54.183046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:54.183046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:54.183046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.183046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:54.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:54.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:54.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:54.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:54.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:54.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:20:54.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:54.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:54.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:54.184072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:54.184072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:54.184072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.184072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:54.184072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:54.184072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:54.184072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:54.184072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:54.184072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:54.184072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:54.184072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:54.184072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:54.184072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:54.184072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:54.185410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:54.185410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:54.185410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.185410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:54.185410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.185410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:54.185410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:54.185410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:54.185410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:54.185410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:54.185410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.185410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:54.185410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:54.185410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:54.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:54.188936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:54.188936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:54.188936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:54.188936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:54.188936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:54.188936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:54.188936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:54.188936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:54.188936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:54.188936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:54.188936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.188936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:54.189566 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:54.190019 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:54.190193 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:54.190420 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:54.191184 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:54.191609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.192473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:54.192473 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:54.192473 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:54.192473 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:54.192473 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:54.192473 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:54.192473 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.192473 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:54.193257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.193257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:54.193257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:54.193257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:54.193257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.193257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:54.193257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:54.193257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:54.193257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.193257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:54.193257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:54.193257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:54.193257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:54.193257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:54.193257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:54.193664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:54.193664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:54.193664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:54.193664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:54.193664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:54.193664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:54.193664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:54.193664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.193664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:54.194234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.194234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:54.194234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:54.194234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:54.194234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.194234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:54.194234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:54.194234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:54.194234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:54.194234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.194234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:54.194631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:54.194631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:54.194631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.194631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:54.194631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:54.194631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:54.194631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:54.194631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:54.194631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:54.194631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:54.194631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:54.194631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:54.194631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:54.194631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:54.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:54.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:54.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.195110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.195403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:54.195933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:54.196582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:54.196582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:54.196582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.196582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:54.196824 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:54.197191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:54.197353 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:54.197596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:54.198119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:54.198396 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:54.198567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.199207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:54.199207 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:54.199207 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:54.199207 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:54.199207 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:54.199207 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:54.199207 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.199207 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:54.200083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.200083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:54.200083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:54.200083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:54.200083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.200083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:54.200083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:54.200083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.200083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:54.200083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:54.200083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:54.200083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.200522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:54.200522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:54.200522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:54.200522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:54.200522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:54.200522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:54.200522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:54.200522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:54.200522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:54.200522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:54.200522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:54.200522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:54.200522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:54.200937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.200937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:54.201193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.201193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:54.201193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:54.201193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:54.201193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:54.201193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:54.201193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.201193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:54.201193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:54.201193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.201193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:54.201193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:54.201193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.201193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:54.201193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:54.201193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:54.201818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:54.202391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:54.202391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:54.202391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:58.664555 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:58.665662 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:58.665662 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:58.666785 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:58.702508 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:58.702811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:58.705799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:58.705799 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:58.705799 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:58.705799 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:58.705799 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:58.705799 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:58.705799 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:58.705799 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:58.705799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:58.705799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:58.705799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:58.705799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:58.705799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:58.705799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:58.705799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:58.706822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:58.706822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:58.706822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:58.706822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:58.706822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:58.706822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:58.706822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:58.706822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:58.706822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:58.706822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:58.706822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:58.706822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:58.706822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:58.706822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:58.707643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:58.707643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:58.707643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:58.707643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:58.707643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:58.707643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:58.707643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:58.707643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:58.707643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:58.707643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:58.707643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:58.707643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:58.707643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:58.707643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:58.708477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:58.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:58.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:58.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:58.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:58.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:58.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:58.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:58.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:58.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:59.165528 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:59.166412 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:59.166613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:59.167821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:59.168250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.169305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:59.169305 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:59.169305 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:59.169305 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:59.169305 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:59.169305 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:59.169305 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.169305 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:59.171066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.171066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:59.171066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:59.171066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:59.171066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.171066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:59.171066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:59.171066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.171066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:59.171066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:59.171066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:59.171066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.172097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:59.172097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:59.172097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:59.172097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:59.172097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:59.172097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:59.172097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:59.172097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:59.172097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:59.172097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:59.172097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:59.172097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:59.172097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:59.172692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.172692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:59.172692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.172692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:59.172692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:59.172692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:59.172692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:59.172692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:59.172692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.172692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:59.172692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:59.172692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.172692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:59.172692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:59.172692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:59.173437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:59.175971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:59.175971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:59.175971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:59.175971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:59.175971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.175971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:59.179307 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:59.179659 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:59.179770 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:59.179894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:20:59.180317 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:59.180568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.181187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:59.181187 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:59.181187 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:59.181187 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:59.181187 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:59.181187 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:59.181187 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.181187 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:59.182551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.182551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:59.182551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:59.182551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:59.182551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.182551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:59.182551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:59.182551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:59.182551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.182551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:59.182551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:59.182551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:59.182551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:59.182551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:59.182551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:59.182988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:59.182988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:59.182988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:59.182988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:59.182988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:59.182988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:59.182988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:59.182988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.182988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:59.184004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.184004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:59.184004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:59.184004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:59.184004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.184004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:59.184004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:59.184004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:20:59.184004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:59.184004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:59.184004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.184004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:59.184654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:59.184654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:59.184654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.184654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:59.184654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:59.184654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:59.184654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:59.184654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:59.184654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:59.184654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:59.184654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:59.184654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:59.184654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:59.184654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:59.185276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:59.185276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:59.185276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.185276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:59.185841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.185841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:59.185841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:59.185841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:59.185841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:59.185841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:59.185841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.185841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:59.185841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:59.185841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.185841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:59.185841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:59.185841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.185841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:59.185841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:59.185841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:59.186307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:59.186896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:59.186896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:59.186896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:59.186896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:59.186896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:59.186896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.186896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:59.190190 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:59.190617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:59.190735 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:59.190866 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:59.191289 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:59.191647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.192273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:59.192273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:59.192273 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:59.192273 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:59.192273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:59.192273 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:59.192273 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.192273 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:59.193159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.193159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:20:59.193159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:59.193159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:59.193159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.193159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:59.193159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:59.193159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:59.193159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.193159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:20:59.193159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:59.193159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:20:59.193159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:59.193159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:20:59.193159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:20:59.193614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:59.193614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:20:59.193614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:59.193614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:20:59.193614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:20:59.193614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:59.193614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:20:59.193614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.193614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:20:59.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:59.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:59.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:59.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:59.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:59.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:59.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:59.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:59.194481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:59.194481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:59.194481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.194481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:59.194481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:59.194481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:59.194481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:59.194481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:59.194481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:59.194481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:59.194481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:59.194481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:59.194481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:59.194481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:59.194873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:59.194873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:59.194873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.194873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.195283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:59.195818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:59.196401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:59.196401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:59.196401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.196401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:20:59.197268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:20:59.197578 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:20:59.197683 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:20:59.197851 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:20:59.198236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:59.198703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:20:59.198923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.199669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:20:59.199669 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:59.199669 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:20:59.199669 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:20:59.199669 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:59.199669 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:20:59.199669 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.199669 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:20:59.200567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.200567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:20:59.200567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:59.200567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:20:59.200567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.200567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:59.200567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:59.200567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.200567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:59.200567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:59.200567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:59.200567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.200976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:20:59.200976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:59.200976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:20:59.200976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:59.200976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:20:59.200976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:20:59.200976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:59.200976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:20:59.200976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:59.200976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:20:59.200976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:20:59.200976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:59.200976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:20:59.201349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.201349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:20:59.201573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.201573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:20:59.201573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:20:59.201573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:20:59.201573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:20:59.201573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:20:59.201573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.201573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:20:59.201573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:20:59.201573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.201573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:20:59.201573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:20:59.201573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.201573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:20:59.201573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:20:59.201573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:20:59.202029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:20:59.202580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:20:59.202580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:20:59.202580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:03.665241 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:03.665879 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:03.665922 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:03.667258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:03.700747 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:03.701102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:03.701989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:03.701989 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:03.701989 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:03.701989 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:03.701989 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:03.701989 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:03.701989 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:03.701989 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:03.703157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:03.703157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:03.703157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:03.703157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:03.703157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:03.703157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:03.703157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:03.703157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:03.703157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:03.703157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:03.703157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:03.703157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:03.703768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:03.703768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:03.703768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:03.703768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:03.703768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:03.703768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:03.703768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:03.703768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:03.703768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:03.703768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:03.703768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:03.703768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:03.703768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:03.704312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:03.704312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:03.704312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:03.704312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:03.704312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:03.704312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:03.704312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:03.704312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:03.704312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:03.704312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:03.704312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:03.704312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:03.704312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:03.704312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:03.704312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:03.705059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:03.706048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:03.706048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:03.706048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:03.706048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:03.706048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:03.706048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:04.166228 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:04.166875 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:04.167074 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:04.168200 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:04.168612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.169566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:04.169566 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:04.169566 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:04.169566 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:04.169566 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:04.169566 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:04.169566 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.169566 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:04.171124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.171124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:04.171124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:04.171124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:04.171124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.171124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:04.171124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:04.171124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.171124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:04.171124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:04.171124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:04.171124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.171586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:04.171586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:04.171586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:04.171586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:04.171586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:04.171586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:04.171586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:04.171586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:04.171586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:04.171586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:04.171586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:04.171586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:04.171586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:04.172007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.172007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:04.173483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.173483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:04.173483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:04.173483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:04.173483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:04.173483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:04.173483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.173483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:04.173483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:04.173483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.173483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:04.173483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:04.173483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.173483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:04.173483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:04.173483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:04.174184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:04.174978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:04.174978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.174978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:04.179987 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:04.180349 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:04.180491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:04.180617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:21:04.181166 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:04.181548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.182342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:04.182342 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:04.182342 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:04.182342 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:04.182342 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:04.182342 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:04.182342 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.182342 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:04.183157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.183157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:04.183157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:04.183157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:04.183157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.183157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:04.183157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:04.183157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:04.183157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.183157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:04.183157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:04.183157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:04.183157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:04.183157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:04.183157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:04.183606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:04.183606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:04.183606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:04.183606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:04.183606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:04.183606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:04.183606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:04.183606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.183606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:04.184010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.184010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:04.184010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:04.184010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:04.184010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.184010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:04.184010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:04.184010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:21:04.184010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:04.184010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:04.184010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.184010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:04.184293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:04.184293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:04.184293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.184293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:04.184293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:04.184293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:04.184293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:04.184293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:04.184293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:04.184293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:04.184293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:04.184293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:04.184293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:04.184293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:04.184633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:04.184633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:04.184633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.184633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:04.185016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.185016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:04.185016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:04.185016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:04.185016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:04.185016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:04.185016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.185016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:04.185016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:04.185016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.185016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:04.185016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:04.185016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.185016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:04.185016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:04.185016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:04.185496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:04.186055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:04.186055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:04.186055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:04.186055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:04.186055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:04.186055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.186055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:04.190781 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:04.191108 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:04.191249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:04.191357 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:04.191847 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:04.192203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.192937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:04.192937 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:04.192937 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:04.192937 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:04.192937 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:04.192937 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:04.192937 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.192937 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:04.193782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.193782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:04.193782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:04.193782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:04.193782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.193782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:04.193782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:04.193782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:04.193782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.193782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:04.193782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:04.193782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:04.193782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:04.193782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:04.193782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:04.194214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:04.194214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:04.194214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:04.194214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:04.194214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:04.194214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:04.194214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:04.194214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.194214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:04.194650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.194650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:04.194650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:04.194650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:04.194650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.194650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:04.194650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:04.194650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:04.194650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:04.194650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.194650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:04.195070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:04.195070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:04.195070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.195070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:04.195070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:04.195070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:04.195070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:04.195070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:04.195070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:04.195070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:04.195070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:04.195070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:04.195070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:04.195070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:04.195551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:04.195551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:04.195551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.195551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.195672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:04.196259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:04.196974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:04.196974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:04.196974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.196974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:04.197777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:04.198138 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:04.198251 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:04.198444 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:04.198939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:04.199303 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:04.199519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.200275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:04.200275 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:04.200275 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:04.200275 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:04.200275 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:04.200275 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:04.200275 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.200275 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:04.201252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.201252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:04.201252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:04.201252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:04.201252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.201252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:04.201252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:04.201252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.201252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:04.201252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:04.201252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:04.201252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.201877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:04.201877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:04.201877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:04.201877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:04.201877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:04.201877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:04.201877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:04.201877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:04.201877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:04.201877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:04.201877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:04.201877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:04.201877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:04.202436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.202436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:04.202544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.202544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:04.202544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:04.202544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:04.202544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:04.202544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:04.202544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.202544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:04.202544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:04.202544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.202544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:04.202544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:04.202544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.202544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:04.202544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:04.202544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:04.203218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:04.204000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:04.204000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:04.204000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:08.665957 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:08.666740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:08.666740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:08.667491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:08.696482 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:08.696769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:08.697428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:08.697428 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:08.697428 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:08.697428 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:08.697428 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:08.697428 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:08.697428 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:08.697428 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:08.698313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.031 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:08.698313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:08.698313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:08.698313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:08.698313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:08.698313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:08.698313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:08.698313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:08.698313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:08.698313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:08.698313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:08.698313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:08.699036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:08.699036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:08.699036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:08.699036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:08.699036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:08.699036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:08.699036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:08.699036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:08.699036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:08.699036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:08.699036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:08.699036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:08.699036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:08.699614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:08.699614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:08.699614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:08.699614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:08.699614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:08.699614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:08.699614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:08.699614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:08.699614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:08.699614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:08.699614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:08.699614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:08.699614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:08.699614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:08.699614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:08.700305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:08.701173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:08.701173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:08.701173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:08.701173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:08.701173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:08.701173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:09.166848 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:09.167354 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:09.167548 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:09.168314 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:09.168633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.169390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:09.169390 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:09.169390 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:09.169390 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:09.169390 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:09.169390 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:09.169390 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.169390 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:09.170512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.170512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:09.170512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:09.170512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:09.170512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.170512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:09.170512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:09.170512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.170512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:09.170512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:09.170512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:09.170512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.171216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:09.171216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:09.171216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:09.171216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:09.171216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:09.171216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:09.171216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:09.171216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:09.171216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:09.171216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:09.171216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:09.171216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:09.171216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:09.171932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.171932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:09.171932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.171932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:09.171932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:09.171932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:09.171932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:09.171932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:09.171932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.171932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:09.171932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:09.171932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.171932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:09.171932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:09.171932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:09.172808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:09.173925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:09.173925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:09.173925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:09.173925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:09.173925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.173925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:09.180655 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:09.181015 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:09.181113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:09.181279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:21:09.182193 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:09.182556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.183344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:09.183344 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:09.183344 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:09.183344 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:09.183344 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:09.183344 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:09.183344 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.183344 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:09.185010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.185010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:09.185010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:09.185010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:09.185010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.185010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:09.185010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:09.185010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:09.185010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.185010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:09.185010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:09.185010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:09.185010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:09.185010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:09.185010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:09.186348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:09.186348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:09.186348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:09.186348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:09.186348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:09.186348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:09.186348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:09.186348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.186348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:09.186348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.186348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:09.186348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:09.186348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:09.186348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.187242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:09.187242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:09.187242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:21:09.187242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:09.187242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:09.187242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.187242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:09.187242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:09.187242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:09.187242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.187242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:09.187242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:09.187242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:09.188013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:09.188013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:09.188013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:09.188013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:09.188013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:09.188013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:09.188013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:09.188013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:09.188013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:09.188013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:09.188013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.188013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:09.188876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.188876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:09.188876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:09.188876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:09.188876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:09.188876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:09.188876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.188876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:09.188876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:09.188876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.188876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:09.188876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:09.188876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.188876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:09.188876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:09.188876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:09.189527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:09.190020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:09.190020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:09.190020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:09.190020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:09.190020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:09.190020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.190020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:09.191395 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:09.191657 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:09.191785 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:09.191923 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:09.192326 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:09.192596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.193180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:09.193180 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:09.193180 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:09.193180 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:09.193180 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:09.193180 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:09.193180 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.193180 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:09.194208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.194208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:09.194208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:09.194208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:09.194208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.194208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:09.194208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:09.194208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:09.194208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.194208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:09.194208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:09.194208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:09.194208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:09.194208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:09.194208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:09.194582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:09.194582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:09.194582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:09.194582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:09.194582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:09.194582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:09.194582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:09.194582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.194582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:09.195505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.195505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:09.195505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:09.195505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:09.195505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.195505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:09.195505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:09.195505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:09.195505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:09.195505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.195505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:09.195734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:09.195734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:09.195734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.195734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:09.195734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:09.195734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:09.195734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:09.195734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:09.195734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:09.195734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:09.195734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:09.195734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:09.195734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:09.195734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:09.196009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:09.196009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:09.196009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.196009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.196801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:09.197158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:09.197550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:09.197550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:09.197550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.197550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:09.198198 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:09.198483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:09.198596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:09.198750 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:09.199095 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:09.199381 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:09.199532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.200084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:09.200084 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:09.200084 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:09.200084 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:09.200084 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:09.200084 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:09.200084 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.200084 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:09.201063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.201063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:09.201063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:09.201063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:09.201063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.201063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:09.201063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:09.201063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.201063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:09.201063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:09.201063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:09.201063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.201496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:09.201496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:09.201496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:09.201496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:09.201496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:09.201496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:09.201496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:09.201496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:09.201496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:09.201496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:09.201496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:09.201496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:09.201496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:09.201898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.201898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:09.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:09.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:09.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:09.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:09.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:09.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:09.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:09.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:09.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:09.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:09.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:09.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:09.202702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:09.203247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:09.203247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:09.203247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:13.666637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:13.667581 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:13.667773 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:13.669019 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:13.704563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:13.705200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:13.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:13.706205 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:13.706205 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:13.706205 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:13.706205 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:13.706205 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:13.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:13.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:13.707338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:13.707338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:13.707338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:13.707338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:13.707338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:13.707338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:13.707338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:13.707338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:13.707338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:13.707338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:13.707338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:13.707338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:13.708011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:13.708011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:13.708011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:13.708011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:13.708011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:13.708011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:13.708011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:13.708011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:13.708011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:13.708011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:13.708011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:13.708011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:13.708011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:13.708626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:13.708626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:13.708626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:13.708626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:13.708626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:13.708626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:13.708626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:13.708626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:13.708626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:13.708626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:13.708626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:13.708626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:13.708626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:13.708626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:13.708626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:13.709409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:13.710259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:13.710259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:13.710259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:13.710259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:13.710259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:13.710259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:14.167568 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:14.168107 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:14.168230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:14.168969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:14.169290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.170235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:14.170235 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:14.170235 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:14.170235 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:14.170235 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:14.170235 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:14.170235 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.170235 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:14.171698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.171698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:14.171698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:14.171698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:14.171698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.171698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:14.171698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:14.171698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.171698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:14.171698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:14.171698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:14.171698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.172340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:14.172340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:14.172340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:14.172340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:14.172340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:14.172340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:14.172340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:14.172340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:14.172340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:14.172340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:14.172340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:14.172340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:14.172340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:14.172926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.172926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:14.173911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.173911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:14.173911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:14.173911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:14.173911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:14.173911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:14.173911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.173911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:14.173911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:14.173911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.173911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:14.173911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:14.173911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.173911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:14.173911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:14.173911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:14.174798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:14.175468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:14.175468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.175468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:14.181232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:14.181592 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:14.181706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:14.181851 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:21:14.182422 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:14.182731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.183474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:14.183474 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:14.183474 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:14.183474 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:14.183474 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:14.183474 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:14.183474 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.183474 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:14.184325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.184325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:14.184325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:14.184325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:14.184325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.184325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:14.184325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:14.184325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:14.184325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.184325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:14.184325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:14.184325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:14.184325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:14.184325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:14.184325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:14.185212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:14.185212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:14.185212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:14.185212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:14.185212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:14.185212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:14.185212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:14.185212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.185212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:14.185212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.185212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:14.185212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:14.185212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:14.185212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.185999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:14.185999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:14.185999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:21:14.185999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:14.185999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:14.185999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.185999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:14.185999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:14.185999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:14.185999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.185999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:14.185999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:14.185999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:14.186750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:14.186750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:14.186750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:14.186750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:14.186750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:14.186750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:14.186750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:14.186750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:14.186750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:14.186750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:14.186750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.186750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:14.187410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.187410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:14.187410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:14.187410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:14.187410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:14.187410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:14.187410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.187410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:14.187410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:14.187410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.187410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:14.187410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:14.187410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.187410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:14.187410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:14.187410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:14.188229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:14.189605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:14.189605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:14.189605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:14.189605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:14.189605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:14.189605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.189605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:14.192055 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:14.192723 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:14.192849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:14.192980 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:14.193465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:14.193841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.194734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:14.194734 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:14.194734 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:14.194734 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:14.194734 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:14.194734 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:14.194734 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.194734 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:14.195603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.195603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:14.195603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:14.195603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:14.195603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.195603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:14.195603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:14.195603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:14.195603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.195603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:14.195603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:14.195603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:14.195603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:14.195603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:14.195603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:14.196044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:14.196044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:14.196044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:14.196044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:14.196044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:14.196044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:14.196044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:14.196044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.196044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:14.196624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.196624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:14.196624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:14.196624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:14.196624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.196624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:14.196624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:14.196624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:14.196624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:14.196624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.196624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:14.196948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:14.196948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:14.196948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.196948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:14.196948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:14.196948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:14.196948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:14.196948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:14.196948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:14.196948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:14.196948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:14.196948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:14.196948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:14.196948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:14.197294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:14.197294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:14.197294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.197294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.198062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:14.198597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:14.199102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:14.199102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:14.199102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.199102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:14.199102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:14.199102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:14.199102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:14.199352 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:14.199692 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:14.200494 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:14.201154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.201804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:14.201804 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:14.201804 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:14.201804 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:14.201804 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:14.201804 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:14.201804 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.201804 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:14.202881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.202881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:14.202881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:14.202881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:14.202881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.202881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:14.202881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:14.202881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.202881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:14.202881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:14.202881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:14.202881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.203312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:14.203312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:14.203312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:14.203312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:14.203312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:14.203312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:14.203312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:14.203312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:14.203312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:14.203312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:14.203312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:14.203312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:14.203312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:14.203709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.203709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:14.204042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.204042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:14.204042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:14.204042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:14.204042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:14.204042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:14.204042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.204042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:14.204042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:14.204042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.204042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:14.204042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:14.204042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.204042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:14.204042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:14.204042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:14.204558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:14.205078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:14.205078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:14.205078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:18.667605 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:18.668502 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:18.668502 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:18.670008 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:18.700680 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:18.701025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:18.701946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:18.701946 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:18.701946 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:18.701946 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:18.701946 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:18.701946 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:18.701946 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:18.701946 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:18.702941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:18.702941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:18.702941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:18.702941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:18.702941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:18.702941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:18.702941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:18.702941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:18.702941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:18.702941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:18.702941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:18.702941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:18.703829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:18.703829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:18.703829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:18.703829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:18.703829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:18.703829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:18.703829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:18.703829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:18.703829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:18.703829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:18.703829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:18.703829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:18.703829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:18.704512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:18.704512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:18.704512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:18.704512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:18.704512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:18.704512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:18.704512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:18.704512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:18.704512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:18.704512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:18.704512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:18.704512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:18.704512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:18.704512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:18.704512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:18.705271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:18.706136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:18.706136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:18.706136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:18.706136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:18.706136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:18.706136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:19.168273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:19.168942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:19.169143 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:19.170109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:19.170503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.171443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:19.171443 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:19.171443 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:19.171443 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:19.171443 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:19.171443 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:19.171443 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.171443 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:19.173120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.173120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:19.173120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:19.173120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:19.173120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.173120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:19.173120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:19.173120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.173120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:19.173120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:19.173120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:19.173120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.173747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:19.173747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:19.173747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:19.173747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:19.173747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:19.173747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:19.173747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:19.173747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:19.173747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:19.173747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:19.173747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:19.173747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:19.173747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:19.174351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.174351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:19.175149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.175149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:19.175149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:19.175149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:19.175149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:19.175149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:19.175149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.175149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:19.175149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:19.175149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.175149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:19.175149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:19.175149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.175149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:19.175149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:19.175149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:19.175949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:19.176769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:19.176769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.176769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:19.181707 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:19.182067 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:19.182222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:19.182387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:21:19.182904 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:19.183227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.184049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:19.184049 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:19.184049 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:19.184049 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:19.184049 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:19.184049 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:19.184049 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.184049 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:19.184908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.184908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:19.184908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:19.184908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:19.184908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.184908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:19.184908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:19.184908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:19.184908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.184908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:19.184908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:19.184908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:19.184908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:19.184908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:19.184908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:19.185441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:19.185441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:19.185441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:19.185441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:19.185441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:19.185441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:19.185441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:19.185441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.185441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:19.185996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.185996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:19.185996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:19.185996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:19.185996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.185996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:19.185996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:19.185996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:21:19.185996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:19.185996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:19.185996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.185996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:19.186358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:19.186358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:19.186358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.186358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:19.186358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:19.186358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:19.186358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:19.186358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:19.186358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:19.186358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:19.186358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:19.186358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:19.186358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:19.186358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:19.186754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:19.186754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:19.186754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.186754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:19.187218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.187218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:19.187218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:19.187218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:19.187218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:19.187218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:19.187218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.187218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:19.187218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:19.187218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.187218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:19.187218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:19.187218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.187218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:19.187218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:19.187218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:19.187725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:19.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:19.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:19.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:19.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:19.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:19.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:19.192730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:19.193004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:19.193119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:19.193244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:19.193591 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:19.193846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.194486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:19.194486 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:19.194486 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:19.194486 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:19.194486 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:19.194486 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:19.194486 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.194486 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:19.195294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.195294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:19.195294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:19.195294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:19.195294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.195294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:19.195294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:19.195294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:19.195294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.195294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:19.195294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:19.195294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:19.195294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:19.195294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:19.195294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:19.195767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:19.195767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:19.195767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:19.195767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:19.195767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:19.195767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:19.195767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:19.195767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.195767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:19.196223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.196223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:19.196223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:19.196223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:19.196223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.196223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:19.196223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:19.196223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:19.196223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:19.196223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.196223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:19.196596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:19.196596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:19.196596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.196596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:19.196596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:19.196596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:19.196596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:19.196596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:19.196596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:19.196596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:19.196596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:19.196596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:19.196596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:19.196596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:19.197018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:19.197018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:19.197018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.197018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.198174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:19.198699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:19.199212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:19.199212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:19.199212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.199212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:19.199212 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:19.199212 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:19.199428 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:19.199528 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:19.199937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:19.200282 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:19.200545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.201231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:19.201231 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:19.201231 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:19.201231 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:19.201231 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:19.201231 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:19.201231 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.201231 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:19.202120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.202120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:19.202120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:19.202120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:19.202120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.202120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:19.202120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:19.202120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.202120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:19.202120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:19.202120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:19.202120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.202772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:19.202772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:19.202772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:19.202772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:19.202772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:19.202772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:19.202772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:19.202772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:19.202772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:19.202772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:19.202772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:19.202772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:19.202772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:19.203448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.203448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:19.203448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.203448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:19.203448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:19.203448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:19.203448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:19.203448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:19.203448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.203448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:19.203448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:19.203448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.203448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:19.203448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:19.203448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:19.204112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:19.204963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:19.204963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:19.204963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:19.204963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:19.204963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:19.204963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:23.668259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:23.669088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:23.669088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:23.670464 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:23.704345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:23.705021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:23.706217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:23.706217 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:23.706217 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:23.706217 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:23.706217 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:23.706217 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:23.706217 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:23.706217 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:23.707261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:23.707261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:23.707261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:23.707261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:23.707261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:23.707261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:23.707261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:23.707261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:23.707261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:23.707261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:23.707261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:23.707261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:23.708083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:23.708083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:23.708083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:23.708083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:23.708083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:23.708083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:23.708083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:23.708083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:23.708083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:23.708083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:23.708083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:23.708083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:23.708083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:23.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:23.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:23.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:23.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:23.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:23.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:23.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:23.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:23.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:23.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:23.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:23.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:23.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:23.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:23.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:23.709414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:23.710253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:23.710253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:23.710253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:23.710253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:23.710253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:23.710253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:24.169022 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:24.169636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:24.169850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:24.170663 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:24.171011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.171870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:24.171870 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:24.171870 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:24.171870 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:24.171870 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:24.171870 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:24.171870 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.171870 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:24.173492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.173492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:24.173492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:24.173492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:24.173492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.173492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:24.173492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:24.173492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.173492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:24.173492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:24.173492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:24.173492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.174898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:24.174898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:24.174898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:24.174898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:24.174898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:24.174898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:24.174898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:24.174898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:24.174898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:24.174898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:24.174898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:24.174898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:24.174898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:24.176419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.176419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:24.176419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.176419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:24.176419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:24.176419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:24.176419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:24.176419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:24.176419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.176419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:24.176419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:24.176419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.176419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:24.176419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:24.176419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:24.176861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:24.177342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:24.177342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:24.177342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:24.177342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:24.177342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.177342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:24.182170 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:24.182591 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:24.182770 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:24.182952 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:21:24.183513 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:24.183717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.184475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:24.184475 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:24.184475 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:24.184475 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:24.184475 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:24.184475 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:24.184475 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.184475 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:24.185270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.185270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:24.185270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:24.185270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:24.185270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.185270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:24.185270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:24.185270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:24.185270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.185270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:24.185270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:24.185270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:24.185270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:24.185270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:24.185270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:24.186592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:24.186592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:24.186592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:24.186592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:24.186592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:24.186592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:24.186592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:24.186592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.186592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:24.186592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.186592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:24.186592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:24.186592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:24.186592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.187534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:24.187534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:24.187534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:21:24.187534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:24.187534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:24.187534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.187534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:24.187534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:24.187534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:24.187534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.187534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:24.187534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:24.187534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:24.188275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:24.188275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:24.188275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:24.188275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:24.188275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:24.188275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:24.188275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:24.188275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:24.188275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:24.188275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:24.188275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.188275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:24.190123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.190123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:24.190123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:24.190123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:24.190123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:24.190123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:24.190123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.190123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:24.190123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:24.190123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.190123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:24.190123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:24.190123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.190123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:24.190123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:24.190123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:24.192241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:24.193191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:24.193191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:24.193191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:24.193191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:24.193191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:24.193191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.193191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:24.193191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:24.193433 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:24.193535 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:24.193664 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:24.194052 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:24.194426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.195079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:24.195079 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:24.195079 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:24.195079 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:24.195079 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:24.195079 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:24.195079 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.195079 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:24.195817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.195817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:24.195817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:24.195817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:24.195817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.195817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:24.195817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:24.195817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:24.195817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.195817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:24.195817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:24.195817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:24.195817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:24.195817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:24.195817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:24.196167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:24.196167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:24.196167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:24.196167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:24.196167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:24.196167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:24.196167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:24.196167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.196167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:24.196774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.196774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:24.196774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:24.196774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:24.196774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.196774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:24.196774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:24.196774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:24.196774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:24.196774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.196774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:24.197228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:24.197228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:24.197228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.197228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:24.197228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:24.197228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:24.197228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:24.197228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:24.197228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:24.197228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:24.197228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:24.197228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:24.197228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:24.197228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:24.197570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:24.197570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:24.197570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.197570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.197846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:24.199155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:24.200191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:24.200191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:24.200191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.200191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:24.200191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:24.200191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:24.200191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:24.200191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:24.200731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:24.200818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:24.201042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.201687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:24.201687 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:24.201687 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:24.201687 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:24.201687 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:24.201687 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:24.201687 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.201687 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:24.202725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.202725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:24.202725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:24.202725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:24.202725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.202725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:24.202725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:24.202725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.202725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:24.202725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:24.202725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:24.202725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.203921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:24.203921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:24.203921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:24.203921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:24.203921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:24.203921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:24.203921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:24.203921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:24.203921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:24.203921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:24.203921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:24.203921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:24.203921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:24.205707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.205707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:24.205707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.205707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:24.205707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:24.205707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:24.205707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:24.205707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:24.205707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.205707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:24.205707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:24.205707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.205707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:24.205707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:24.205707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:24.207745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:24.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:24.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:24.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:24.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:24.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:24.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:28.668914 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:28.669612 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:28.669749 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:28.671043 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:28.695413 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:28.695847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:28.696941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:28.696941 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:28.696941 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:28.696941 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:28.696941 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:28.696941 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:28.696941 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:28.696941 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:28.698631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.027 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:28.698631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:28.698631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:28.698631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:28.698631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:28.698631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:28.698631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:28.698631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:28.698631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:28.698631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:28.698631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:28.698631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:28.699484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:28.699484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:28.699484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:28.699484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:28.699484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:28.699484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:28.699484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:28.699484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:28.699484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:28.699484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:28.699484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:28.699484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:28.699484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:28.700121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:28.700121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:28.700983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:28.700983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:28.700983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:28.700983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:28.700983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:28.700983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:28.700983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:28.700983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:28.700983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:28.700983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:28.700983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:28.700983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:28.700983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:28.700983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:28.700983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:28.700983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:28.702046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:28.703052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:28.703052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:28.703052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:29.172403 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:29.172403 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:29.172403 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:29.173238 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:29.173737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.174724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:29.174724 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:29.174724 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:29.174724 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:29.174724 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:29.174724 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:29.174724 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.174724 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:29.175989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.175989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:29.175989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:29.175989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:29.175989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.175989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:29.175989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:29.175989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.175989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:29.175989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:29.175989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:29.175989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.176301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:29.176301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:29.176301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:29.176301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:29.176301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:29.176301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:29.176301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:29.176301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:29.176301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:29.176301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:29.176301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:29.176301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:29.176301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:29.176591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.176591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:29.177963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.177963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:29.177963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:29.177963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:29.177963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:29.177963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:29.177963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.177963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:29.177963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:29.177963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.177963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:29.177963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:29.177963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.177963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:29.177963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:29.177963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:29.178472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:29.179043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:29.179043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.179043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:29.182756 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:29.183179 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:29.183179 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:29.183303 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:21:29.183899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:29.184265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.185165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:29.185165 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:29.185165 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:29.185165 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:29.185165 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:29.185165 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:29.185165 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.185165 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:29.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:29.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:29.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:29.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:29.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:29.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:29.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:29.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:29.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:29.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:29.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:29.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:29.186688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:29.186688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:29.186688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:29.186688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:29.186688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:29.186688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:29.186688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:29.186688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.186688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:29.187099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.187099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:29.187099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:29.187099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:29.187099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.187099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:29.187099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:29.187099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:21:29.187099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:29.187099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:29.187099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.187099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:29.187685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:29.187685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:29.187685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.187685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:29.187685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:29.187685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:29.187685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:29.187685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:29.187685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:29.187685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:29.187685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:29.187685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:29.187685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:29.187685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:29.188178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:29.188178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:29.188178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.188178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:29.188178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.188178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:29.188178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:29.188178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:29.188178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:29.188178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:29.188178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.188178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:29.188178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:29.188178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:29.188683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:29.189223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:29.189223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:29.189223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:29.189223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:29.189223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:29.189223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:29.189223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:29.189223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:29.189223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:29.189223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:29.189223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.189223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:29.193580 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:29.193821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:29.193934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:29.194061 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:29.194435 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:29.194695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.195216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:29.195216 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:29.195216 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:29.195216 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:29.195216 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:29.195216 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:29.195216 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.195216 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:29.195986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.195986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:29.195986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:29.195986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:29.195986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.195986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:29.195986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:29.195986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:29.195986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.195986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:29.195986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:29.195986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:29.195986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:29.195986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:29.195986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:29.196505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:29.196505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:29.196505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:29.196505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:29.196505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:29.196505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:29.196505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:29.196505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.196505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:29.196869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.196869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:29.196869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:29.196869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:29.196869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.196869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:29.196869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:29.196869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:29.196869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:29.196869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.196869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:29.197251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:29.197251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:29.197251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.197251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:29.197251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:29.197251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:29.197251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:29.197251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:29.197251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:29.197251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:29.197251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:29.197251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:29.197251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:29.197251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:29.197744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:29.197744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:29.197744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.197744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.197981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:29.198735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:29.199249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:29.199249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:29.199249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.199249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:29.199725 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:29.200072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:29.200247 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:29.200525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:29.200848 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:29.201085 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:29.201187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.201861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:29.201861 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:29.201861 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:29.201861 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:29.201861 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:29.201861 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:29.201861 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.201861 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:29.203222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.203222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:29.203222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:29.203222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:29.203222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.203222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:29.203222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:29.203222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.203222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:29.203222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:29.203222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:29.203222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.203671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:29.203671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:29.203671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:29.203671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:29.203671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:29.203671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:29.203671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:29.203671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:29.203671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:29.203671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:29.203671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:29.203671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:29.203671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:29.204108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.204108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:29.204954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.204954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:29.204954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:29.204954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:29.204954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:29.204954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:29.204954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.204954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:29.204954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:29.204954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.204954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:29.204954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:29.204954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.204954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:29.204954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:29.204954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:29.205582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:29.206072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:29.206072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:29.206072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:33.669588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:33.670535 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:33.670535 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:33.671997 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:33.703811 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:33.704257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:33.705139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:33.705139 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:33.705139 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:33.705139 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:33.705139 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:33.705139 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:33.705139 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:33.705139 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:33.706295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:33.706295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:33.706295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:33.706295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:33.706295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:33.706295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:33.706295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:33.706295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:33.706295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:33.706295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:33.706295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:33.706295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:33.706878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:33.706878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:33.706878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:33.706878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:33.706878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:33.706878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:33.706878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:33.706878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:33.706878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:33.706878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:33.706878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:33.706878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:33.706878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:33.707756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:33.707756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:33.707756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:33.707756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:33.707756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:33.707756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:33.707756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:33.707756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:33.707756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:33.707756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:33.707756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:33.707756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:33.707756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:33.707756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:33.707756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:33.708464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:33.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:33.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:33.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:33.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:33.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:33.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:34.171844 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:34.172518 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:34.172771 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:34.173887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:34.174503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.175763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:34.175763 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:34.175763 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:34.175763 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:34.175763 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:34.175763 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:34.175763 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.175763 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:34.177411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.177411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:34.177411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:34.177411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:34.177411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.177411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:34.177411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:34.177411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.177411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:34.177411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:34.177411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:34.177411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.178175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:34.178175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:34.178175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:34.178175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:34.178175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:34.178175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:34.178175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:34.178175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:34.178175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:34.178175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:34.178175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:34.178175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:34.178175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:34.179080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.179080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:34.179080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.179080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:34.179080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:34.179080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:34.179080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:34.179080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:34.179080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.179080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:34.179080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:34.179080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.179080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:34.179080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:34.179080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:34.180038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:34.181207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:34.181207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:34.181207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:34.181207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:34.181207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.181207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:34.183194 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:34.183584 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:34.183664 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:34.183813 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:21:34.184172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:34.184534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.185208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:34.185208 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:34.185208 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:34.185208 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:34.185208 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:34.185208 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:34.185208 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.185208 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:34.185897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.185897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:34.185897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:34.185897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:34.185897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.185897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:34.185897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:34.185897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:34.185897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.185897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:34.185897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:34.185897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:34.185897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:34.185897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:34.185897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:34.186695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:34.186695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:34.186695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:34.186695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:34.186695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:34.186695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:34.186695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:34.186695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.186695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:34.187227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.187227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:34.187227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:34.187227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:34.187227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.187227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:34.187227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:34.187227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:21:34.187227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:34.187227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:34.187227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.187227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:34.187830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:34.187830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:34.187830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.187830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:34.187830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:34.187830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:34.187830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:34.187830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:34.187830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:34.187830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:34.187830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:34.187830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:34.187830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:34.187830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:34.188502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:34.188502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:34.188502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.188502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:34.188502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.188502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:34.188502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:34.188502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:34.188502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:34.188502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:34.188502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.188502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:34.188502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:34.188502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:34.189187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:34.190098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:34.190098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:34.190098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:34.190098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:34.190098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:34.190098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:34.190098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:34.190098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:34.190098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:34.190098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:34.190098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.190098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:34.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:34.194171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:34.194272 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:34.194428 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:34.194753 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:34.195126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.195877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:34.195877 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:34.195877 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:34.195877 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:34.195877 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:34.195877 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:34.195877 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.195877 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:34.197412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.197412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:34.197412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:34.197412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:34.197412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.197412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:34.197412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:34.197412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:34.197412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.197412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:34.197412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:34.197412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:34.197412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:34.197412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:34.197412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:34.197865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:34.197865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:34.197865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:34.197865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:34.197865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:34.197865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:34.197865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:34.197865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.197865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:34.199149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.199149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:34.199149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:34.199149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:34.199149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.199149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:34.199149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:34.199149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:34.199149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:34.199149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.199149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:34.199507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:34.199507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:34.199507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.199507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:34.199507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:34.199507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:34.199507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:34.199507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:34.199507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:34.199507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:34.199507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:34.199507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:34.199507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:34.199507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:34.199897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:34.199897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:34.199897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.199897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.201532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:34.202004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:34.202755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:34.202755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:34.202755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.202755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:34.202755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:34.202755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:34.202755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:34.202996 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:34.203257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:34.203524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:34.203640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.204335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:34.204335 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:34.204335 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:34.204335 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:34.204335 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:34.204335 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:34.204335 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.204335 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:34.205021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.205021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:34.205021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:34.205021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:34.205021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.205021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:34.205021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:34.205021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.205021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:34.205021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:34.205021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:34.205021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.205439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:34.205439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:34.205439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:34.205439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:34.205439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:34.205439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:34.205439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:34.205439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:34.205439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:34.205439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:34.205439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:34.205439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:34.205439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:34.205837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.205837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:34.205837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.205837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:34.205837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:34.205837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:34.205837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:34.205837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:34.205837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.205837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:34.205837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:34.205837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.205837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:34.205837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:34.205837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:34.206277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:34.206851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:34.206851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:34.206851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:34.206851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:34.206851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:34.206851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:38.670329 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:38.671267 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:38.671267 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:38.672348 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:38.705667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:38.706071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:38.707010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:38.707010 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:38.707010 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:38.707010 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:38.707010 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:38.707010 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:38.707010 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:38.707010 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:38.707860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:38.707860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:38.707860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:38.707860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:38.707860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:38.707860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:38.707860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:38.707860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:38.707860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:38.707860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:38.707860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:38.707860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:38.708293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:38.708293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:38.708293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:38.708293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:38.708293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:38.708293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:38.708293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:38.708293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:38.708293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:38.708293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:38.708293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:38.708293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:38.708293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:38.713683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:38.713683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:38.713683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:38.713683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:38.713683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:38.713683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:38.713683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:38.713683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:38.713683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:38.713683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:38.713683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:38.713683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:38.713683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:38.713683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:38.713683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:38.714104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:38.714566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:38.714566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:38.714566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:38.714566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:38.714566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:38.714566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:39.172540 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:39.173111 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:39.173320 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:39.174197 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:39.174550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.176555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:39.176555 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:39.176555 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:39.176555 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:39.176555 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:39.176555 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:39.176555 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.176555 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:39.177380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.177380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:39.177380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:39.177380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:39.177380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.177380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:39.177380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:39.177380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.177380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:39.177380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:39.177380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:39.177380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.177766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:39.177766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:39.177766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:39.177766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:39.177766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:39.177766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:39.177766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:39.177766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:39.177766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:39.177766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:39.177766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:39.177766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:39.177766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:39.178124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.178124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:39.179769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.179769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:39.179769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:39.179769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:39.179769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:39.179769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:39.179769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.179769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:39.179769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:39.179769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.179769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:39.179769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:39.179769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.179769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:39.179769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:39.179769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:39.180249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:39.180773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:39.180773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.180773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:39.183539 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:39.183956 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:39.184077 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:39.184210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:21:39.184602 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:39.184882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.185573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:39.185573 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:39.185573 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:39.185573 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:39.185573 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:39.185573 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:39.185573 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.185573 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:39.186391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.186391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:39.186391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:39.186391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:39.186391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.186391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:39.186391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:39.186391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:39.186391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.186391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:39.186391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:39.186391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:39.186391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:39.186391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:39.186391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:39.186832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:39.186832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:39.186832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:39.186832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:39.186832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:39.186832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:39.186832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:39.186832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.186832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:39.187461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.187461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:39.187461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:39.187461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:39.187461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.187461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:39.187461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:39.187461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:21:39.187461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:39.187461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:39.187461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.187461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:39.187818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:39.187818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:39.187818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.187818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:39.187818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:39.187818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:39.187818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:39.187818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:39.187818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:39.187818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:39.187818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:39.187818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:39.187818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:39.187818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:39.188194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:39.188194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:39.188194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.188194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:39.188725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.188725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:39.188725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:39.188725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:39.188725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:39.188725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:39.188725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.188725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:39.188725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:39.188725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.188725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:39.188725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:39.188725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.188725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:39.188725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:39.188725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:39.189227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:39.189748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:39.189748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:39.189748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:39.189748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:39.189748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:39.189748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.189748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:39.194329 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:39.194611 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:39.194757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:39.194986 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:39.195481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:39.195789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.196361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:39.196361 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:39.196361 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:39.196361 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:39.196361 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:39.196361 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:39.196361 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.196361 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:39.197253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.197253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:39.197253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:39.197253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:39.197253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.197253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:39.197253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:39.197253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:39.197253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.197253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:39.197253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:39.197253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:39.197253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:39.197253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:39.197253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:39.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:39.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:39.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:39.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:39.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:39.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:39.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:39.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:39.198631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.198631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:39.198631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:39.198631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:39.198631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.198631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:39.198631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:39.198631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:39.198631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:39.198631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.198631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:39.198991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:39.198991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:39.198991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.198991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:39.198991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:39.198991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:39.198991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:39.198991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:39.198991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:39.198991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:39.198991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:39.198991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:39.198991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:39.198991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:39.199439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:39.199439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:39.199439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.199439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.203066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:39.203580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:39.203935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:39.203935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:39.203935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.203935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:39.203935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:39.203935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:39.203935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:39.203935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:39.204110 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:39.204110 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:39.204159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.204912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:39.204912 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:39.204912 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:39.204912 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:39.204912 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:39.204912 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:39.204912 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.204912 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:39.205884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.205884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:39.205884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:39.205884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:39.205884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.205884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:39.205884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:39.205884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.205884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:39.205884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:39.205884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:39.205884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.206156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:39.206156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:39.206156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:39.206156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:39.206156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:39.206156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:39.206156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:39.206156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:39.206156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:39.206156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:39.206156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:39.206156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:39.206156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:39.206392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.206392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:39.207020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.207020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:39.207020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:39.207020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:39.207020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:39.207020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:39.207020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.207020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:39.207020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:39.207020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.207020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:39.207020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:39.207020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.207020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:39.207020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:39.207020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:39.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:39.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:39.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:39.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:43.671661 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:43.672407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:43.672606 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:43.673894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:43.709261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:43.709680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:43.710551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:43.710551 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:43.710551 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:43.710551 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:43.710551 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:43.710551 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:43.710551 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:43.710551 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:43.711658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:43.711658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:43.711658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:43.711658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:43.711658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:43.711658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:43.711658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:43.711658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:43.711658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:43.711658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:43.711658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:43.711658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:43.712214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:43.712214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:43.712214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:43.712214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:43.712214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:43.712214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:43.712214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:43.712214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:43.712214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:43.712214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:43.712214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:43.712214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:43.712214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:43.712883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:43.712883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:43.713001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:43.713001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:43.713001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:43.713001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:43.713001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:43.713001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:43.713001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:43.713001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:43.713001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:43.713001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:43.713001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:43.713001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:43.713001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:43.713001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:43.713001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:43.713001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:43.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:43.714630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:43.714630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:43.714630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:44.173042 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:44.173901 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:44.174099 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:44.174849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:44.175070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:44.175739 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:44.175739 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:44.175739 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:44.175739 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:44.175739 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:44.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:44.177385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.177385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:44.177385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:44.177385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:44.177385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.177385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:44.177385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:44.177385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.177385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:44.177385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:44.177385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:44.177385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.177785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:44.177785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:44.177785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:44.177785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:44.177785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:44.177785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:44.177785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:44.177785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:44.177785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:44.177785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:44.177785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:44.177785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:44.177785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:44.178271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.178271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:44.179853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.179853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:44.179853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:44.179853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:44.179853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:44.179853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:44.179853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.179853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:44.179853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:44.179853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.179853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:44.179853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:44.179853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.179853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:44.179853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:44.179853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:44.180605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:44.181464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:44.181464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.181464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:44.183942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:44.184222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:44.184342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:44.184488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:21:44.184878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:44.185074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.185640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:44.185640 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:44.185640 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:44.185640 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:44.185640 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:44.185640 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:44.185640 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.185640 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:44.186421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.186421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:44.186421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:44.186421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:44.186421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.186421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:44.186421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:44.186421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:44.186421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.186421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:44.186421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:44.186421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:44.186421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:44.186421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:44.186421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:44.186727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:44.186727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:44.186727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:44.186727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:44.186727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:44.186727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:44.186727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:44.186727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.186727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:44.187235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.187235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:44.187235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:44.187235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:44.187235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.187235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:44.187235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:44.187235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:21:44.187235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:44.187235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:44.187235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.187235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:44.187511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:44.187511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:44.187511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.187511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:44.187511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:44.187511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:44.187511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:44.187511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:44.187511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:44.187511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:44.187511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:44.187511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:44.187511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:44.187511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:44.187776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:44.187776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:44.187776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.187776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:44.188250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.188250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:44.188250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:44.188250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:44.188250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:44.188250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:44.188250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.188250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:44.188250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:44.188250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.188250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:44.188250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:44.188250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.188250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:44.188250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:44.188250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:44.188625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:44.188991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:44.188991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:44.188991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:44.188991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:44.188991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:44.188991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.188991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:44.194738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:44.195142 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:44.195275 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:44.195396 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:44.195748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:44.195971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.196512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:44.196512 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:44.196512 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:44.196512 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:44.196512 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:44.196512 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:44.196512 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.196512 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:44.197278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.197278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:44.197278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:44.197278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:44.197278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.197278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:44.197278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:44.197278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:44.197278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.197278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:44.197278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:44.197278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:44.197278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:44.197278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:44.197278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:44.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:44.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:44.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:44.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:44.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:44.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:44.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:44.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.197740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:44.198178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.198178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:44.198178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:44.198178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:44.198178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.198178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:44.198178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:44.198178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:44.198178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:44.198178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.198178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:44.198534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:44.198534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:44.198534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.198534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:44.198534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:44.198534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:44.198534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:44.198534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:44.198534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:44.198534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:44.198534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:44.198534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:44.198534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:44.198534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:44.198929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:44.198929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:44.198929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.198929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.199294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:44.199794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:44.200306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:44.200306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:44.200306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.200306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:44.202650 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:44.202988 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:44.203109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:44.203277 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:44.203800 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:44.204215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:44.204469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.205237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:44.205237 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:44.205237 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:44.205237 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:44.205237 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:44.205237 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:44.205237 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.205237 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:44.206152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.206152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:44.206152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:44.206152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:44.206152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.206152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:44.206152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:44.206152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.206152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:44.206152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:44.206152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:44.206152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.206636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:44.206636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:44.206636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:44.206636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:44.206636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:44.206636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:44.206636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:44.206636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:44.206636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:44.206636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:44.206636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:44.206636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:44.206636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:44.207005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.207005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:44.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:44.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:44.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:44.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:44.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:44.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:44.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:44.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:44.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:44.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:44.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:44.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:44.207646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:44.208167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:44.208167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:44.208167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:48.672330 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:48.673208 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:48.673208 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:48.673508 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:48.708952 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:48.709457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:48.710639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:48.710639 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:48.710639 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:48.710639 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:48.710639 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:48.710639 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:48.710639 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:48.710639 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:48.711691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:48.711691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:48.711691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:48.711691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:48.711691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:48.711691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:48.711691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:48.711691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:48.711691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:48.711691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:48.711691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:48.711691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:48.712948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:48.712948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:48.712948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:48.712948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:48.712948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:48.712948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:48.712948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:48.712948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:48.712948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:48.712948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:48.712948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:48.712948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:48.712948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:48.714202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:48.714202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:48.714202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:48.714202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:48.714202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:48.714202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:48.714202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:48.714202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:48.714202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:48.714202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:48.714202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:48.714202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:48.714202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:48.714202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:48.714202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:48.715605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:48.716495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:48.716495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:48.716495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:48.716495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:48.716495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:48.716495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:49.173746 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:49.174401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:49.174598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:49.175513 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:49.175933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.176963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:49.176963 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:49.176963 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:49.176963 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:49.176963 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:49.176963 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:49.176963 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.176963 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:49.178580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.178580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:49.178580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:49.178580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:49.178580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.178580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:49.178580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:49.178580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.178580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:49.178580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:49.178580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:49.178580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.179137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:49.179137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:49.179137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:49.179137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:49.179137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:49.179137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:49.179137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:49.179137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:49.179137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:49.179137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:49.179137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:49.179137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:49.179137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:49.179711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.179711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:49.180393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.180393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:49.180393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:49.180393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:49.180393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:49.180393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:49.180393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.180393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:49.180393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:49.180393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.180393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:49.180393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:49.180393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.180393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:49.180393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:49.180393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:49.181021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:49.181510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:49.181510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.181510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:49.184455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:49.184801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:49.184915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:49.185029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:21:49.185410 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:49.185649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.186273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:49.186273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:49.186273 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:49.186273 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:49.186273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:49.186273 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:49.186273 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.186273 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:49.187037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.187037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:49.187037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:49.187037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:49.187037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.187037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:49.187037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:49.187037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:49.187037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.187037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:49.187037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:49.187037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:49.187037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:49.187037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:49.187037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:49.187457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:49.187457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:49.187457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:49.187457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:49.187457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:49.187457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:49.187457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:49.187457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.187457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:49.187950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.187950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:49.187950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:49.187950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:49.187950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.187950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:49.187950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:49.187950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:21:49.187950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:49.187950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:49.187950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.187950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:49.188711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:49.188711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:49.188711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.188711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:49.188711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:49.188711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:49.188711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:49.188711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:49.188711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:49.188711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:49.188711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:49.188711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:49.188711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:49.188711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:49.189463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:49.189463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:49.189463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.189463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:49.189463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.189463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:49.189463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:49.189463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:49.189463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:49.189463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:49.189463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.189463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:49.189463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:49.189463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:49.189898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:49.190352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:49.190352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:49.190352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:49.190352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:49.190352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:49.190352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:49.190352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:49.190352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:49.190352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:49.190352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:49.190352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.190352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:49.195260 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:49.195565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:49.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:49.195806 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:49.196330 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:49.196802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.197681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:49.197681 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:49.197681 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:49.197681 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:49.197681 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:49.197681 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:49.197681 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.197681 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:49.198493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.198493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:49.198493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:49.198493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:49.198493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.198493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:49.198493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:49.198493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:49.198493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.198493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:49.198493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:49.198493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:49.198493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:49.198493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:49.198493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:49.198931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:49.198931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:49.198931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:49.198931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:49.198931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:49.198931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:49.198931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:49.198931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.198931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:49.199592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.199592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:49.199592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:49.199592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:49.199592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.199592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:49.199592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:49.199592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:49.199592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:49.199592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.199592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:49.200809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:49.200809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:49.200809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.200809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:49.200809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:49.200809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:49.200809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:49.200809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:49.200809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:49.200809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:49.200809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:49.200809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:49.200809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:49.200809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:49.201590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:49.201590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:49.201590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.201590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:49.201590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.201590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:49.201590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:49.201590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:49.201590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:49.201590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:49.201590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.201590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:49.201590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:49.201590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:49.202239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:49.203026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:49.203026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:49.203026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:49.203026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:49.203026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:49.203026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:49.203026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:49.203026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:49.203026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:49.203026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.203026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:49.204493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:49.204493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:49.204493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:49.204493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:49.204493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:49.204493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:49.205111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.205111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:49.205111 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:49.205111 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:49.205111 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:49.205111 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:49.205111 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:49.205111 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.205111 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:49.206122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.206122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:49.206122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:49.206122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:49.206122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.206122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:49.206122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:49.206122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.206122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:49.206122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:49.206122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:49.206122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.207440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:49.207440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:49.207440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:49.207440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:49.207440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:49.207440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:49.207440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:49.207440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:49.207440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:49.207440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:49.207440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:49.207440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:49.207440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:49.208050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.208050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:49.208050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.208050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:49.208050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:49.208050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:49.208050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:49.208050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:49.208050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.208050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:49.208050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:49.208050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.208050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:49.208050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:49.208050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:49.209633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:49.210822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:49.210822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:49.210822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:49.210822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:49.210822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:49.210822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:53.672988 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:53.673973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:53.673973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:53.675442 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:53.695878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=251 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:21:53.706156 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:53.706587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:53.707375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:53.707375 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:53.707375 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:53.707375 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:53.707375 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:53.707375 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:53.707375 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:53.707375 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:53.708159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:53.708159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:53.708159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:53.708159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:53.708159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:53.708159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:53.708159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:53.708159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:53.708159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:53.708159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:53.708159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:53.708159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:53.708732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:53.708732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:53.708732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:53.708732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:53.708732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:53.708732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:53.708732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:53.708732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:53.708732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:53.708732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:53.708732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:53.708732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:53.708732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:53.709614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:53.709614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:53.709614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:53.709614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:53.709614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:53.709614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:53.709614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:53.709614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:53.709614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:53.709614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:53.709614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:53.709614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:53.709614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:53.709614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:53.709614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:53.710263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:53.710961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:53.710961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:53.710961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:53.710961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:53.710961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:53.710961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:54.174482 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:54.175309 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:54.175569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:54.176388 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:54.176743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.177604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:54.177604 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:54.177604 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:54.177604 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:54.177604 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:54.177604 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:54.177604 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.177604 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:54.179343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.179343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:54.179343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:54.179343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:54.179343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.179343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:54.179343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:54.179343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.179343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:54.179343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:54.179343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:54.179343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.179895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:54.179895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:54.179895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:54.179895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:54.179895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:54.179895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:54.179895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:54.179895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:54.179895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:54.179895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:54.179895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:54.179895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:54.179895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:54.180492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.180492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:54.181412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.181412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:54.181412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:54.181412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:54.181412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:54.181412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:54.181412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.181412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:54.181412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:54.181412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.181412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:54.181412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:54.181412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.181412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:54.181412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:54.181412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:54.182063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:54.182871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:54.182871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.182871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:54.184945 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:54.185317 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:54.185603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:54.185834 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:21:54.186285 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:54.186621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.187309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:54.187309 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:54.187309 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:54.187309 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:54.187309 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:54.187309 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:54.187309 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.187309 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:54.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:54.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:54.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:54.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:54.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:54.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:54.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:54.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:54.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:54.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:54.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:54.188266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:54.188804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:54.188804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:54.188804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:54.188804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:54.188804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:54.188804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:54.188804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:54.188804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.188804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:54.189445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.189445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:54.189445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:54.189445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:54.189445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.189445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:54.189445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:54.189445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:21:54.189445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:54.189445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:54.189445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.189445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:54.189772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:54.189772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:54.189772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.189772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:54.189772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:54.189772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:54.189772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:54.189772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:54.189772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:54.189772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:54.189772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:54.189772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:54.189772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:54.189772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:54.190134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:54.190134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:54.190134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.190134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:54.190768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.190768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:54.190768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:54.190768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:54.190768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:54.190768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:54.190768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.190768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:54.190768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:54.190768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.190768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:54.190768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:54.190768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.190768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:54.190768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:54.190768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:54.191196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:54.191836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:54.191836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:54.191836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:54.191836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:54.191836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:54.191836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.191836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:54.195614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:54.195962 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:54.196105 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:54.196268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:54.196726 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:54.197063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.197769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:54.197769 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:54.197769 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:54.197769 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:54.197769 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:54.197769 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:54.197769 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.197769 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:54.198620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.198620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:54.198620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:54.198620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:54.198620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.198620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:54.198620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:54.198620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:54.198620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.198620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:54.198620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:54.198620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:54.198620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:54.198620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:54.198620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:54.199028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:54.199028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:54.199028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:54.199028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:54.199028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:54.199028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:54.199028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:54.199028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.199028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:54.199920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.199920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:54.199920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:54.199920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:54.199920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.199920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:54.199920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:54.199920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:54.199920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:54.199920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.199920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:54.200235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:54.200235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:54.200235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.200235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:54.200235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:54.200235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:54.200235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:54.200235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:54.200235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:54.200235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:54.200235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:54.200235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:54.200235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:54.200235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:54.200621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:54.200621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:54.200621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.200621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.201581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:54.202040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:54.202529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:54.202529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:54.202529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.202529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:54.203573 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:54.203891 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:54.204027 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:54.204220 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:54.204663 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:54.205033 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:54.205207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.205902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:54.205902 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:54.205902 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:54.205902 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:54.205902 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:54.205902 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:54.205902 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.205902 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:54.206940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.206940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:54.206940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:54.206940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:54.206940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.206940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:54.206940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:54.206940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.206940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:54.206940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:54.206940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:54.206940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.207291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:54.207291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:54.207291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:54.207291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:54.207291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:54.207291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:54.207291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:54.207291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:54.207291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:54.207291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:54.207291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:54.207291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:54.207291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:54.207673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.207673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:54.207737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.207737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:54.207737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:54.207737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:54.207737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:54.207737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:54.207737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.207737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:54.207737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:54.207737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.207737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:54.207737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:54.207737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.207737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:54.207737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:54.207737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:54.208152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:54.208810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:54.208810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:54.208810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:58.673689 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:58.677425 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:58.677425 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:58.677425 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:58.710847 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:58.711300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:58.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:58.712492 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:58.712492 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:58.712492 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:58.712492 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:58.712492 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:58.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:58.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:58.713132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:58.713132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:58.713132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:58.713132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:58.713132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:58.713132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:58.713132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:58.713132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:58.713132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:58.713132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:58.713132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:58.713132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:58.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:58.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:58.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:58.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:58.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:58.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:58.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:58.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:58.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:58.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:58.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:58.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:58.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:58.714714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:58.714714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:58.714714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:58.714714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:58.714714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:58.714714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:58.714714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:58.714714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:58.714714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:58.714714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:58.714714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:58.714714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:58.714714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:58.714714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:58.714714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:58.715405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:58.716224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:58.716224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:58.716224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:58.716224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:58.716224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:58.716224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:59.175196 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:59.175898 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:59.176139 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:59.177135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:59.178279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.179936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:59.179936 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:59.179936 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:59.179936 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:59.179936 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:59.179936 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:59.179936 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.179936 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:59.181409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.181409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:59.181409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:59.181409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:59.181409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.181409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:59.181409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:59.181409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.181409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:59.181409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:59.181409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:59.181409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.182299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:59.182299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:59.182299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:59.182299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:59.182299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:59.182299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:59.182299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:59.182299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:59.182299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:59.182299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:59.182299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:59.182299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:59.182299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:59.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:59.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:59.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:59.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:59.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:59.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:59.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:59.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:59.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:59.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:59.183464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:59.184662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:59.186246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:59.186246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:59.186246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:59.186246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:59.186246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.186246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:59.186246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:59.186246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:59.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:59.187259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:21:59.187521 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:59.187871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.188964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:59.188964 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:59.188964 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:59.188964 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:59.188964 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:59.188964 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:59.188964 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.188964 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:59.190044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.190044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:59.190044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:59.190044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:59.190044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.190044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:59.190044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:59.190044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:59.190044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.190044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:59.190044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:59.190044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:59.190044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:59.190044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:59.190044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:59.190400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:59.190400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:59.190400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:59.190400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:59.190400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:59.190400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:59.190400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:59.190400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.190400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:59.190991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.190991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:59.190991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:59.190991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:59.190991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.190991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:59.190991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:59.190991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:21:59.190991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:59.190991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:59.190991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.190991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:59.191267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:59.191267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:59.191267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.191267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:59.191267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:59.191267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:59.191267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:59.191267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:59.191267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:59.191267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:59.191267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:59.191267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:59.191267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:59.191267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:59.191559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:59.191559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:59.191559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.191559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:59.192077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.192077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:59.192077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:59.192077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:59.192077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:59.192077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:59.192077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.192077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:59.192077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:59.192077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.192077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:59.192077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:59.192077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.192077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:59.192077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:59.192077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:59.192530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:59.193093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:59.193093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:59.193093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:59.193093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:59.193093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:59.193093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.193093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:59.196009 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:59.196334 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:59.196496 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:59.196640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:59.196968 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:59.197195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.197805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:59.197805 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:59.197805 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:59.197805 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:59.197805 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:59.197805 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:59.197805 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.197805 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:59.198647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.198647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:21:59.198647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:59.198647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:59.198647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.198647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:59.198647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:59.198647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:59.198647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.198647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:21:59.198647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:59.198647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:21:59.198647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:59.198647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:21:59.198647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:21:59.199222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:59.199222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:21:59.199222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:59.199222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:21:59.199222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:21:59.199222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:59.199222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:21:59.199222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.199222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:21:59.199698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.199698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:59.199698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:59.199698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:59.199698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.199698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:59.199698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:59.199698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:59.199698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:59.199698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.199698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:59.200360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:59.200360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:59.200360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.200360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:59.200360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:59.200360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:59.200360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:59.200360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:59.200360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:59.200360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:59.200360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:59.200360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:59.200360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:59.200360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:59.200807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:59.200807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:59.200807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.200807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:59.200807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.200807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:59.200807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:59.200807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:59.200807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:59.200807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:59.200807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.200807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:59.200807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:59.200807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:59.201088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:59.201545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:59.201545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:59.201545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:59.201545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:59.201545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:59.201545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:59.201545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:59.201545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:59.201545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:59.201545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.201545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:21:59.203941 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:21:59.204250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:21:59.204352 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:21:59.204555 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:21:59.204860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:59.205091 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:21:59.205211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.205811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:21:59.205811 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:59.205811 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:21:59.205811 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:21:59.205811 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:59.205811 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:21:59.205811 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.205811 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:21:59.206802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.206802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:21:59.206802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:59.206802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:21:59.206802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.206802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:59.206802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:59.206802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.206802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:59.206802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:59.206802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:59.206802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.207199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:21:59.207199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:59.207199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:21:59.207199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:59.207199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:21:59.207199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:21:59.207199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:59.207199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:21:59.207199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:59.207199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:21:59.207199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:21:59.207199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:59.207199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:21:59.207562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.207562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:21:59.207976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.207976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:21:59.207976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:21:59.207976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:21:59.207976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:21:59.207976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:21:59.207976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.207976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:21:59.207976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:21:59.207976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.207976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:21:59.207976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:21:59.207976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.207976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:21:59.207976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:21:59.207976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:21:59.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:21:59.209133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:21:59.209133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:21:59.209133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:03.675040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:03.675534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:03.675754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:03.676971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:03.708832 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:03.709213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:03.709923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:03.709923 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:03.709923 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:03.709923 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:03.709923 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:03.709923 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:03.709923 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:03.709923 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:03.710620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:03.710620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:03.710620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:03.710620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:03.710620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:03.710620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:03.710620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:03.710620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:03.710620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:03.710620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:03.710620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:03.710620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:03.711333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:03.711333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:03.711333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:03.711333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:03.711333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:03.711333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:03.711333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:03.711333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:03.711333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:03.711333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:03.711333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:03.711333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:03.711333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:03.712079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:03.712079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:03.712079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:03.712079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:03.712079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:03.712079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:03.712079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:03.712079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:03.712079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:03.712079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:03.712079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:03.712079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:03.712079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:03.712079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:03.712079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:03.712956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:03.714047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:03.714047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:03.714047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:03.714047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:03.714047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:03.714047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:04.176051 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:04.176533 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:04.176642 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:04.177259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:04.177544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.178194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:04.178194 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:04.178194 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:04.178194 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:04.178194 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:04.178194 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:04.178194 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.178194 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:04.179358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.179358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:04.179358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:04.179358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:04.179358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.179358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:04.179358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:04.179358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.179358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:04.179358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:04.179358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:04.179358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.179988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:04.179988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:04.179988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:04.179988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:04.179988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:04.179988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:04.179988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:04.179988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:04.179988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:04.179988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:04.179988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:04.179988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:04.179988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:04.180634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.180634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:04.180634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.180634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:04.180634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:04.180634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:04.180634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:04.180634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:04.180634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.180634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:04.180634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:04.180634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.180634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:04.180634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:04.180634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:04.181389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:04.182298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:04.182298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:04.182298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:04.182298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:04.182298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.182298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:04.186135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:04.186618 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:04.186853 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:04.187105 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:22:04.187757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:04.188093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.188969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:04.188969 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:04.188969 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:04.188969 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:04.188969 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:04.188969 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:04.188969 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.188969 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:04.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:04.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:04.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:04.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:04.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:04.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:04.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:04.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:04.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:04.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:04.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:04.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:04.190889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:04.190889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:04.190889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:04.190889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:04.190889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:04.190889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:04.190889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:04.190889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.190889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:04.192059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.192059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:04.192059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:04.192059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:04.192059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.192059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:04.192059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:04.192059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:22:04.192059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:04.192059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:04.192059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.192059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:04.192401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:04.192401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:04.192401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.192401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:04.192401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:04.192401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:04.192401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:04.192401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:04.192401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:04.192401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:04.192401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:04.192401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:04.192401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:04.192401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:04.192773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:04.192773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:04.192773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.192773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:04.193844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.193844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:04.193844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:04.193844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:04.193844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:04.193844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:04.193844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.193844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:04.193844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:04.193844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.193844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:04.193844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:04.193844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.193844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:04.193844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:04.193844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:04.194277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:04.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:04.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:04.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:04.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:04.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:04.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:04.196536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:04.196843 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:04.196960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:04.197087 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:04.197537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:04.197961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.198786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:04.198786 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:04.198786 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:04.198786 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:04.198786 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:04.198786 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:04.198786 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.198786 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:04.199641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.199641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:04.199641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:04.199641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:04.199641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.199641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:04.199641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:04.199641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:04.199641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.199641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:04.199641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:04.199641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:04.199641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:04.199641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:04.199641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:04.200060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:04.200060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:04.200060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:04.200060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:04.200060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:04.200060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:04.200060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:04.200060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.200060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:04.200610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.200610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:04.200610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:04.200610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:04.200610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.200610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:04.200610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:04.200610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:04.200610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:04.200610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.200610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:04.200930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:04.200930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:04.200930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.200930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:04.200930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:04.200930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:04.200930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:04.200930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:04.200930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:04.200930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:04.200930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:04.200930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:04.200930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:04.200930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:04.201381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:04.201381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:04.201381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.201381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.201757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:04.202192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:04.202731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:04.202731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:04.202731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.202731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:04.204434 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:04.204749 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:04.204861 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:04.205017 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:04.205500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:04.205895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:04.206095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.206870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:04.206870 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:04.206870 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:04.206870 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:04.206870 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:04.206870 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:04.206870 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.206870 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:04.207771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.207771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:04.207771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:04.207771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:04.207771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.207771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:04.207771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:04.207771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.207771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:04.207771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:04.207771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:04.207771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.208110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:04.208110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:04.208110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:04.208110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:04.208110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:04.208110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:04.208110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:04.208110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:04.208110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:04.208110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:04.208110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:04.208110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:04.208110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:04.208469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.208469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:04.208735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.208735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:04.208735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:04.208735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:04.208735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:04.208735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:04.208735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.208735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:04.208735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:04.208735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.208735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:04.208735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:04.208735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.208735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:04.208735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:04.208735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:04.209168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:04.209811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:04.209811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:04.209811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:08.675729 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:08.676566 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:08.676566 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:08.677694 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:08.708910 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:08.709226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:08.709971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:08.709971 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:08.709971 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:08.709971 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:08.709971 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:08.709971 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:08.709971 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:08.709971 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:08.710740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:08.710740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:08.710740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:08.710740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:08.710740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:08.710740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:08.710740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:08.710740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:08.710740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:08.710740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:08.710740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:08.710740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:08.711601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:08.711601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:08.711601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:08.711601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:08.711601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:08.711601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:08.711601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:08.711601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:08.711601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:08.711601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:08.711601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:08.711601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:08.711601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:08.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:08.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:08.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:08.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:08.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:08.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:08.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:08.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:08.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:08.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:08.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:08.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:08.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:08.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:08.712492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:08.713467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:08.714791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:08.714791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:08.714791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:08.714791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:08.714791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:08.714791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:09.176656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:09.177220 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:09.177392 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:09.178577 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:09.178754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.180555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:09.180555 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:09.180555 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:09.180555 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:09.180555 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:09.180555 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:09.180555 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.180555 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:09.180996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.180996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:09.180996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:09.180996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:09.180996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.180996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:09.180996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:09.180996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.180996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:09.180996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:09.180996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:09.180996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.181660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:09.181660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:09.181660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:09.181660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:09.181660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:09.181660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:09.181660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:09.181660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:09.181660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:09.181660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:09.181660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:09.181660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:09.181660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:09.182321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.182321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:09.182321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.182321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:09.182321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:09.182321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:09.182321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:09.182321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:09.182321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.182321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:09.182321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:09.182321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.182321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:09.182321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:09.182321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:09.183191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:09.184070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:09.184070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:09.184070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:09.184070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:09.184070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.184070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:09.186680 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:09.187084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:09.187207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:09.187389 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:22:09.188787 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:09.188787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.188913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:09.188913 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:09.188913 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:09.188913 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:09.188913 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:09.188913 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:09.188913 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.188913 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:09.189891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.189891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:09.189891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:09.189891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:09.189891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.189891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:09.189891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:09.189891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:09.189891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.189891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:09.189891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:09.189891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:09.189891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:09.189891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:09.189891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:09.190457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:09.190457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:09.190457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:09.190457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:09.190457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:09.190457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:09.190457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:09.190457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.190457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:09.190992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.190992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:09.190992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:09.190992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:09.190992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.190992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:09.190992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:09.190992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:22:09.190992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:09.190992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:09.190992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.190992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:09.191358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:09.191358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:09.191358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.191358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:09.191358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:09.191358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:09.191358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:09.191358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:09.191358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:09.191358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:09.191358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:09.191358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:09.191358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:09.191358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:09.191833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:09.191833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:09.191833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.191833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:09.192321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.192321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:09.192321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:09.192321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:09.192321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:09.192321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:09.192321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.192321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:09.192321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:09.192321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.192321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:09.192321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:09.192321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.192321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:09.192321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:09.192321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:09.192862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:09.193483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:09.193483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:09.193483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:09.193483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:09.193483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:09.193483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.193483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:09.196881 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:09.197123 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:09.197251 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:09.197465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:09.198500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:09.198500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.198697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:09.198697 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:09.198697 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:09.198697 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:09.198697 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:09.198697 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:09.198697 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.198697 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:09.199586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.199586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:09.199586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:09.199586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:09.199586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.199586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:09.199586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:09.199586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:09.199586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.199586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:09.199586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:09.199586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:09.199586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:09.199586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:09.199586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:09.200315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:09.200315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:09.200315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:09.200315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:09.200315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:09.200315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:09.200315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:09.200315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.200315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:09.200801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.200801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:09.200801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:09.200801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:09.200801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.200801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:09.200801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:09.200801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:09.200801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:09.200801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.200801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:09.201726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:09.201726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:09.201726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.201726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:09.201726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:09.201726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:09.201726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:09.201726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:09.201726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:09.201726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:09.201726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:09.201726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:09.201726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:09.201726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:09.202817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:09.202817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:09.202817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.202817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:09.202817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.202817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:09.202817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:09.202817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:09.202817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:09.202817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:09.202817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.202817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:09.202817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:09.202817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:09.203486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:09.204009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:09.204009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:09.204009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:09.204009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:09.204009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:09.204009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:09.204009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:09.204009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:09.204009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:09.204009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.204009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:09.204896 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:09.205147 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:09.205272 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:09.205498 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:09.205804 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:09.206028 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:09.206147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.206721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:09.206721 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:09.206721 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:09.206721 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:09.206721 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:09.206721 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:09.206721 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.206721 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:09.207598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.207598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:09.207598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:09.207598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:09.207598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.207598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:09.207598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:09.207598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.207598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:09.207598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:09.207598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:09.207598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.207934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:09.207934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:09.207934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:09.207934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:09.207934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:09.207934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:09.207934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:09.207934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:09.207934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:09.207934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:09.207934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:09.207934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:09.207934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:09.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:09.208820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.208820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:09.208820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:09.208820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:09.208820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:09.208820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:09.208820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.208820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:09.208820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:09.208820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.208820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:09.208820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:09.208820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.208820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:09.208820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:09.208820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:09.209420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:09.210058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:09.210058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:09.210058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:13.676542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:13.679901 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:13.679901 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:13.679901 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:13.714950 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:13.715173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:13.716518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:13.716518 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:13.716518 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:13.716518 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:13.716518 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:13.716518 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:13.716518 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:13.716518 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:13.717028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:13.717028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:13.717028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:13.717028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:13.717028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:13.717028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:13.717028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:13.717028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:13.717028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:13.717028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:13.717028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:13.717028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:13.717615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:13.717615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:13.717615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:13.717615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:13.717615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:13.717615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:13.717615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:13.717615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:13.717615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:13.717615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:13.717615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:13.717615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:13.717615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:13.718146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:13.718146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:13.718146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:13.718146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:13.718146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:13.718146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:13.718146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:13.718146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:13.718146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:13.718146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:13.718146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:13.718146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:13.718146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:13.718146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:13.718146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:13.718827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:13.719732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:13.719732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:13.719732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:13.719732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:13.719732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:13.719732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:14.177353 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:14.178014 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:14.178241 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:14.179570 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:14.179911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.180821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:14.180821 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:14.180821 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:14.180821 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:14.180821 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:14.180821 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:14.180821 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.180821 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:14.182386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.182386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:14.182386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:14.182386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:14.182386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.182386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:14.182386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:14.182386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.182386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:14.182386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:14.182386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:14.182386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.183529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:14.183529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:14.183529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:14.183529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:14.183529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:14.183529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:14.183529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:14.183529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:14.183529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:14.183529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:14.183529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:14.183529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:14.183529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:14.184702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.184702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:14.184702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.184702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:14.184702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:14.184702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:14.184702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:14.184702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:14.184702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.184702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:14.184702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:14.184702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.184702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:14.184702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:14.184702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:14.186150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:14.187265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:14.187265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:14.187265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:14.187265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:14.187265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.187265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:14.187265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:14.187677 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:14.187856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:14.188131 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:22:14.188763 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:14.189079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.189882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:14.189882 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:14.189882 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:14.189882 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:14.189882 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:14.189882 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:14.189882 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.189882 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:14.190910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.190910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:14.190910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:14.190910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:14.190910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.190910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:14.190910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:14.190910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:14.190910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.190910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:14.190910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:14.190910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:14.190910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:14.190910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:14.190910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:14.191748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:14.191748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:14.191748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:14.191748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:14.191748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:14.191748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:14.191748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:14.191748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.191748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:14.191986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.191986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:14.191986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:14.191986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:14.191986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.191986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:14.191986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:14.191986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:22:14.191986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:14.191986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:14.191986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.191986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:14.192333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:14.192333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:14.192333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.192333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:14.192333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:14.192333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:14.192333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:14.192333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:14.192333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:14.192333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:14.192333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:14.192333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:14.192333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:14.192333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:14.192748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:14.192748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:14.192748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.192748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:14.193029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.193029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:14.193029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:14.193029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:14.193029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:14.193029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:14.193029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.193029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:14.193029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:14.193029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.193029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:14.193029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:14.193029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.193029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:14.193029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:14.193029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:14.194334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:14.195186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:14.195186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:14.195186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:14.195186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:14.195186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:14.195186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.195186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:14.197208 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:14.197504 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:14.197617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:14.197755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:14.198531 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:14.199615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.200506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:14.200506 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:14.200506 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:14.200506 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:14.200506 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:14.200506 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:14.200506 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.200506 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:14.201810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.201810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:14.201810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:14.201810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:14.201810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.201810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:14.201810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:14.201810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:14.201810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.201810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:14.201810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:14.201810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:14.201810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:14.201810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:14.201810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:14.202445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:14.202445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:14.202445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:14.202445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:14.202445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:14.202445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:14.202445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:14.202445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.202445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:14.203360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.203360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:14.203360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:14.203360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:14.203360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.203360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:14.203360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:14.203360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:14.203360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:14.203360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.203360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:14.203680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:14.203680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:14.203680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.203680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:14.203680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:14.203680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:14.203680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:14.203680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:14.203680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:14.203680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:14.203680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:14.203680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:14.203680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:14.203680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:14.204018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:14.204018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:14.204018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.204018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.204549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:14.204992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:14.205493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:14.205493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:14.205493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.205493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:14.205493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:14.205493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:14.205684 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:14.205684 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:14.206106 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:14.206599 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:14.206599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.206892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:14.206892 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:14.206892 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:14.206892 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:14.206892 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:14.206892 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:14.206892 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.206892 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:14.207725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.207725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:14.207725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:14.207725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:14.207725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.207725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:14.207725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:14.207725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.207725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:14.207725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:14.207725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:14.207725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.208500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:14.208500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:14.208500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:14.208500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:14.208500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:14.208500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:14.208500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:14.208500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:14.208500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:14.208500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:14.208500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:14.208500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:14.208500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:14.209026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.209026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:14.209026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.209026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:14.209026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:14.209026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:14.209026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:14.209026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:14.209026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.209026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:14.209026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:14.209026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.209026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:14.209026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:14.209026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:14.209444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:14.209939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:14.209939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:14.209939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:14.209939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:14.209939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:14.209939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:18.708473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:18.709125 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:18.709125 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:18.711132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:18.744345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:18.744804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:18.745770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:18.745770 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:18.745770 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:18.745770 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:18.745770 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:18.745770 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:18.745770 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:18.745770 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:18.746595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:18.746595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:18.746595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:18.746595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:18.746595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:18.746595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:18.746595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:18.746595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:18.746595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:18.746595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:18.746595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:18.746595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:18.747155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:18.747155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:18.747155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:18.747155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:18.747155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:18.747155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:18.747155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:18.747155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:18.747155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:18.747155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:18.747155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:18.747155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:18.747155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:18.747745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:18.747745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:18.747745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:18.747745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:18.747745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:18.747745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:18.747745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:18.747745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:18.747745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:18.747745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:18.747745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:18.747745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:18.747745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:18.747745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:18.747745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:18.748420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:18.749191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:18.749191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:18.749191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:18.749191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:18.749191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:18.749191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:19.178003 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:19.178583 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:19.178583 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:19.179605 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:19.179921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.181589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:19.181589 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:19.181589 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:19.181589 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:19.181589 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:19.181589 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:19.181589 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.181589 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:19.182717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.182717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:19.182717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:19.182717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:19.182717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.182717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:19.182717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:19.182717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.182717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:19.182717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:19.182717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:19.182717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.183042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:19.183042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:19.183042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:19.183042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:19.183042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:19.183042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:19.183042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:19.183042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:19.183042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:19.183042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:19.183042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:19.183042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:19.183042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:19.183388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.183388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:19.185486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.185486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:19.185486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:19.185486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:19.185486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:19.185486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:19.185486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.185486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:19.185486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:19.185486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.185486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:19.185486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:19.185486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.185486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:19.185486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:19.185486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:19.186588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:19.187063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:19.187063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.187063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:19.188135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:19.188338 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:19.188473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:19.188658 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:22:19.189257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:19.189619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.190456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:19.190456 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:19.190456 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:19.190456 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:19.190456 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:19.190456 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:19.190456 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.190456 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:19.191240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.191240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:19.191240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:19.191240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:19.191240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.191240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:19.191240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:19.191240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:19.191240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.191240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:19.191240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:19.191240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:19.191240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:19.191240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:19.191240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:19.191552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:19.191552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:19.191552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:19.191552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:19.191552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:19.191552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:19.191552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:19.191552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.191552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:19.191960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.191960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:19.191960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:19.191960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:19.191960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.191960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:19.191960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:19.191960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:22:19.191960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:19.191960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:19.191960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.191960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:19.192656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:19.192656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:19.192656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.192656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:19.192656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:19.192656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:19.192656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:19.192656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:19.192656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:19.192656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:19.192656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:19.192656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:19.192656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:19.192656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:19.193139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:19.193139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:19.193139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.193139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:19.193139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.193139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:19.193139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:19.193139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:19.193139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:19.193139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:19.193139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.193139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:19.193139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:19.193139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:19.193402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:19.193724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:19.193724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:19.193724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:19.193724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:19.193724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:19.193724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:19.193724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:19.193724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:19.193724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:19.193724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:19.193724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.193724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:19.197516 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:19.197798 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:19.197880 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:19.197977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:19.198513 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:19.198880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.199627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:19.199627 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:19.199627 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:19.199627 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:19.199627 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:19.199627 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:19.199627 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.199627 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:19.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:19.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:19.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:19.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:19.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:19.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:19.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:19.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:19.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:19.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:19.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:19.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:19.200556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:19.200556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:19.200556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:19.200556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:19.200556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:19.200556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:19.200556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:19.200556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.200556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:19.201156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.201156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:19.201156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:19.201156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:19.201156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.201156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:19.201156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:19.201156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:19.201156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:19.201156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.201156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:19.201490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:19.201490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:19.201490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.201490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:19.201490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:19.201490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:19.201490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:19.201490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:19.201490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:19.201490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:19.201490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:19.201490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:19.201490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:19.201490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:19.201858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:19.201858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:19.201858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.201858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.202257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:19.202790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:19.203294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:19.203294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:19.203294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.203294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:19.205484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:19.205685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:19.205798 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:19.205957 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:19.206293 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:19.206642 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:19.206765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.207202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:19.207202 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:19.207202 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:19.207202 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:19.207202 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:19.207202 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:19.207202 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.207202 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:19.208016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.208016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:19.208016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:19.208016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:19.208016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.208016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:19.208016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:19.208016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.208016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:19.208016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:19.208016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:19.208016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.208342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:19.208342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:19.208342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:19.208342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:19.208342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:19.208342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:19.208342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:19.208342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:19.208342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:19.208342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:19.208342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:19.208342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:19.208342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:19.208711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.208711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:19.208977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.208977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:19.208977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:19.208977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:19.208977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:19.208977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:19.208977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.208977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:19.208977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:19.208977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.208977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:19.208977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:19.208977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.208977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:19.208977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:19.208977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:19.209407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:19.209905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:19.209905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:19.209905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:23.708721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:23.709668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:23.709868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:23.711581 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:23.749320 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:23.749320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:23.749626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:23.749626 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:23.749626 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:23.749626 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:23.749626 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:23.749626 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:23.749626 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:23.749626 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:23.750777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:23.750777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:23.750777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:23.750777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:23.750777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:23.750777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:23.750777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:23.750777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:23.750777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:23.750777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:23.750777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:23.750777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:23.751567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:23.751567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:23.751567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:23.751567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:23.751567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:23.751567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:23.751567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:23.751567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:23.751567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:23.751567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:23.751567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:23.751567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:23.751567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:23.752188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:23.752188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:23.752188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:23.752188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:23.752188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:23.752188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:23.752188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:23.752188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:23.752188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:23.752188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:23.752188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:23.752188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:23.752188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:23.752188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:23.752188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:23.753109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:23.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:23.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:23.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:23.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:23.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:23.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:24.179186 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:24.179752 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:24.179988 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:24.182311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:24.182311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.182724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:24.182724 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:24.182724 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:24.182724 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:24.182724 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:24.182724 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:24.182724 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.182724 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:24.184727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.184727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:24.184727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:24.184727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:24.184727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.184727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:24.184727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:24.184727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.184727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:24.184727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:24.184727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:24.184727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.185326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:24.185326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:24.185326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:24.185326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:24.185326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:24.185326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:24.185326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:24.185326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:24.185326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:24.185326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:24.185326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:24.185326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:24.185326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:24.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.185946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:24.186675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.186675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:24.186675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:24.186675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:24.186675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:24.186675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:24.186675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.186675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:24.186675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:24.186675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.186675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:24.186675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:24.186675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.186675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:24.186675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:24.186675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:24.187468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:24.188328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:24.188328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.188328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:24.188519 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:24.188709 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:24.188802 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:24.188908 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:22:24.189487 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:24.189826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.190638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:24.190638 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:24.190638 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:24.190638 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:24.190638 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:24.190638 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:24.190638 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.190638 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:24.191533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.191533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:24.191533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:24.191533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:24.191533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.191533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:24.191533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:24.191533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:24.191533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.191533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:24.191533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:24.191533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:24.191533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:24.191533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:24.191533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:24.191948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:24.191948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:24.191948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:24.191948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:24.191948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:24.191948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:24.191948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:24.191948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.191948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:24.192403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.192403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:24.192403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:24.192403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:24.192403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.192403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:24.192403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:24.192403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:22:24.192403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:24.192403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:24.192403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.192403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:24.192708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:24.192708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:24.192708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.192708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:24.192708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:24.192708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:24.192708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:24.192708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:24.192708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:24.192708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:24.192708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:24.192708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:24.192708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:24.192708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:24.193081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:24.193081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:24.193081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.193081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:24.193545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.193545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:24.193545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:24.193545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:24.193545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:24.193545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:24.193545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.193545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:24.193545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:24.193545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.193545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:24.193545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:24.193545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.193545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:24.193545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:24.193545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:24.193986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:24.194449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:24.194449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:24.194449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:24.194449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:24.194449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:24.194449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.194449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:24.197935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:24.198117 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:24.198224 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:24.198352 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:24.199052 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:24.199492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.200319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:24.200319 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:24.200319 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:24.200319 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:24.200319 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:24.200319 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:24.200319 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.200319 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:24.201119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.201119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:24.201119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:24.201119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:24.201119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.201119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:24.201119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:24.201119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:24.201119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.201119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:24.201119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:24.201119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:24.201119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:24.201119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:24.201119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:24.201512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:24.201512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:24.201512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:24.201512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:24.201512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:24.201512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:24.201512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:24.201512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.201512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:24.202027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.202027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:24.202027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:24.202027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:24.202027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.202027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:24.202027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:24.202027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:24.202027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:24.202027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.202027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:24.202324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:24.202324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:24.202324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.202324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:24.202324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:24.202324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:24.202324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:24.202324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:24.202324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:24.202324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:24.202324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:24.202324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:24.202324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:24.202324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:24.202699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:24.202699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:24.202699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.202699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.203201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:24.203771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:24.204429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:24.204429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:24.204429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.204429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:24.205784 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:24.205972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:24.206083 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:24.206282 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:24.206728 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:24.207031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:24.207173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.207966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:24.207966 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:24.207966 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:24.207966 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:24.207966 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:24.207966 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:24.207966 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.207966 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:24.208867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.208867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:24.208867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:24.208867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:24.208867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.208867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:24.208867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:24.208867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.208867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:24.208867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:24.208867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:24.208867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.209224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:24.209224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:24.209224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:24.209224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:24.209224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:24.209224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:24.209224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:24.209224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:24.209224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:24.209224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:24.209224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:24.209224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:24.209224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:24.209563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.209563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:24.209817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.209817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:24.209817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:24.209817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:24.209817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:24.209817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:24.209817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.209817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:24.209817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:24.209817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.209817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:24.209817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:24.209817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.209817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:24.209817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:24.209817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:24.210229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:24.210789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:24.210789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:24.210789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:28.709432 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:28.710461 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:28.710461 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:28.711578 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:28.749052 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:28.749674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:28.751019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:28.751019 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:28.751019 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:28.751019 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:28.751019 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:28.751019 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:28.751019 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:28.751019 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:28.751904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:28.751904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:28.751904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:28.751904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:28.751904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:28.751904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:28.751904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:28.751904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:28.751904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:28.751904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:28.751904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:28.751904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:28.752770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:28.752770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:28.752770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:28.752770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:28.752770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:28.752770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:28.752770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:28.752770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:28.752770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:28.752770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:28.752770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:28.752770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:28.752770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:28.753418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:28.753418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:28.753418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:28.753418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:28.753418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:28.753418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:28.753418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:28.753418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:28.753418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:28.753418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:28.753418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:28.753418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:28.753418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:28.753418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:28.753418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:28.754112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:28.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:28.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:28.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:28.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:28.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:28.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:29.180046 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:29.180544 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:29.180789 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:29.181888 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:29.182227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.183119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:29.183119 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:29.183119 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:29.183119 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:29.183119 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:29.183119 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:29.183119 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.183119 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:29.184975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.184975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:29.184975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:29.184975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:29.184975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.184975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:29.184975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:29.184975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.184975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:29.184975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:29.184975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:29.184975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.185813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:29.185813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:29.185813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:29.185813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:29.185813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:29.185813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:29.185813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:29.185813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:29.185813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:29.185813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:29.185813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:29.185813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:29.185813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:29.186540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.186540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:29.186985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.186985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:29.186985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:29.186985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:29.186985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:29.186985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:29.186985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.186985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:29.186985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:29.186985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.186985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:29.186985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:29.186985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.186985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:29.186985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:29.186985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:29.187879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:29.188579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:29.188579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.188579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:29.188843 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:29.189270 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:29.189598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:29.189778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:22:29.190405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:29.190885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.191693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:29.191693 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:29.191693 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:29.191693 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:29.191693 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:29.191693 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:29.191693 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.191693 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:29.192610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.192610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:29.192610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:29.192610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:29.192610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.192610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:29.192610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:29.192610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:29.192610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.192610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:29.192610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:29.192610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:29.192610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:29.192610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:29.192610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:29.193414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:29.193414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:29.193414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:29.193414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:29.193414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:29.193414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:29.193414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:29.193414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.193414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:29.194015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.194015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:29.194015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:29.194015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:29.194015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.194015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:29.194015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:29.194015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:22:29.194015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:29.194015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:29.194015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.194015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:29.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:29.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:29.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:29.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:29.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:29.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:29.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:29.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:29.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:29.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:29.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:29.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:29.194749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:29.195513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:29.195513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:29.195513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.195513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:29.195513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.195513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:29.195513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:29.195513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:29.195513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:29.195513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:29.195513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.195513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:29.195513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:29.195513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:29.196541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:29.197104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:29.197104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:29.197104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:29.197104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:29.197104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:29.197104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:29.197104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:29.197104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:29.197104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:29.197104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:29.197104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.197104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:29.198384 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:29.204781 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:29.204781 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:29.204781 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:29.204781 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:29.204781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.204781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:29.204781 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:29.204781 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:29.204781 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:29.205121 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:29.205121 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:29.205121 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.205121 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:29.205121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.205121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:29.205121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:29.205121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:29.205121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.205121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:29.205121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:29.205121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:29.205121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.205121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:29.205121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:29.205121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:29.205598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:29.205598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:29.205598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:29.205598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:29.205598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:29.205598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:29.205598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:29.205598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:29.205598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:29.205598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:29.205598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.205598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:29.205598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.205598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:29.206035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:29.206035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:29.206035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.206035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:29.206035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:29.206035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:29.206035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:29.206035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.206035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:29.206035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:29.206035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:29.206035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.206035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:29.206415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:29.206415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:29.206415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:29.206415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:29.206415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:29.206415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:29.206415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:29.206415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:29.206415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:29.206415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:29.206415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:29.206415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:29.206415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:29.206873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:29.207348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:29.208014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:29.208014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:29.208014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:29.208014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.208014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:29.208014 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:29.208014 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:29.208014 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:29.208014 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:29.208353 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:29.208353 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:29.208353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.208353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:29.208353 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:29.208353 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:29.208353 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:29.208353 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:29.208353 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:29.208353 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.208353 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:29.208856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.208856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:29.208856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:29.208856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:29.208856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.208856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:29.208856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:29.208856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.208856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:29.208856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:29.208856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:29.208856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.209217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:29.209217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:29.209217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:29.209217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:29.209217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:29.209217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:29.209217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:29.209217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:29.209217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:29.209217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:29.209217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:29.209217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:29.209217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:29.209616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.209616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:29.209616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.209616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:29.209616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:29.209616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:29.209616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:29.209616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:29.209616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.209616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:29.209616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:29.209616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.209616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:29.209616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:29.209616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:29.210059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:29.210600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:29.210600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:29.210600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:29.210600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:29.210600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:29.210600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:33.710505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:33.711360 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:33.711360 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:33.712762 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:33.753141 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:33.753506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:33.754152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:33.754152 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:33.754152 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:33.754152 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:33.754152 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:33.754152 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:33.754152 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:33.754152 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:33.754957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:33.754957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:33.754957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:33.754957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:33.754957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:33.754957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:33.754957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:33.754957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:33.754957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:33.754957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:33.754957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:33.754957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:33.755818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:33.755818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:33.755818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:33.755818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:33.755818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:33.755818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:33.755818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:33.755818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:33.755818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:33.755818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:33.755818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:33.755818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:33.755818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:33.756615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:33.756615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:33.756615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:33.756615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:33.756615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:33.756615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:33.756615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:33.756615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:33.756615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:33.756615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:33.756615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:33.756615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:33.756615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:33.756615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:33.756615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:33.757426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:33.758670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:33.758670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:33.758670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:33.758670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:33.758670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:33.758670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:34.180961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:34.181542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:34.181972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:34.182649 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:34.182975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.185392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:34.185392 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:34.185392 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:34.185392 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:34.185392 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:34.185392 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:34.185392 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.185392 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:34.185392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.185392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:34.185392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:34.185392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:34.185392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.185392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:34.185392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:34.185747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.185747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:34.185747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:34.185747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:34.185747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.185747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:34.185747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:34.185747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:34.185747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:34.185747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:34.185747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:34.185747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:34.185747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:34.185747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:34.186020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:34.186020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:34.186020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:34.186020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:34.186020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.186020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:34.186020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.186020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:34.186020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:34.186020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:34.186020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:34.186020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:34.186020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.186020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:34.186298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:34.186682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:34.186682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:34.186682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:34.186682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:34.186682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:34.186682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:34.186682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:34.186682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:34.186682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.186682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:34.189384 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:34.189647 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:34.189859 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:34.190075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:22:34.190962 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:34.191346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.195122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:34.195696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:34.195696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:34.195696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:34.195696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:34.195696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:34.195696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:34.195696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:34.195696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:34.195696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:34.195696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:34.195696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:34.195696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:34.195696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.195696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:34.195696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.196172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:34.196172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:34.196172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:34.196172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.196172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:34.196172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:34.196172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:22:34.196172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:34.196172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:34.196172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.196172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:34.196172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:34.196172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:34.196602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.196602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:34.196602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:34.196602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:34.196602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:34.196602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:34.196602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:34.196602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:34.196602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:34.196602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:34.196602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:34.196602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:34.196602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:34.196602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:34.197014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.197014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:34.197014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.197014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:34.197014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:34.197014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:34.197014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:34.197014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:34.197014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.197014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:34.197014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:34.197014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.197014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:34.197014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:34.197014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:34.197482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:34.198117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:34.198117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:34.198117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:34.198117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:34.198117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:34.198117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:34.198117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:34.198117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.198117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:34.198700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:34.199024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:34.199246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:34.199501 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:34.200147 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:34.200439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.203944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:34.204570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:34.204570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:34.204570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:34.204570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:34.204570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:34.204570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:34.204570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:34.204570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:34.204570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:34.204570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:34.204570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:34.204570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:34.204570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.204570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:34.204570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.205079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:34.205079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:34.205079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:34.205079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.205079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:34.205079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:34.205079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:34.205079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:34.205079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.205079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:34.205079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:34.205079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:34.205079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.205506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:34.205506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:34.205506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:34.205506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:34.205506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:34.205506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:34.205506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:34.205506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:34.205506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:34.205506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:34.205506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:34.205506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:34.205506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:34.205870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.205870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:34.205870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.205870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:34.205870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:34.205870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:34.205870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:34.205870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:34.205870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.205870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:34.205870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:34.205870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.205870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:34.205870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:34.205870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:34.206314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:34.206906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:34.206906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:34.206906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:34.206906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:34.206906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:34.206906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:34.206906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.206906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:34.206906 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:34.207421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:34.207631 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:34.207885 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:34.208632 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:34.209029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:34.209208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.211315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:34.211315 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:34.211315 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:34.211315 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:34.211315 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:34.211315 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:34.211315 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.211315 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:34.211315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.211315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:34.211315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:34.211315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:34.211315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.211315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:34.211315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:34.211682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.211682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:34.211682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:34.211682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:34.211682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.211682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:34.211682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:34.211682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:34.211682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:34.211682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:34.211682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:34.211682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:34.211682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:34.211682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:34.211964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:34.211964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:34.211964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:34.211964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:34.211964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.211964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:34.211964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.211964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:34.211964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:34.211964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:34.211964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:34.211964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:34.211964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.211964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:34.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:34.212622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:34.212622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:34.212622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:34.212622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:34.212622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:34.212622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:34.212622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:34.212622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:34.212622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:34.212622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:38.712128 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:38.713036 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:38.713036 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:38.714437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:38.746833 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:38.747149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:38.747989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:38.747989 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:38.747989 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:38.747989 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:38.747989 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:38.747989 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:38.747989 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:38.747989 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:38.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:38.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:38.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:38.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:38.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:38.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:38.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:38.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:38.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:38.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:38.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:38.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:38.749062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:38.749062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:38.749062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:38.749062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:38.749062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:38.749062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:38.749062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:38.749062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:38.749062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:38.749062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:38.749062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:38.749062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:38.749062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:38.749404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:38.749404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:38.749621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:38.749621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:38.749621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:38.749621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:38.749621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:38.749621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:38.749621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:38.749621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:38.749621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:38.749621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:38.749621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:38.749621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:38.749621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:38.749621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:38.749621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:38.749621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:38.750038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:38.750728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:38.750728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:38.750728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:39.181758 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:39.182384 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:39.182687 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:39.183504 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:39.183855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.184827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:39.184827 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:39.184827 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:39.184827 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:39.184827 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:39.184827 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:39.184827 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.184827 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:39.186532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.186532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:39.186532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:39.186532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:39.186532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.186532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:39.186532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:39.186532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.186532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:39.186532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:39.186532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:39.186532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.186999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:39.186999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:39.186999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:39.186999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:39.186999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:39.186999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:39.186999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:39.186999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:39.186999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:39.186999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:39.186999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:39.186999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:39.186999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:39.187483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.187483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:39.188556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.188556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:39.188556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:39.188556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:39.188556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:39.188556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:39.188556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.188556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:39.188556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:39.188556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.188556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:39.188556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:39.188556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.188556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:39.188556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:39.188556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:39.189553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:39.190004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:39.190004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.190004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:39.190004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:39.190004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:39.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:39.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:22:39.190941 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:39.191087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.191703 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:39.192719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.192719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:39.192719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:39.192719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:39.192719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.192719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:39.192719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:39.192719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:39.192719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.192719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:39.192719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:39.192719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:39.192719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:39.192719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:39.192719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:39.193984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:39.193984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:39.193984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:39.193984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:39.193984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:39.193984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:39.193984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:39.193984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.193984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:39.193984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.193984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:39.193984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:39.193984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:39.193984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.194554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:39.194554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:39.194554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:22:39.194554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:39.194554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:39.194554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.194554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:39.194554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:39.194554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:39.194554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.194554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:39.194554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:39.194554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:39.194995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:39.194995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:39.194995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:39.194995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:39.194995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:39.194995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:39.194995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:39.194995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:39.194995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:39.194995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:39.194995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.194995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:39.195419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.195419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:39.195419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:39.195419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:39.195419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:39.195419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:39.195419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.195419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:39.195419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:39.195419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.195419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:39.195419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:39.195419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.195419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:39.195419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:39.195419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:39.195862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:39.196298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:39.196298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:39.196298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:39.196298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:39.196298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:39.196298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.196298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:39.199060 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:39.199327 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:39.199482 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:39.199624 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:39.200011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:39.200297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.200869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:39.200869 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:39.200869 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:39.200869 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:39.200869 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:39.200869 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:39.200869 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.200869 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:39.201686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.201686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:39.201686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:39.201686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:39.201686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.201686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:39.201686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:39.201686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:39.201686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.201686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:39.201686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:39.201686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:39.201686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:39.201686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:39.201686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:39.202118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:39.202118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:39.202118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:39.202118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:39.202118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:39.202118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:39.202118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:39.202118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.202118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:39.202707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.202707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:39.202707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:39.202707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:39.202707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.202707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:39.202707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:39.202707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:39.202707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:39.202707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.202707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:39.203036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:39.203036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:39.203036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.203036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:39.203036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:39.203036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:39.203036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:39.203036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:39.203036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:39.203036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:39.203036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:39.203036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:39.203036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:39.203036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:39.203414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:39.203414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:39.203414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.203414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.203855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:39.204393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:39.204948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:39.204948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:39.204948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.204948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:39.207843 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:39.208213 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:39.208363 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:39.208576 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:39.209684 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:39.210078 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:39.210266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.211062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:39.211062 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:39.211062 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:39.211062 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:39.211062 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:39.211062 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:39.211062 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.211062 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:39.212190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.212190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:39.212190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:39.212190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:39.212190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.212190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:39.212190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:39.212190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.212190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:39.212190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:39.212190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:39.212190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.212834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:39.212834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:39.212834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:39.212834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:39.212834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:39.212834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:39.212834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:39.212834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:39.212834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:39.212834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:39.212834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:39.212834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:39.212834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:39.213210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.213210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:39.213288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.213288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:39.213288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:39.213288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:39.213288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:39.213288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:39.213288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.213288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:39.213288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:39.213288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.213288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:39.213288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:39.213288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.213288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:39.213288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:39.213288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:39.213851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:39.214571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:39.214571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:39.214571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:43.713025 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:43.713650 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:43.713650 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:43.714767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:43.744092 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:43.744436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:43.745044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:43.745044 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:43.745044 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:43.745044 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:43.745044 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:43.745044 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:43.745044 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:43.745044 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:43.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.031 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:43.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:43.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:43.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:43.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:43.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:43.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:43.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:43.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:43.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:43.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:43.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:43.746474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:43.746474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:43.746474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:43.746474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:43.746474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:43.746474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:43.746474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:43.746474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:43.746474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:43.746474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:43.746474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:43.746474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:43.746474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:43.747080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:43.747080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:43.747080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:43.747080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:43.747080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:43.747080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:43.747080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:43.747080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:43.747080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:43.747080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:43.747080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:43.747080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:43.747080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:43.747080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:43.747080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:43.747920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:43.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:43.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:43.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:43.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:43.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:43.748711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:44.182320 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:44.182890 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:44.183089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:44.184545 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:44.185103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.186308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:44.186308 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:44.186308 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:44.186308 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:44.186308 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:44.186308 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:44.186308 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.186308 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:44.187975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.187975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:44.187975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:44.187975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:44.187975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.187975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:44.187975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:44.187975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.187975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:44.187975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:44.187975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:44.187975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.188605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:44.188605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:44.188605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:44.188605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:44.188605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:44.188605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:44.188605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:44.188605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:44.188605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:44.188605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:44.188605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:44.188605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:44.188605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:44.189173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.189173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:44.189173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.189173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:44.189173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:44.189173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:44.189173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:44.189173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:44.189173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.189173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:44.189173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:44.189173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.189173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:44.189173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:44.189173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:44.190636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:44.191709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:44.191709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:44.191709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:44.191709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:44.191709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.191709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:44.191709 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:44.191709 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:44.191709 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:44.191709 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:22:44.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:44.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:44.192246 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:44.192246 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:44.192246 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:44.192246 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:44.192246 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:44.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.192246 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:44.192999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.192999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:44.192999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:44.192999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:44.192999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.192999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:44.192999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:44.192999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:44.192999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.192999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:44.192999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:44.192999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:44.192999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:44.192999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:44.192999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:44.193746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:44.193746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:44.193746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:44.193746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:44.193746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:44.193746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:44.193746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:44.193746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.193746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:44.194162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.194162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:44.194162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:44.194162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:44.194162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.194162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:44.194162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:44.194162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:22:44.194162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:44.194162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:44.194162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.194162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:44.194751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:44.194751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:44.194751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.194751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:44.194751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:44.194751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:44.194751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:44.194751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:44.194751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:44.194751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:44.194751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:44.194751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:44.194751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:44.194751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:44.195423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:44.195423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:44.195423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.195423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:44.195423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.195423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:44.195423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:44.195423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:44.195423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:44.195423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:44.195423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.195423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:44.195423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:44.195423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:44.196075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:44.196922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:44.196922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:44.196922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:44.196922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:44.196922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:44.196922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:44.196922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:44.196922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:44.196922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:44.196922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:44.196922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.196922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:44.199557 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:44.199823 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:44.199943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:44.200071 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:44.200456 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:44.200710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.201220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:44.201220 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:44.201220 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:44.201220 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:44.201220 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:44.201220 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:44.201220 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.201220 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:44.202020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.202020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:44.202020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:44.202020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:44.202020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.202020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:44.202020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:44.202020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:44.202020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.202020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:44.202020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:44.202020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:44.202020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:44.202020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:44.202020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:44.202343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:44.202343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:44.202343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:44.202343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:44.202343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:44.202343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:44.202343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:44.202343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.202343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:44.202945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.202945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:44.202945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:44.202945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:44.202945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.202945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:44.202945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:44.202945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:44.202945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:44.202945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.202945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:44.203193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:44.203193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:44.203193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.203193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:44.203193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:44.203193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:44.203193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:44.203193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:44.203193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:44.203193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:44.203193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:44.203193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:44.203193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:44.203193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:44.203523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:44.203523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:44.203523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.203523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.204105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:44.204918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:44.204918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:44.204918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.204918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:44.208273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:44.208545 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:44.208663 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:44.208833 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:44.209207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:44.209541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:44.209718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.210341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:44.210341 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:44.210341 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:44.210341 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:44.210341 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:44.210341 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:44.210341 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.210341 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:44.211323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.211323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:44.211323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:44.211323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:44.211323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.211323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:44.211323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:44.211323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.211323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:44.211323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:44.211323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:44.211323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.211976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:44.211976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:44.211976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:44.211976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:44.211976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:44.211976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:44.211976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:44.211976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:44.211976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:44.211976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:44.211976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:44.211976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:44.211976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:44.212552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.212552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:44.212552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.212552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:44.212552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:44.212552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:44.212552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:44.212552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:44.212552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.212552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:44.212552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:44.212552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.212552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:44.212552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:44.212552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:44.213281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:44.214159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:44.214159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:44.214159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:44.214159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:44.214159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:44.214159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:48.716404 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:48.717171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:48.717265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:48.718399 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:48.761454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:48.761966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:48.762962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:48.762962 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:48.762962 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:48.762962 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:48.762962 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:48.762962 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:48.762962 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:48.762962 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:48.763776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.046 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:48.763776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:48.763776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:48.763776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:48.763776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:48.763776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:48.763776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:48.763776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:48.763776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:48.763776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:48.763776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:48.763776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:48.764428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:48.764428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:48.764428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:48.764428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:48.764428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:48.764428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:48.764428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:48.764428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:48.764428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:48.764428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:48.764428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:48.764428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:48.764428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:48.765228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:48.765228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:48.765228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:48.765228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:48.765228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:48.765228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:48.765228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:48.765228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:48.765228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:48.765228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:48.765228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:48.765228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:48.765228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:48.765228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:48.765228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:48.765923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:48.766409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:48.766409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:48.766409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:48.766409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:48.766409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:48.766409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:49.183025 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:49.183408 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:49.183598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:49.185602 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:49.185957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.187414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:49.187414 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:49.187414 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:49.187414 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:49.187414 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:49.187414 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:49.187414 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.187414 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:49.188714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.188714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:49.188714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:49.188714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:49.188714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.188714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:49.188714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:49.188714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.188714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:49.188714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:49.188714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:49.188714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.189342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:49.189342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:49.189342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:49.189342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:49.189342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:49.189342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:49.189342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:49.189342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:49.189342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:49.189342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:49.189342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:49.189342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:49.189342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:49.189903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.189903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:49.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:49.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:49.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:49.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:49.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:49.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:49.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:49.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:49.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:49.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:49.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:49.190502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:49.191399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:49.193949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:49.193949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.193949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:49.193949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:49.193949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:49.193949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:49.193949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:22:49.193949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:49.194208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.195036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:49.195036 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:49.195036 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:49.195036 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:49.195036 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:49.195036 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:49.195036 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.195036 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:49.195683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.195683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:49.195683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:49.195683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:49.195683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.195683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:49.195683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:49.195683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:49.195683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.195683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:49.195683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:49.195683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:49.195683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:49.195683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:49.195683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:49.196110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:49.196110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:49.196110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:49.196110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:49.196110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:49.196110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:49.196110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:49.196110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.196110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:49.196418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.196418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:49.196418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:49.196418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:49.196418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.196418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:49.196418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:49.196418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:22:49.196418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:49.196418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:49.196418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.196418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:49.196769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:49.196769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:49.196769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.196769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:49.196769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:49.196769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:49.196769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:49.196769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:49.196769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:49.196769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:49.196769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:49.196769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:49.196769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:49.196769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:49.197169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:49.197169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:49.197169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.197169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:49.197169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.197169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:49.197169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:49.197169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:49.197169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:49.197169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:49.197169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.197169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:49.197169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:49.197169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:49.197567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:49.198067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:49.198067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:49.198067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:49.198067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:49.198067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:49.198067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:49.198067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:49.198067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:49.198067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:49.198067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:49.198067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.198067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:49.199854 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:49.199989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:49.200067 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:49.200166 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:49.200588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:49.200887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.201456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:49.201456 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:49.201456 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:49.201456 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:49.201456 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:49.201456 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:49.201456 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.201456 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:49.201988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.201988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:49.201988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:49.201988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:49.201988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.201988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:49.201988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:49.201988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:49.201988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.201988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:49.201988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:49.201988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:49.201988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:49.201988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:49.201988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:49.202454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:49.202454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:49.202454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:49.202454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:49.202454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:49.202454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:49.202454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:49.202454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.202454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:49.202697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.202697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:49.202697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:49.202697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:49.202697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.202697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:49.202697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:49.202697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:49.202697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:49.202697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.202697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:49.203018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:49.203018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:49.203018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.203018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:49.203018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:49.203018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:49.203018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:49.203018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:49.203018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:49.203018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:49.203018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:49.203018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:49.203018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:49.203018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:49.203522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:49.203522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:49.203522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.203522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:49.203522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.203522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:49.203522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:49.203522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:49.203522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:49.203522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:49.203522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.203522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:49.203522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:49.203522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:49.204041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:49.204833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:49.204833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:49.204833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:49.204833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:49.204833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:49.204833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:49.204833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:49.204833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:49.204833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:49.204833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.204833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:49.208584 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:49.208788 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:49.208938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:49.209096 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:49.209517 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:49.209784 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:49.209923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.210506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:49.210506 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:49.210506 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:49.210506 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:49.210506 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:49.210506 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:49.210506 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.210506 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:49.211356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.211356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:49.211356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:49.211356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:49.211356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.211356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:49.211356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:49.211356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.211356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:49.211356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:49.211356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:49.211356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.211746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:49.211746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:49.211746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:49.211746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:49.211746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:49.211746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:49.211746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:49.211746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:49.211746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:49.211746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:49.211746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:49.211746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:49.211746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:49.212131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.212131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:49.212479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.212479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:49.212479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:49.212479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:49.212479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:49.212479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:49.212479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.212479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:49.212479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:49.212479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.212479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:49.212479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:49.212479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.212479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:49.212479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:49.212479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:49.213064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:49.213749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:49.213749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:49.213749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:53.717554 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:53.717554 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:53.718636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:53.718783 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:53.721419 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=229 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:22:53.749328 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:53.749889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:53.751147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:53.751147 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:53.751147 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:53.751147 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:53.751147 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:53.751147 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:53.751147 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:53.751147 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:53.752930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:53.752930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:53.752930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:53.752930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:53.752930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:53.752930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:53.752930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:53.752930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:53.752930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:53.752930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:53.752930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:53.752930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:53.753882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:53.753882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:53.753882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:53.753882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:53.753882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:53.753882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:53.753882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:53.753882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:53.753882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:53.753882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:53.753882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:53.753882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:53.753882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:53.754687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:53.754687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:53.754687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:53.754687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:53.754687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:53.754687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:53.754687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:53.754687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:53.754687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:53.754687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:53.754687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:53.754687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:53.754687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:53.754687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:53.754687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:53.755437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:53.756286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:53.756286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:53.756286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:53.756286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:53.756286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:53.756286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:54.183537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:54.184037 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:54.184337 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:54.185307 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:54.185687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.186612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:54.186612 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:54.186612 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:54.186612 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:54.186612 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:54.186612 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:54.186612 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.186612 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:54.188163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.188163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:54.188163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:54.188163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:54.188163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.188163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:54.188163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:54.188163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.188163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:54.188163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:54.188163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:54.188163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.188698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:54.188698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:54.188698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:54.188698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:54.188698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:54.188698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:54.188698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:54.188698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:54.188698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:54.188698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:54.188698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:54.188698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:54.188698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:54.189096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.189096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:54.189900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.189900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:54.189900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:54.189900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:54.189900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:54.189900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:54.189900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.189900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:54.189900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:54.189900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.189900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:54.189900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:54.189900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.189900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:54.189900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:54.189900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:54.190535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:54.191155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:54.191155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.191155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:54.191487 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:54.191862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:54.192053 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:54.192247 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:22:54.192754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:54.193043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.193754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:54.193754 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:54.193754 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:54.193754 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:54.193754 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:54.193754 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:54.193754 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.193754 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:54.194548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.194548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:54.194548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:54.194548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:54.194548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.194548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:54.194548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:54.194548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:54.194548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.194548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:54.194548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:54.194548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:54.194548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:54.194548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:54.194548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:54.195050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:54.195050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:54.195050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:54.195050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:54.195050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:54.195050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:54.195050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:54.195050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.195050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:54.195358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.195358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:54.195358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:54.195358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:54.195358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.195358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:54.195358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:54.195358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:22:54.195358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:54.195358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:54.195358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.195358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:54.195784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:54.195784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:54.195784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.195784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:54.195784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:54.195784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:54.195784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:54.195784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:54.195784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:54.195784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:54.195784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:54.195784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:54.195784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:54.195784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:54.196251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:54.196251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:54.196251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.196251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:54.196531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.196531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:54.196531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:54.196531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:54.196531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:54.196531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:54.196531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.196531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:54.196531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:54.196531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.196531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:54.196531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:54.196531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.196531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:54.196531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:54.196531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:54.197074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:54.197682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:54.197682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:54.197682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:54.197682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:54.197682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:54.197682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.197682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:54.202173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:54.202173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:54.202173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:54.202173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:54.202173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:54.202173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.202484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:54.202484 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:54.202484 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:54.202484 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:54.202484 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:54.202484 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:54.202484 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.202484 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:54.203032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.203032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:54.203032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:54.203032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:54.203032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.203032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:54.203032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:54.203032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:54.203032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.203032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:54.203032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:54.203032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:54.203032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:54.203032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:54.203032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:54.203529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:54.203529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:54.203529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:54.203529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:54.203529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:54.203529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:54.203529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:54.203529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.203529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:54.203992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.203992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:54.203992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:54.203992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:54.203992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.203992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:54.203992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:54.203992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:54.203992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:54.203992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.203992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:54.204427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:54.204427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:54.204427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.204427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:54.204427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:54.204427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:54.204427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:54.204427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:54.204427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:54.204427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:54.204427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:54.204427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:54.204427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:54.204427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:54.204853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:54.204853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:54.204853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.204853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.205183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:54.205728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:54.206313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:54.206313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:54.206313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.206313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:54.209040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:54.209328 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:54.209478 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:54.209631 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:54.210121 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:54.210617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:54.210820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.211548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:54.211548 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:54.211548 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:54.211548 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:54.211548 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:54.211548 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:54.211548 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.211548 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:54.212453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.212453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:54.212453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:54.212453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:54.212453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.212453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:54.212453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:54.212453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.212453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:54.212453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:54.212453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:54.212453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.212826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:54.212826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:54.212826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:54.212826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:54.212826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:54.212826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:54.212826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:54.212826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:54.212826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:54.212826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:54.212826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:54.212826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:54.212826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:54.213206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.213206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:54.213466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.213466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:54.213466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:54.213466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:54.213466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:54.213466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:54.213466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.213466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:54.213466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:54.213466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.213466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:54.213466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:54.213466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.213466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:54.213466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:54.213466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:54.213948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:54.214524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:54.214524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:54.214524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:58.717843 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:58.718787 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:58.718853 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:58.720249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:58.762290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:58.762747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:58.763621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:58.763621 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:58.763621 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:58.763621 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:58.763621 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:58.763621 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:58.763621 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:58.763621 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:58.764550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.045 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:58.764550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:58.764550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:58.764550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:58.764550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:58.764550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:58.764550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:58.764550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:58.764550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:58.764550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:58.764550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:58.764550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:58.765159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:58.765159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:58.765159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:58.765159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:58.765159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:58.765159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:58.765159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:58.765159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:58.765159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:58.765159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:58.765159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:58.765159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:58.765159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:58.765701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:58.765701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:58.765701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:58.765701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:58.765701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:58.765701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:58.765701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:58.765701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:58.765701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:58.765701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:58.765701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:58.765701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:58.765701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:58.765701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:58.765701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:58.766404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:58.767140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:58.767140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:58.767140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:58.767140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:58.767140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:58.767140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:59.184478 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:59.184847 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:59.185136 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:59.186796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:59.187201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.188554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:59.188554 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:59.188554 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:59.188554 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:59.188554 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:59.188554 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:59.188554 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.188554 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:59.190148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.190148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:59.190148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:59.190148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:59.190148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.190148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:59.190148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:59.190148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.190148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:59.190148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:59.190148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:59.190148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:59.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:59.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:59.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:59.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:59.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:59.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:59.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:59.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:59.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:59.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:59.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:59.191343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:59.192145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.192145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:59.192255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.192255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:59.192255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:59.192255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:59.192255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:59.192255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:59.192255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.192255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:59.192255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:59.192255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.192255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:59.192255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:59.192255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.192255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:59.192255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:59.192255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:59.192987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:59.193973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:59.193973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.193973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:59.193973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:59.193973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:59.193973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:59.193973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:22:59.194561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:59.194763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.195432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:59.195432 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:59.195432 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:59.195432 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:59.195432 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:59.195432 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:59.195432 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.195432 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:59.196522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.196522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:59.196522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:59.196522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:59.196522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.196522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:59.196522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:59.196522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:59.196522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.196522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:59.196522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:59.196522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:59.196522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:59.196522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:59.196522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:59.197240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:59.197240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:59.197240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:59.197240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:59.197240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:59.197240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:59.197240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:59.197240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.197240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:59.197550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.197550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:59.197550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:59.197550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:59.197550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.197550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:59.197550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:59.197550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:22:59.197550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:59.197550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:59.197550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.197550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:59.197992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:59.197992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:59.197992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.197992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:59.197992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:59.197992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:59.197992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:59.197992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:59.197992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:59.197992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:59.197992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:59.197992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:59.197992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:59.197992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:59.198364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:59.198364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:59.198364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.198364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:59.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:59.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:59.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:59.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:59.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:59.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:59.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:59.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:59.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:59.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:59.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:59.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:59.198902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:59.199420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:59.199420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:59.199420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:59.199420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:59.199420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:59.199420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.199420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:59.200599 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:59.200867 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:59.201002 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:59.201130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:59.201666 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:59.202030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.202799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:59.202799 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:59.202799 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:59.202799 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:59.202799 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:59.202799 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:59.202799 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.202799 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:59.203643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.203643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:22:59.203643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:59.203643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:59.203643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.203643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:59.203643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:59.203643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:59.203643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.203643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:22:59.203643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:59.203643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:22:59.203643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:59.203643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:22:59.203643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:22:59.204221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:59.204221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:22:59.204221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:59.204221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:22:59.204221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:22:59.204221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:59.204221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:22:59.204221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.204221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:22:59.204594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.204594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:59.204594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:59.204594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:59.204594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.204594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:59.204594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:59.204594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:59.204594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:59.204594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.204594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:59.205053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:59.205053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:59.205053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.205053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:59.205053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:59.205053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:59.205053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:59.205053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:59.205053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:59.205053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:59.205053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:59.205053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:59.205053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:59.205053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:59.205802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:59.205802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:59.205802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.205802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:59.205802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.205802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:59.205802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:59.205802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:59.205802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:59.205802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:59.205802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.205802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:59.205802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:59.205802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:59.206307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:59.207009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:59.207009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:59.207009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:59.207009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:59.207009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:59.207009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:59.207009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:59.207009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:59.207009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:59.207009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.207009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:22:59.209622 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:22:59.209837 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:22:59.209959 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:22:59.210117 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:22:59.210738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:59.211163 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:22:59.211383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:22:59.212246 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:59.212246 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:22:59.212246 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:22:59.212246 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:59.212246 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:22:59.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.212246 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:22:59.213167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.213167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:22:59.213167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:59.213167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:22:59.213167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.213167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:59.213167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:59.213167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.213167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:59.213167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:59.213167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:59.213167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.213641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:22:59.213641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:59.213641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:22:59.213641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:59.213641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:22:59.213641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:22:59.213641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:59.213641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:22:59.213641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:59.213641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:22:59.213641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:22:59.213641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:59.213641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:22:59.214126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.214126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:22:59.214213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.214213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:22:59.214213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:22:59.214213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:22:59.214213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:22:59.214213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:22:59.214213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.214213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:22:59.214213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:22:59.214213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.214213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:22:59.214213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:22:59.214213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.214213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:22:59.214213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:22:59.214213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:22:59.214793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:22:59.215485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:22:59.215485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:22:59.215485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:03.718524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:03.719336 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:03.719336 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:03.719996 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:03.756677 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:03.757160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:03.758409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:03.758409 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:03.758409 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:03.758409 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:03.758409 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:03.758409 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:03.758409 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:03.758409 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:03.759226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:03.759226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:03.759226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:03.759226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:03.759226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:03.759226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:03.759226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:03.759226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:03.759226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:03.759226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:03.759226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:03.759226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:03.759909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:03.759909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:03.759909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:03.759909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:03.759909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:03.759909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:03.759909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:03.759909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:03.759909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:03.759909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:03.759909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:03.759909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:03.759909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:03.760554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:03.760554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:03.760554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:03.760554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:03.760554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:03.760554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:03.760554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:03.760554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:03.760554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:03.760554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:03.760554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:03.760554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:03.760554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:03.760554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:03.760554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:03.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:03.762189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:03.762189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:03.762189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:03.762189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:03.762189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:03.762189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:04.184968 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:04.185279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:04.185450 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:04.186305 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:04.186580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.187222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:04.187222 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:04.187222 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:04.187222 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:04.187222 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:04.187222 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:04.187222 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.187222 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:04.188306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.188306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:04.188306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:04.188306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:04.188306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.188306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:04.188306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:04.188306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.188306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:04.188306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:04.188306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:04.188306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:04.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:04.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:04.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:04.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:04.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:04.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:04.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:04.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:04.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:04.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:04.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:04.188911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:04.189583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.189583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:04.189583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.189583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:04.189583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:04.189583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:04.189583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:04.189583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:04.189583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.189583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:04.189583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:04.189583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.189583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:04.189583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:04.189583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:04.190291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:04.191168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:04.191168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:04.191168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:04.191168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:04.191168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.191168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:04.193568 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:04.193788 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:04.193903 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:04.194020 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:23:04.194517 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:04.194747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.195341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:04.195341 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:04.195341 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:04.195341 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:04.195341 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:04.195341 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:04.195341 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.195341 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:04.196123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.196123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:04.196123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:04.196123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:04.196123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.196123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:04.196123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:04.196123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:04.196123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.196123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:04.196123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:04.196123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:04.196123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:04.196123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:04.196123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:04.196610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:04.196610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:04.196610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:04.196610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:04.196610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:04.196610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:04.196610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:04.196610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.196610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:04.196952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.196952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:04.196952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:04.196952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:04.196952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.196952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:04.196952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:04.196952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:23:04.196952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:04.196952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:04.196952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.196952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:04.197302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:04.197302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:04.197302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.197302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:04.197302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:04.197302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:04.197302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:04.197302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:04.197302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:04.197302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:04.197302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:04.197302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:04.197302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:04.197302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:04.197691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:04.197691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:04.197691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.197691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:04.198021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.198021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:04.198021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:04.198021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:04.198021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:04.198021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:04.198021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.198021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:04.198021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:04.198021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.198021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:04.198021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:04.198021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.198021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:04.198021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:04.198021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:04.198506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:04.198997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:04.198997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:04.198997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:04.198997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:04.198997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:04.198997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.198997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:04.200906 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:04.201115 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:04.201236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:04.201379 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:04.201885 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:04.202296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.202990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:04.202990 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:04.202990 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:04.202990 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:04.202990 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:04.202990 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:04.202990 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.202990 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:04.203807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.203807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:04.203807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:04.203807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:04.203807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.203807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:04.203807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:04.203807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:04.203807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.203807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:04.203807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:04.203807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:04.203807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:04.203807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:04.203807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:04.204240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:04.204240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:04.204240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:04.204240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:04.204240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:04.204240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:04.204240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:04.204240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.204240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:04.204783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.204783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:04.204783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:04.204783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:04.204783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.204783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:04.204783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:04.204783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:04.204783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:04.204783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.204783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:04.205131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:04.205131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:04.205131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.205131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:04.205131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:04.205131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:04.205131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:04.205131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:04.205131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:04.205131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:04.205131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:04.205131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:04.205131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:04.205131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:04.205547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:04.205547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:04.205547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.205547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.205960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:04.206527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:04.207006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:04.207006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:04.207006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.207006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:04.209877 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:04.210101 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:04.210221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:04.210401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:04.210768 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:04.211067 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:04.211234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.212027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:04.212027 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:04.212027 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:04.212027 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:04.212027 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:04.212027 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:04.212027 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.212027 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:04.212937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.212937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:04.212937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:04.212937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:04.212937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.212937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:04.212937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:04.212937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.212937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:04.212937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:04.212937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:04.212937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.213294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:04.213294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:04.213294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:04.213294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:04.213294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:04.213294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:04.213294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:04.213294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:04.213294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:04.213294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:04.213294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:04.213294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:04.213294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:04.213668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.213668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:04.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:04.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:04.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:04.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:04.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:04.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:04.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:04.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:04.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:04.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:04.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:04.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:04.214475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:04.215026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:04.215026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:04.215026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:08.720853 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:08.722312 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:08.722790 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:08.724284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:08.765589 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:08.765994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:08.766876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:08.766876 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:08.766876 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:08.766876 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:08.766876 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:08.766876 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:08.766876 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:08.766876 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:08.767983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.044 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:08.767983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:08.767983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:08.767983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:08.767983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:08.767983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:08.767983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:08.767983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:08.767983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:08.767983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:08.767983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:08.767983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:08.768601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:08.768601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:08.768601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:08.768601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:08.768601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:08.768601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:08.768601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:08.768601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:08.768601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:08.768601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:08.768601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:08.768601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:08.768601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:08.769131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:08.769131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:08.769131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:08.769131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:08.769131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:08.769131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:08.769131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:08.769131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:08.769131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:08.769131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:08.769131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:08.769131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:08.769131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:08.769131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:08.769131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:08.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:08.770427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:08.770427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:08.770427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:08.770427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:08.770427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:08.770427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:09.185771 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:09.186900 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:09.186900 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:09.187645 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:09.187968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.189247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:09.189247 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:09.189247 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:09.189247 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:09.189247 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:09.189247 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:09.189247 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.189247 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:09.190782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.190782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:09.190782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:09.190782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:09.190782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.190782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:09.190782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:09.190782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.190782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:09.190782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:09.190782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:09.190782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.191236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:09.191236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:09.191236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:09.191236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:09.191236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:09.191236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:09.191236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:09.191236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:09.191236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:09.191236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:09.191236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:09.191236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:09.191236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:09.191646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.191646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:09.193629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.193629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:09.193629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:09.193629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:09.193629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:09.193629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:09.193629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.193629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:09.193629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:09.193629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.193629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:09.193629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:09.193629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.193629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:09.193629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:09.193629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:09.194105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:09.194609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:09.194609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.194609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:09.194609 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:09.194609 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:09.194609 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:09.194818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:23:09.195083 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:09.195301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.195921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:09.195921 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:09.195921 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:09.195921 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:09.195921 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:09.195921 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:09.195921 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.195921 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:09.196730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.196730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:09.196730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:09.196730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:09.196730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.196730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:09.196730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:09.196730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:09.196730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.196730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:09.196730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:09.196730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:09.196730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:09.196730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:09.196730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:09.197162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:09.197162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:09.197162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:09.197162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:09.197162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:09.197162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:09.197162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:09.197162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.197162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:09.197644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.197644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:09.197644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:09.197644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:09.197644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.197644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:09.197644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:09.197644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:23:09.197644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:09.197644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:09.197644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.197644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:09.197985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:09.197985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:09.197985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.197985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:09.197985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:09.197985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:09.197985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:09.197985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:09.197985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:09.197985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:09.197985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:09.197985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:09.197985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:09.197985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:09.198380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:09.198380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:09.198380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.198380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:09.198710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.198710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:09.198710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:09.198710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:09.198710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:09.198710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:09.198710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.198710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:09.198710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:09.198710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.198710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:09.198710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:09.198710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.198710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:09.198710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:09.198710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:09.199214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:09.199745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:09.199745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:09.199745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:09.199745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:09.199745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:09.199745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.199745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:09.201405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:09.201714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:09.201714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:09.201893 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:09.202796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:09.203196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.203915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:09.203915 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:09.203915 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:09.203915 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:09.203915 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:09.203915 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:09.203915 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.203915 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:09.204459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.204459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:09.204459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:09.204459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:09.204459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.204459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:09.204459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:09.204459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:09.204459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.204459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:09.204459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:09.204459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:09.204459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:09.204459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:09.204459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:09.204879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:09.204879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:09.204879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:09.204879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:09.204879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:09.204879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:09.204879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:09.204879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.204879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:09.205469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.205469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:09.205469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:09.205469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:09.205469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.205469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:09.205469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:09.205469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:09.205469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:09.205469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.205469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:09.206094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:09.206094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:09.206094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.206094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:09.206094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:09.206094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:09.206094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:09.206094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:09.206094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:09.206094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:09.206094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:09.206094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:09.206094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:09.206094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:09.206747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:09.206747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:09.206747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.206747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:09.206747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.206747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:09.206747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:09.206747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:09.206747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:09.206747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:09.206747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.206747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:09.206747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:09.206747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:09.207581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:09.208422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:09.208422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:09.208422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:09.208422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:09.208422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:09.208422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:09.208422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:09.208422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:09.208422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:09.208422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.208422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:09.212598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:09.212894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:09.213024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:09.213141 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:09.213577 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:09.213799 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:09.213966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.214551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:09.214551 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:09.214551 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:09.214551 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:09.214551 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:09.214551 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:09.214551 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.214551 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:09.215347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.215347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:09.215347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:09.215347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:09.215347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.215347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:09.215347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:09.215347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.215347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:09.215347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:09.215347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:09.215347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.215706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:09.215706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:09.215706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:09.215706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:09.215706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:09.215706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:09.215706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:09.215706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:09.215706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:09.215706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:09.215706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:09.215706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:09.215706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:09.216337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.216337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:09.216658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.216658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:09.216658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:09.216658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:09.216658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:09.216658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:09.216658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.216658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:09.216658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:09.216658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.216658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:09.216658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:09.216658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.216658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:09.216658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:09.216658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:09.217402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:09.218230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:09.218230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:09.218230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:13.722619 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:13.723227 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:13.723633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:13.724643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:13.756036 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:13.756296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:13.756943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:13.756943 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:13.756943 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:13.756943 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:13.756943 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:13.756943 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:13.756943 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:13.756943 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:13.757674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:13.757674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:13.757674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:13.757674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:13.757674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:13.757674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:13.757674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:13.757674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:13.757674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:13.757674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:13.757674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:13.757674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:13.758041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:13.758041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:13.758041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:13.758041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:13.758041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:13.758041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:13.758041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:13.758041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:13.758041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:13.758041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:13.758041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:13.758041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:13.758041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:13.758445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:13.758445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:13.758445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:13.758445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:13.758445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:13.758445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:13.758445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:13.758445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:13.758445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:13.758445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:13.758445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:13.758445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:13.758445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:13.758445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:13.758445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:13.758872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:13.759419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:13.759419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:13.759419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:13.759419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:13.759419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:13.759419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:14.186530 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:14.187752 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:14.187918 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:14.188974 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:14.189299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.190220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:14.190220 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:14.190220 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:14.190220 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:14.190220 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:14.190220 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:14.190220 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.190220 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:14.191409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.191409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:14.191409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:14.191409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:14.191409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.191409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:14.191409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:14.191409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.191409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:14.191409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:14.191409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:14.191409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.191953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:14.191953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:14.191953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:14.191953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:14.191953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:14.191953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:14.191953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:14.191953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:14.191953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:14.191953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:14.191953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:14.191953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:14.191953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:14.192456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.192456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:14.193459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.193459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:14.193459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:14.193459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:14.193459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:14.193459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:14.193459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.193459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:14.193459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:14.193459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.193459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:14.193459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:14.193459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.193459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:14.193459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:14.193459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:14.193869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:14.194428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:14.194428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.194428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:14.194516 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:14.194806 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:14.194924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:14.195045 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:23:14.195567 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:14.195863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.196576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:14.196576 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:14.196576 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:14.196576 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:14.196576 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:14.196576 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:14.196576 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.196576 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:14.197342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.197342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:14.197342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:14.197342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:14.197342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.197342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:14.197342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:14.197342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:14.197342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.197342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:14.197342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:14.197342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:14.197342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:14.197342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:14.197342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:14.197745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:14.197745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:14.197745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:14.197745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:14.197745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:14.197745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:14.197745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:14.197745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.197745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:14.198251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.198251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:14.198251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:14.198251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:14.198251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.198251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:14.198251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:14.198251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:23:14.198251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:14.198251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:14.198251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.198251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:14.198611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:14.198611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:14.198611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.198611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:14.198611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:14.198611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:14.198611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:14.198611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:14.198611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:14.198611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:14.198611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:14.198611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:14.198611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:14.198611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:14.198968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:14.198968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:14.198968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.198968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:14.199321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.199321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:14.199321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:14.199321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:14.199321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:14.199321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:14.199321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.199321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:14.199321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:14.199321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.199321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:14.199321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:14.199321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.199321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:14.199321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:14.199321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:14.199753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:14.200220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:14.200220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:14.200220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:14.200220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:14.200220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:14.200220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.200220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:14.201886 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:14.202180 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:14.202294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:14.202482 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:14.202998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:14.203361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.204095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:14.204095 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:14.204095 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:14.204095 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:14.204095 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:14.204095 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:14.204095 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.204095 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:14.205069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.205069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:14.205069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:14.205069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:14.205069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.205069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:14.205069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:14.205069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:14.205069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.205069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:14.205069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:14.205069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:14.205069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:14.205069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:14.205069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:14.205474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:14.205474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:14.205474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:14.205474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:14.205474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:14.205474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:14.205474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:14.205474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.205474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:14.206072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.206072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:14.206072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:14.206072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:14.206072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.206072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:14.206072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:14.206072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:14.206072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:14.206072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.206072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:14.206456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:14.206456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:14.206456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.206456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:14.206456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:14.206456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:14.206456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:14.206456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:14.206456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:14.206456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:14.206456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:14.206456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:14.206456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:14.206456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:14.206820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:14.206820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:14.206820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.206820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.207215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:14.207705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:14.208247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:14.208247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:14.208247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.208247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:14.213044 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:14.213328 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:14.213450 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:14.213600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:14.214075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:14.214472 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:14.214654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.215382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:14.215382 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:14.215382 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:14.215382 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:14.215382 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:14.215382 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:14.215382 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.215382 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:14.216214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.216214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:14.216214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:14.216214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:14.216214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.216214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:14.216214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:14.216214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.216214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:14.216214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:14.216214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:14.216214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.216623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:14.216623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:14.216623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:14.216623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:14.216623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:14.216623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:14.216623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:14.216623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:14.216623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:14.216623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:14.216623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:14.216623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:14.216623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:14.216960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.216960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:14.217201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.217201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:14.217201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:14.217201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:14.217201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:14.217201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:14.217201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.217201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:14.217201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:14.217201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.217201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:14.217201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:14.217201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.217201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:14.217201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:14.217201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:14.218257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:14.218792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:14.218792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:14.218792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:18.723274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:18.723989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:18.723989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:18.724957 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:18.768785 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:18.769153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:18.770186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:18.770186 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:18.770186 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:18.770186 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:18.770186 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:18.770186 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:18.770186 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:18.770186 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:18.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.046 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:18.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:18.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:18.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:18.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:18.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:18.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:18.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:18.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:18.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:18.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:18.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:18.771801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:18.771801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:18.771801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:18.771801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:18.771801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:18.771801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:18.771801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:18.771801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:18.771801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:18.771801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:18.771801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:18.771801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:18.771801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:18.772417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:18.772417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:18.772417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:18.772417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:18.772417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:18.772417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:18.772417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:18.772417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:18.772417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:18.772417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:18.772417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:18.772417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:18.772417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:18.772417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:18.772417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:18.773094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:18.774004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:18.774004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:18.774004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:18.774004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:18.774004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:18.774004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:19.187210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:19.188203 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:19.188203 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:19.188963 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:19.189298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.190258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:19.190258 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:19.190258 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:19.190258 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:19.190258 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:19.190258 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:19.190258 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.190258 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:19.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:19.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:19.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:19.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:19.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:19.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:19.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:19.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:19.191985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.192346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:19.192346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:19.192346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:19.192346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:19.192346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:19.192346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:19.192346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:19.192346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:19.192346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:19.192346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:19.192346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:19.192346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:19.192346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:19.192707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.192707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:19.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:19.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:19.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:19.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:19.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:19.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:19.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:19.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:19.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:19.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:19.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:19.193907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:19.194344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:19.195335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:19.195335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.195335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:19.195335 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:19.195335 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:19.195335 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:19.195335 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:23:19.195880 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:19.196209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.197072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:19.197072 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:19.197072 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:19.197072 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:19.197072 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:19.197072 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:19.197072 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.197072 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:19.197906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.197906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:19.197906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:19.197906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:19.197906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.197906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:19.197906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:19.197906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:19.197906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.197906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:19.197906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:19.197906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:19.197906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:19.197906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:19.197906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:19.198434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:19.198434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:19.198434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:19.198434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:19.198434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:19.198434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:19.198434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:19.198434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.198434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:19.198758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.198758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:19.198758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:19.198758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:19.198758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.198758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:19.198758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:19.198758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:23:19.198758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:19.198758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:19.198758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.198758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:19.199031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:19.199031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:19.199031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.199031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:19.199031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:19.199031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:19.199031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:19.199031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:19.199031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:19.199031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:19.199031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:19.199031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:19.199031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:19.199031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:19.199301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:19.199301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:19.199301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.199301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:19.199815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.199815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:19.199815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:19.199815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:19.199815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:19.199815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:19.199815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.199815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:19.199815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:19.199815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.199815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:19.199815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:19.199815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.199815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:19.199815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:19.199815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:19.200325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:19.200686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:19.200686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:19.200686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:19.200686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:19.200686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:19.200686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.200686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:19.202199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:19.202419 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:19.202531 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:19.202660 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:19.203199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:19.203489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.204122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:19.204122 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:19.204122 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:19.204122 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:19.204122 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:19.204122 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:19.204122 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.204122 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:19.205343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.205343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:19.205343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:19.205343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:19.205343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.205343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:19.205343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:19.205343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:19.205343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.205343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:19.205343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:19.205343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:19.205343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:19.205343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:19.205343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:19.206085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:19.206085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:19.206085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:19.206085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:19.206085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:19.206085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:19.206085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:19.206085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.206085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:19.206085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.206085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:19.206085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:19.206085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:19.206085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.207481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:19.207481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:19.207481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:19.207481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:19.207481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.207481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:19.207481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:19.207481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:19.207481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.207481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:19.207481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:19.207481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:19.207481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:19.207939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:19.207939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:19.207939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:19.207939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:19.207939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:19.207939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:19.207939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:19.207939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:19.207939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:19.207939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.207939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:19.207939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:19.208299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.208804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:19.213390 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:19.213778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:19.213957 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:19.214245 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:19.214831 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:19.215102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:19.215229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.215901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:19.215901 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:19.215901 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:19.215901 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:19.215901 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:19.215901 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:19.215901 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.215901 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:19.217269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.217269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:19.217269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:19.217269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:19.217269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.217269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:19.217269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:19.217269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.217269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:19.217269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:19.217269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:19.217269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.217615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:19.217615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:19.217615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:19.217615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:19.217615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:19.217615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:19.217615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:19.217615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:19.217615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:19.217615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:19.217615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:19.217615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:19.217615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:19.217939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.217939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:19.219228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.219228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:19.219228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:19.219228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:19.219228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:19.219228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:19.219228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.219228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:19.219228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:19.219228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.219228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:19.219228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:19.219228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.219228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:19.219228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:19.219228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:19.219890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:19.220834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:19.220834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:19.220834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:23.724056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:23.724895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:23.724895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:23.726175 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:23.760484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:23.760906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:23.761830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:23.761830 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:23.761830 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:23.761830 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:23.761830 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:23.761830 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:23.761830 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:23.761830 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:23.762824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:23.762824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:23.762824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:23.762824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:23.762824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:23.762824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:23.762824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:23.762824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:23.762824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:23.762824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:23.762824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:23.762824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:23.763498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:23.763498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:23.763498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:23.763498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:23.763498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:23.763498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:23.763498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:23.763498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:23.763498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:23.763498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:23.763498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:23.763498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:23.763498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:23.764219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:23.764219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:23.764219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:23.764219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:23.764219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:23.764219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:23.764219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:23.764219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:23.764219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:23.764219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:23.764219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:23.764219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:23.764219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:23.764219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:23.764219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:23.764994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:23.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:23.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:23.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:23.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:23.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:23.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:24.187895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:24.188308 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:24.188551 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:24.189851 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:24.190274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.191390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:24.191390 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:24.191390 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:24.191390 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:24.191390 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:24.191390 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:24.191390 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.191390 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:24.193061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.193061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:24.193061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:24.193061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:24.193061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.193061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:24.193061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:24.193061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.193061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:24.193061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:24.193061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:24.193061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.193704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:24.193704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:24.193704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:24.193704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:24.193704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:24.193704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:24.193704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:24.193704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:24.193704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:24.193704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:24.193704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:24.193704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:24.193704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:24.194299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.194299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:24.195043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.195043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:24.195043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:24.195043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:24.195043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:24.195043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:24.195043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.195043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:24.195043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:24.195043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.195043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:24.195043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:24.195043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.195043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:24.195043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:24.195043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:24.195939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:24.196841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:24.196841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.196841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:24.196841 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:24.196841 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:24.196841 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:24.196841 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:23:24.196841 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:24.197290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.197642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:24.197642 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:24.197642 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:24.197642 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:24.197642 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:24.197642 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:24.197642 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.197642 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:24.198496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.198496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:24.198496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:24.198496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:24.198496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.198496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:24.198496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:24.198496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:24.198496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.198496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:24.198496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:24.198496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:24.198496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:24.198496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:24.198496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:24.198994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:24.198994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:24.198994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:24.198994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:24.198994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:24.198994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:24.198994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:24.198994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.198994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:24.199582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.199582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:24.199582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:24.199582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:24.199582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.199582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:24.199582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:24.199582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:23:24.199582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:24.199582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:24.199582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.199582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:24.200051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:24.200051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:24.200051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.200051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:24.200051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:24.200051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:24.200051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:24.200051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:24.200051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:24.200051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:24.200051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:24.200051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:24.200051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:24.200051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:24.200465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:24.200465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:24.200465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.200465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:24.200587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.200587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:24.200587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:24.200587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:24.200587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:24.200587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:24.200587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.200587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:24.200587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:24.200587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.200587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:24.200587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:24.200587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.200587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:24.200587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:24.200587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:24.201045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:24.201588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:24.201588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:24.201588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:24.201588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:24.201588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:24.201588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.201588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:24.202556 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:24.202775 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:24.202888 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:24.203045 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:24.203629 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:24.204000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.204807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:24.204807 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:24.204807 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:24.204807 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:24.204807 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:24.204807 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:24.204807 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.204807 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:24.205878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.205878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:24.205878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:24.205878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:24.205878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.205878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:24.205878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:24.205878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:24.205878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.205878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:24.205878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:24.205878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:24.205878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:24.205878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:24.205878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:24.206312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:24.206312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:24.206312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:24.206312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:24.206312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:24.206312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:24.206312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:24.206312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.206312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:24.206889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.206889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:24.206889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:24.206889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:24.206889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.206889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:24.206889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:24.206889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:24.206889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:24.206889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.206889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:24.207232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:24.207232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:24.207232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.207232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:24.207232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:24.207232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:24.207232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:24.207232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:24.207232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:24.207232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:24.207232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:24.207232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:24.207232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:24.207232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:24.207670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:24.207670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:24.207670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.207670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.208108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:24.208620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:24.209153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:24.209153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:24.209153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.209153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:24.213769 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:24.213987 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:24.214105 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:24.214282 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:24.214676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:24.214902 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:24.215026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.215608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:24.215608 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:24.215608 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:24.215608 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:24.215608 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:24.215608 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:24.215608 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.215608 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:24.216612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.216612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:24.216612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:24.216612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:24.216612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.216612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:24.216612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:24.216612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.216612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:24.216612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:24.216612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:24.216612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.217246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:24.217246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:24.217246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:24.217246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:24.217246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:24.217246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:24.217246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:24.217246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:24.217246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:24.217246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:24.217246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:24.217246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:24.217246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:24.217848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.217848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:24.217848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.217848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:24.217848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:24.217848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:24.217848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:24.217848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:24.217848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.217848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:24.217848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:24.217848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.217848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:24.217848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:24.217848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:24.218892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:24.219744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:24.219744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:24.219744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:24.219744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:24.219744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:24.219744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:28.725038 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:28.725892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:28.725892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:28.727224 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:28.763335 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:28.763567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:28.764225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:28.764225 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:28.764225 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:28.764225 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:28.764225 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:28.764225 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:28.764225 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:28.764225 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:28.765146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:28.765146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:28.765146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:28.765146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:28.765146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:28.765146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:28.765146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:28.765146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:28.765146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:28.765146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:28.765146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:28.765146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:28.765823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:28.765823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:28.765823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:28.765823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:28.765823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:28.765823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:28.765823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:28.765823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:28.765823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:28.765823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:28.765823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:28.765823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:28.765823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:28.766427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:28.766427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:28.766427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:28.766427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:28.766427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:28.766427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:28.766427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:28.766427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:28.766427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:28.766427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:28.766427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:28.766427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:28.766427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:28.766427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:28.766427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:28.767144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:28.767980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:28.767980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:28.767980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:28.767980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:28.767980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:28.767980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:29.188993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:29.189914 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:29.189914 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:29.190044 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:29.190275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.190874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:29.190874 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:29.190874 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:29.190874 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:29.190874 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:29.190874 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:29.190874 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.190874 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:29.192642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.192642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:29.192642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:29.192642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:29.192642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.192642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:29.192642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:29.192642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.192642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:29.192642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:29.192642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:29.192642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.193404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:29.193404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:29.193404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:29.193404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:29.193404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:29.193404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:29.193404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:29.193404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:29.193404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:29.193404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:29.193404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:29.193404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:29.193404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:29.193781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.193781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:29.193781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.193781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:29.193781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:29.193781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:29.193781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:29.193781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:29.193781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.193781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:29.193781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:29.193781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.193781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:29.193781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:29.193781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:29.194058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:29.194425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:29.194425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:29.194425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:29.194425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:29.194425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.194425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:29.195442 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:29.195630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:29.195740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:29.195865 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:23:29.196231 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:29.196479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.196967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:29.196967 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:29.196967 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:29.196967 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:29.196967 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:29.196967 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:29.196967 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.196967 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:29.197624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.197624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:29.197624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:29.197624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:29.197624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.197624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:29.197624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:29.197624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:29.197624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.197624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:29.197624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:29.197624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:29.197624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:29.197624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:29.197624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:29.198025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:29.198025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:29.198025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:29.198025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:29.198025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:29.198025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:29.198025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:29.198025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.198025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:29.198465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.198465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:29.198465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:29.198465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:29.198465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.198465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:29.198465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:29.198465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:23:29.198465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:29.198465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:29.198465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.198465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:29.198825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:29.198825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:29.198825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.198825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:29.198825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:29.198825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:29.198825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:29.198825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:29.198825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:29.198825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:29.198825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:29.198825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:29.198825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:29.198825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:29.199246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:29.199246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:29.199246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.199246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:29.199533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.199533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:29.199533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:29.199533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:29.199533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:29.199533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:29.199533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.199533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:29.199533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:29.199533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.199533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:29.199533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:29.199533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.199533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:29.199533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:29.199533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:29.199877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:29.200257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:29.200257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:29.200257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:29.200257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:29.200257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:29.200257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.200257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:29.202816 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:29.202993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:29.203101 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:29.203232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:29.203893 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:29.204101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.204533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:29.204533 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:29.204533 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:29.204533 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:29.204533 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:29.204533 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:29.204533 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.204533 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:29.205632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.205632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:29.205632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:29.205632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:29.205632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.205632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:29.205632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:29.205632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:29.205632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.205632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:29.205632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:29.205632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:29.205632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:29.205632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:29.205632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:29.206225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:29.206225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:29.206225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:29.206225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:29.206225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:29.206225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:29.206225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:29.206225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.206225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:29.206926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.206926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:29.206926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:29.206926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:29.206926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.206926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:29.206926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:29.206926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:29.206926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:29.206926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.206926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:29.207402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:29.207402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:29.207402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.207402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:29.207402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:29.207402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:29.207402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:29.207402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:29.207402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:29.207402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:29.207402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:29.207402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:29.207402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:29.207402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:29.207958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:29.207958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:29.207958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.207958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.208790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:29.209411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:29.210488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:29.210488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:29.210488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.210488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:29.214078 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:29.214313 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:29.214499 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:29.214698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:29.215004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:29.215244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:29.215415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.215866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:29.215866 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:29.215866 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:29.215866 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:29.215866 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:29.215866 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:29.215866 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.215866 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:29.216804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.216804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:29.216804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:29.216804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:29.216804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.216804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:29.216804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:29.216804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.216804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:29.216804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:29.216804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:29.216804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.217334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:29.217334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:29.217334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:29.217334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:29.217334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:29.217334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:29.217334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:29.217334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:29.217334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:29.217334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:29.217334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:29.217334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:29.217334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:29.217881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.217881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:29.218206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.218206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:29.218206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:29.218206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:29.218206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:29.218206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:29.218206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.218206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:29.218206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:29.218206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.218206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:29.218206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:29.218206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.218206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:29.218206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:29.218206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:29.218720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:29.219180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:29.219180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:29.219180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:33.725609 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:33.726753 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:33.726753 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:33.727980 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:33.765816 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:33.766230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:33.767314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:33.767314 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:33.767314 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:33.767314 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:33.767314 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:33.767314 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:33.767314 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:33.767314 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:33.768144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:33.768144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:33.768144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:33.768144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:33.768144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:33.768144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:33.768144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:33.768144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:33.768144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:33.768144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:33.768144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:33.768144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:33.769548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:33.769548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:33.769548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:33.769548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:33.769548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:33.769548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:33.769548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:33.769548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:33.769548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:33.769548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:33.769548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:33.769548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:33.769548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:33.770397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:33.770397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:33.770397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:33.770397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:33.770397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:33.770397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:33.770397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:33.770397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:33.770397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:33.770397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:33.770397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:33.770397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:33.770397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:33.770397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:33.770397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:33.771292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:33.772232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:33.772232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:33.772232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:33.772232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:33.772232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:33.772232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:34.189416 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:34.190057 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:34.190187 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:34.191171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:34.191542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.192392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:34.192392 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:34.192392 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:34.192392 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:34.192392 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:34.192392 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:34.192392 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.192392 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:34.193544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.193544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:34.193544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:34.193544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:34.193544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.193544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:34.193544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:34.193544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.193544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:34.193544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:34.193544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:34.193544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.194180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:34.194180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:34.194180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:34.194180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:34.194180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:34.194180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:34.194180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:34.194180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:34.194180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:34.194180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:34.194180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:34.194180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:34.194180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:34.194954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.194954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:34.194954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.194954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:34.194954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:34.194954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:34.194954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:34.194954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:34.194954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.194954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:34.194954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:34.194954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.194954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:34.194954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:34.194954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:34.195671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:34.196604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:34.196604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:34.196604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:34.196604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:34.196604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.196604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:34.196604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:34.196604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:34.196604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:34.196604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:23:34.197081 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:34.197081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.197911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:34.197911 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:34.197911 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:34.197911 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:34.197911 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:34.197911 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:34.197911 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.197911 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:34.199196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.199196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:34.199196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:34.199196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:34.199196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.199196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:34.199196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:34.199196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:34.199196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.199196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:34.199196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:34.199196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:34.199196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:34.199196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:34.199196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:34.199837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:34.199837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:34.199837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:34.199837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:34.199837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:34.199837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:34.199837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:34.199837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.199837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:34.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:34.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:34.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:34.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:34.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:34.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:23:34.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:34.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:34.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.200154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:34.200544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:34.200544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:34.200544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.200544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:34.200544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:34.200544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:34.200544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:34.200544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:34.200544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:34.200544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:34.200544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:34.200544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:34.200544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:34.200544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:34.201136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:34.201136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:34.201136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.201136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:34.201613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.201613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:34.201613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:34.201613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:34.201613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:34.201613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:34.201613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.201613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:34.201613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:34.201613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.201613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:34.201613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:34.201613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.201613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:34.201613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:34.201613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:34.202334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:34.203079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:34.203079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:34.203079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:34.203079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:34.203079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:34.203079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.203079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:34.203342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:34.203578 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:34.203716 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:34.203902 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:34.204488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:34.204901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.205735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:34.205735 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:34.205735 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:34.205735 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:34.205735 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:34.205735 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:34.205735 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.205735 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:34.206680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.206680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:34.206680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:34.206680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:34.206680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.206680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:34.206680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:34.206680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:34.206680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.206680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:34.206680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:34.206680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:34.206680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:34.206680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:34.206680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:34.207227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:34.207227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:34.207227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:34.207227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:34.207227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:34.207227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:34.207227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:34.207227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.207227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:34.207905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.207905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:34.207905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:34.207905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:34.207905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.207905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:34.207905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:34.207905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:34.207905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:34.207905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.207905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:34.208343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:34.208343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:34.208343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.208343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:34.208343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:34.208343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:34.208343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:34.208343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:34.208343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:34.208343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:34.208343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:34.208343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:34.208343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:34.208343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:34.208886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:34.208886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:34.208886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.208886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.209385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:34.210087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:34.210799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:34.210799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:34.210799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.210799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:34.214525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:34.214949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:34.215106 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:34.215345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:34.215780 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:34.216073 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:34.216247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.216832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:34.216832 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:34.216832 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:34.216832 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:34.216832 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:34.216832 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:34.216832 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.216832 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:34.217665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.217665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:34.217665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:34.217665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:34.217665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.217665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:34.217665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:34.217665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.217665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:34.217665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:34.217665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:34.217665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.217994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:34.217994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:34.217994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:34.217994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:34.217994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:34.217994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:34.217994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:34.217994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:34.217994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:34.217994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:34.217994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:34.217994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:34.217994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:34.218348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.218348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:34.218752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.218752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:34.218752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:34.218752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:34.218752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:34.218752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:34.218752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.218752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:34.218752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:34.218752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.218752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:34.218752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:34.218752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.218752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:34.218752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:34.218752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:34.219240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:34.219735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:34.219735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:34.219735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:38.726297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:38.727129 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:38.727129 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:38.728672 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:38.764497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:38.764889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:38.765901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:38.765901 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:38.765901 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:38.765901 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:38.765901 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:38.765901 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:38.765901 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:38.765901 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:38.767600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:38.767600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:38.767600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:38.767600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:38.767600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:38.767600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:38.767600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:38.767600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:38.767600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:38.767600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:38.767600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:38.767600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:38.768492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:38.768492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:38.768492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:38.768492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:38.768492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:38.768492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:38.768492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:38.768492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:38.768492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:38.768492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:38.768492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:38.768492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:38.768492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:38.769224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:38.769224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:38.769401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:38.769401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:38.769401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:38.769401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:38.769401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:38.769401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:38.769401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:38.769401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:38.769401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:38.769401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:38.769401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:38.769401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:38.769401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:38.769401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:38.769401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:38.769401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:38.770409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:38.771642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:38.771642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:38.771642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:39.190069 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:39.190837 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:39.190996 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:39.192664 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:39.192951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.193740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:39.193740 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:39.193740 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:39.193740 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:39.193740 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:39.193740 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:39.193740 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.193740 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:39.195322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.195322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:39.195322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:39.195322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:39.195322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.195322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:39.195322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:39.195322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.195322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:39.195322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:39.195322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:39.195322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.195702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:39.195702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:39.195702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:39.195702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:39.195702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:39.195702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:39.195702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:39.195702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:39.195702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:39.195702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:39.195702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:39.195702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:39.195702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:39.196044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.196044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:39.197878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.197878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:39.197878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:39.197878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:39.197878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:39.197878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:39.197878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.197878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:39.197878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:39.197878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.197878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:39.197878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:39.197878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.197878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:39.197878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:39.197878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:39.198335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:39.198943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:39.198943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.198943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:39.198943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:39.198943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:39.198943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:39.199187 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:23:39.199808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:39.200012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.200851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:39.200851 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:39.200851 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:39.200851 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:39.200851 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:39.200851 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:39.200851 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.200851 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:39.201612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.201612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:39.201612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:39.201612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:39.201612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.201612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:39.201612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:39.201612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:39.201612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.201612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:39.201612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:39.201612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:39.201612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:39.201612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:39.201612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:39.202492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:39.202492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:39.202492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:39.202492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:39.202492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:39.202492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:39.202492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:39.202492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.202492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:39.202492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.202492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:39.202492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:39.202492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:39.202492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.203458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:39.203458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:39.203458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:23:39.203458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:39.203458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:39.203458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.203458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:39.203458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:39.203458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:39.203458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.203458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:39.203458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:39.203458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:39.204305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:39.204305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:39.204305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:39.204305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:39.204305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:39.204305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:39.204305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:39.204305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:39.204305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:39.204305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:39.204305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.204305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:39.204940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.204940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:39.204940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:39.204940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:39.204940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:39.204940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:39.204940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.204940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:39.204940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:39.204940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.204940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:39.204940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:39.204940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.204940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:39.204940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:39.204940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:39.205533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:39.206209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:39.206209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:39.206209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:39.206209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:39.206209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:39.206209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.206209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:39.206209 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:39.206209 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:39.206209 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:39.206620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:39.206620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:39.206620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.206620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:39.206620 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:39.206620 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:39.206620 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:39.206620 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:39.206620 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:39.206620 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.206620 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:39.207334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.207334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:39.207334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:39.207334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:39.207334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.207334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:39.207334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:39.207334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:39.207334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.207334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:39.207334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:39.207334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:39.207334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:39.207334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:39.207334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:39.207964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:39.207964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:39.207964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:39.207964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:39.207964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:39.207964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:39.207964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:39.207964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.207964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:39.208479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.208479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:39.208479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:39.208479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:39.208479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.208479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:39.208479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:39.208479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:39.208479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:39.208479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.208479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:39.208933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:39.208933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:39.208933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.208933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:39.208933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:39.208933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:39.208933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:39.208933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:39.208933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:39.208933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:39.208933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:39.208933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:39.208933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:39.208933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:39.209473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:39.209473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:39.209473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.209473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.209774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:39.210466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:39.211131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:39.211131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:39.211131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.211131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:39.215033 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:39.215277 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:39.215378 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:39.215496 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:39.215816 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:39.216034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:39.216177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.216682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:39.216682 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:39.216682 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:39.216682 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:39.216682 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:39.216682 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:39.216682 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.216682 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:39.217272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.217272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:39.217272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:39.217272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:39.217272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.217272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:39.217272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:39.217272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.217272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:39.217272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:39.217272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:39.217272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.217539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:39.217539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:39.217539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:39.217539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:39.217539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:39.217539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:39.217539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:39.217539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:39.217539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:39.217539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:39.217539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:39.217539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:39.217539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:39.217772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.217772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:39.218006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.218006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:39.218006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:39.218006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:39.218006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:39.218006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:39.218006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.218006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:39.218006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:39.218006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.218006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:39.218006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:39.218006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.218006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:39.218006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:39.218006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:39.218294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:39.218703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:39.218703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:39.218703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:43.727431 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:43.728215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:43.728215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:43.729625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:43.763679 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:43.764153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:43.765141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:43.765141 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:43.765141 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:43.765141 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:43.765141 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:43.765141 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:43.765141 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:43.765141 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:43.766032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:43.766032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:43.766032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:43.766032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:43.766032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:43.766032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:43.766032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:43.766032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:43.766032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:43.766032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:43.766032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:43.766032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:43.766924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:43.766924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:43.766924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:43.766924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:43.766924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:43.766924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:43.766924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:43.766924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:43.766924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:43.766924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:43.766924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:43.766924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:43.766924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:43.767548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:43.767548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:43.767548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:43.767548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:43.767548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:43.767548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:43.767548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:43.767548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:43.767548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:43.767548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:43.767548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:43.767548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:43.767548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:43.767548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:43.767548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:43.768219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:43.769015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:43.769015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:43.769015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:43.769015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:43.769015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:43.769015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:44.190894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:44.191242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:44.191322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:44.192177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:44.192350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.192871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:44.192871 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:44.192871 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:44.192871 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:44.192871 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:44.192871 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:44.192871 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.192871 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:44.194021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.194021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:44.194021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:44.194021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:44.194021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.194021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:44.194021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:44.194021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.194021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:44.194021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:44.194021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:44.194021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.194471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:44.194471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:44.194471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:44.194471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:44.194471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:44.194471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:44.194471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:44.194471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:44.194471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:44.194471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:44.194471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:44.194471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:44.194471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:44.194839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.194839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:44.195130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.195130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:44.195130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:44.195130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:44.195130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:44.195130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:44.195130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.195130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:44.195130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:44.195130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.195130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:44.195130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:44.195130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.195130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:44.195130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:44.195130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:44.195673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:44.196264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:44.196264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.196264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:44.198612 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:44.198847 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:44.198960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:44.199085 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:23:44.199541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:44.199798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.200442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:44.200442 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:44.200442 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:44.200442 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:44.200442 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:44.200442 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:44.200442 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.200442 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:44.201226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.201226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:44.201226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:44.201226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:44.201226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.201226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:44.201226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:44.201226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:44.201226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.201226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:44.201226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:44.201226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:44.201226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:44.201226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:44.201226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:44.201662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:44.201662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:44.201662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:44.201662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:44.201662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:44.201662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:44.201662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:44.201662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.201662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:44.202182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.202182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:44.202182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:44.202182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:44.202182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.202182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:44.202182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:44.202182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:23:44.202182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:44.202182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:44.202182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.202182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:44.202627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:44.202627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:44.202627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.202627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:44.202627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:44.202627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:44.202627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:44.202627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:44.202627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:44.202627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:44.202627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:44.202627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:44.202627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:44.202627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:44.203081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:44.203081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:44.203081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.203081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:44.203346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.203346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:44.203346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:44.203346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:44.203346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:44.203346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:44.203346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.203346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:44.203346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:44.203346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.203346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:44.203346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:44.203346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.203346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:44.203346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:44.203346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:44.203796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:44.204306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:44.204306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:44.204306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:44.204306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:44.204306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:44.204306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.204306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:44.204521 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:44.204977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:44.205098 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:44.205343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:44.205635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:44.205836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.206247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:44.206247 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:44.206247 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:44.206247 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:44.206247 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:44.206247 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:44.206247 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.206247 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:44.207026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.207026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:44.207026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:44.207026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:44.207026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.207026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:44.207026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:44.207026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:44.207026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.207026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:44.207026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:44.207026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:44.207026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:44.207026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:44.207026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:44.207522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:44.207522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:44.207522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:44.207522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:44.207522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:44.207522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:44.207522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:44.207522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.207522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:44.207927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.207927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:44.207927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:44.207927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:44.207927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.207927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:44.207927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:44.207927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:44.207927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:44.207927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.207927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:44.208241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:44.208241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:44.208241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.208241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:44.208241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:44.208241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:44.208241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:44.208241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:44.208241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:44.208241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:44.208241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:44.208241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:44.208241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:44.208241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:44.208604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:44.208604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:44.208604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.208604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.209021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:44.209488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:44.209995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:44.209995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:44.209995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.209995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:44.215335 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:44.215545 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:44.215658 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:44.215810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:44.216204 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:44.216561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:44.216720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.217330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:44.217330 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:44.217330 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:44.217330 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:44.217330 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:44.217330 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:44.217330 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.217330 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:44.218479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.218479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:44.218479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:44.218479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:44.218479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.218479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:44.218479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:44.218479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.218479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:44.218479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:44.218479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:44.218479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.218828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:44.218828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:44.218828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:44.218828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:44.218828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:44.218828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:44.218828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:44.218828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:44.218828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:44.218828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:44.218828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:44.218828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:44.218828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:44.219153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.219153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:44.220166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.220166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:44.220166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:44.220166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:44.220166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:44.220166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:44.220166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.220166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:44.220166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:44.220166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.220166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:44.220166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:44.220166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.220166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:44.220166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:44.220166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:44.220618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:44.221104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:44.221104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:44.221104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:48.728102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:48.728828 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:48.728991 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:48.730402 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:48.765449 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:48.766125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:48.769231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:48.769231 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:48.769231 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:48.769231 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:48.769231 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:48.769231 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:48.769231 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:48.769231 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:48.769231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:48.769231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:48.769231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:48.769231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:48.769231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:48.769231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:48.769231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:48.769831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:48.769831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:48.769831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:48.769831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:48.769831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:48.769831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:48.769831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:48.769831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:48.769831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:48.769831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:48.769831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:48.769831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:48.769831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:48.769831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:48.770222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:48.770222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:48.770222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:48.770222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:48.770222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:48.770222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:48.770222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:48.770222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:48.770222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:48.770222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:48.770222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:48.770222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:48.770222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:48.770222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:48.770633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:48.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:48.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:48.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:48.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:48.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:48.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:48.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:48.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:48.771189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:49.191688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:49.192322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:49.193076 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:49.195568 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:49.195824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.196838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:49.196838 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:49.196838 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:49.196838 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:49.196838 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:49.196838 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:49.196838 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.196838 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:49.198594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.198594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:49.198594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:49.198594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:49.198594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.198594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:49.198594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:49.198594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.198594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:49.198594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:49.198594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:49.198594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.199022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:49.199022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:49.199022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:49.199022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:49.199022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:49.199022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:49.199022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:49.199022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:49.199022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:49.199022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:49.199022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:49.199022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:49.199022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:49.199427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.199427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:49.200648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.200648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:49.200648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:49.200648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:49.200648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:49.200648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:49.200648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.200648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:49.200648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:49.200648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.200648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:49.200648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:49.200648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.200648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:49.200648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:49.200648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:49.201110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:49.201800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:49.201800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.201800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:49.202643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:49.203006 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:49.205361 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:49.205361 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:23:49.205361 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:49.205361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.205361 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:49.205569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:49.205569 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:49.205569 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:49.205569 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:49.205569 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:49.205569 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:49.205569 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.205569 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:49.206194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.206194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:49.206194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:49.206194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:49.206194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.206194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:49.206194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:49.206194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:49.206194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.206194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:49.206194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:49.206194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:49.206194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:49.206194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:49.206194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:49.206620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:49.206620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:49.206620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:49.206620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:49.206620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:49.206620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:49.206620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:49.206620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.206620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:49.207104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.207104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:49.207104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:49.207104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:49.207104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.207104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:49.207104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:49.207104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:23:49.207104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:49.207104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:49.207104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.207104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:49.207521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:49.207521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:49.207521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.207521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:49.207521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:49.207521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:49.207521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:49.207521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:49.207521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:49.207521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:49.207521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:49.207521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:49.207521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:49.207521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:49.207901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:49.207901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:49.207901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.207901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:49.208139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.208139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:49.208139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:49.208139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:49.208139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:49.208139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:49.208139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.208139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:49.208139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:49.208139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.208139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:49.208139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:49.208139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.208139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:49.208139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:49.208139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:49.208612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:49.209110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:49.209110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:49.209110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:49.209110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:49.209110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:49.209110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.209110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:49.209110 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:49.209110 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:49.209110 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:49.209423 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:49.209550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.210224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:49.210224 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:49.210224 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:49.210224 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:49.210224 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:49.210224 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:49.210224 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.210224 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:49.210939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.210939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:49.210939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:49.210939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:49.210939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.210939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:49.210939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:49.210939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:49.210939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.210939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:49.210939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:49.210939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:49.210939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:49.210939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:49.210939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:49.211858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:49.211858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:49.211858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:49.211858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:49.211858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:49.211858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:49.211858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:49.211858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.211858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:49.212170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.212170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:49.212170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:49.212170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:49.212170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.212170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:49.212170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:49.212170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:49.212170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:49.212170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.212170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:49.212628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:49.212628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:49.212628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.212628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:49.212628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:49.212628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:49.212628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:49.212628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:49.212628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:49.212628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:49.212628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:49.212628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:49.212628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:49.212628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:49.213233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:49.213233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:49.213233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.213233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:49.213233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.213233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:49.213233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:49.213233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:49.213233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:49.213233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:49.213233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.213233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:49.213233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:49.213233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:49.213718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:49.214258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:49.214258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:49.214258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:49.214258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:49.214258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:49.214258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:49.214258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:49.214258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:49.214258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:49.214258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.214258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:49.215606 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:49.215785 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:49.215879 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:49.216026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:49.216361 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:49.216617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:49.216726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.217241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:49.217241 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:49.217241 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:49.217241 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:49.217241 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:49.217241 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:49.217241 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.217241 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:49.218536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.218536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:49.218536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:49.218536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:49.218536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.218536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:49.218536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:49.218536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.218536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:49.218536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:49.218536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:49.218536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.219657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:49.219657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:49.219657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:49.219657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:49.219657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:49.219657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:49.219657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:49.219657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:49.219657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:49.219657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:49.219657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:49.219657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:49.219657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:49.220345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.220345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:49.220345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.220345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:49.220345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:49.220345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:49.220345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:49.220345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:49.220345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.220345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:49.220345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:49.220345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.220345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:49.220345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:49.220345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:49.221279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:49.222737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:49.222737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:49.222737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:49.222737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:49.222737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:49.222737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:53.728752 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:53.729706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:53.729706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:53.731101 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:53.732778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:23:53.763747 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:53.764066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:53.764830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:53.764830 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:53.764830 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:53.764830 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:53.764830 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:53.764830 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:53.764830 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:53.764830 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:53.765547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:53.765547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:53.765547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:53.765547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:53.765547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:53.765547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:53.765547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:53.765547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:53.765547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:53.765547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:53.765547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:53.765547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:53.766146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:53.766146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:53.766146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:53.766146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:53.766146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:53.766146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:53.766146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:53.766146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:53.766146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:53.766146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:53.766146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:53.766146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:53.766146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:53.766823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:53.766823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:53.766823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:53.766823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:53.766823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:53.766823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:53.766823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:53.766823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:53.766823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:53.766823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:53.766823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:53.766823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:53.766823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:53.766823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:53.766823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:53.767561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:53.768622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:53.768622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:53.768622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:53.768622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:53.768622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:53.768622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:54.192183 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:54.192476 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:54.192556 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:54.193794 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:54.193940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.194326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:54.194326 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:54.194326 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:54.194326 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:54.194326 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:54.194326 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:54.194326 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.194326 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:54.195015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.195015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:54.195015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:54.195015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:54.195015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.195015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:54.195015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:54.195015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.195015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:54.195015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:54.195015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:54.195015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.195859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:54.195859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:54.195859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:54.195859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:54.195859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:54.195859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:54.195859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:54.195859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:54.195859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:54.195859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:54.195859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:54.195859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:54.195859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:54.196601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.196601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:54.196601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.196601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:54.196601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:54.196601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:54.196601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:54.196601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:54.196601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.196601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:54.196601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:54.196601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.196601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:54.196601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:54.196601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:54.197622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:54.198514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:54.198514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:54.198514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:54.198514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:54.198514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.198514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:54.203255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:54.203733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:54.203930 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:54.204136 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:23:54.204551 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:54.204736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.205349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:54.205349 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:54.205349 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:54.205349 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:54.205349 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:54.205349 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:54.205349 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.205349 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:54.206919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.206919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:54.206919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:54.206919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:54.206919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.206919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:54.206919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:54.206919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:54.206919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.206919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:54.206919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:54.206919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:54.206919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:54.206919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:54.206919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:54.207475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:54.207475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:54.207475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:54.207475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:54.207475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:54.207475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:54.207475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:54.207475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.207475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:54.209200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.209200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:54.209200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:54.209200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:54.209200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.209200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:54.209200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:54.209200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:23:54.209200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:54.209200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:54.209200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.209200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:54.209882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:54.209882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:54.209882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.209882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:54.209882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:54.209882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:54.209882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:54.209882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:54.209882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:54.209882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:54.209882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:54.209882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:54.209882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:54.209882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:54.210596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:54.210596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:54.210596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.210596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:54.210596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:54.211325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.211325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:54.211325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:54.211325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:54.211325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:54.211325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:54.211325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.211325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:54.211325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:54.211325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.211325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:54.211325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:54.211325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.211325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:54.211325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:54.211325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:54.212055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:54.212947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:54.212947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:54.212947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:54.212947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:54.212947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:54.212947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.212947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:54.212947 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:54.212947 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:54.212947 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:54.213462 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:54.213462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.214030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:54.214030 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:54.214030 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:54.214030 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:54.214030 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:54.214030 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:54.214030 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.214030 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:54.214714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.214714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:54.214714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:54.214714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:54.214714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.214714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:54.214714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:54.214714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:54.214714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.214714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:54.214714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:54.214714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:54.214714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:54.214714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:54.214714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:54.215423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:54.215423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:54.215423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:54.215423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:54.215423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:54.215423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:54.215423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:54.215423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.215423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:54.215423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.215423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:54.215423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:54.215423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:54.215423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.215995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:54.215995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:54.215995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:54.215995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:54.215995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.215995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:54.215995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:54.215995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:54.215995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.215995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:54.215995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:54.215995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:54.215995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:54.216549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:54.216549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:54.216549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:54.216549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:54.216549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:54.216549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:54.216549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:54.216549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:54.216549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:54.216549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.216549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:54.216549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:54.217062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.217558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:54.218070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:54.218070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:54.218070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:54.218070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:54.218070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:54.218070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:54.218254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.218702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:54.218702 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:54.218702 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:54.218702 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:54.218702 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:54.218702 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:54.218702 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.218702 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:54.219318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.219318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:54.219318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:54.219318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:54.219318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.219318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:54.219318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:54.219318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.219318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:54.219318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:54.219318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:54.219318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.219667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:54.219667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:54.219667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:54.219667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:54.219667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:54.219667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:54.219667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:54.219667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:54.219667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:54.219667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:54.219667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:54.219667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:54.219667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:54.220078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.220078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:54.220236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.220236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:54.220236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:54.220236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:54.220236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:54.220236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:54.220236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.220236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:54.220236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:54.220236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.220236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:54.220236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:54.220236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.220236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:54.220236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:54.220236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:54.220737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:54.221211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:54.221211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:54.221211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:58.729353 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:58.730058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:58.730058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:58.731560 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:58.766679 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:58.767443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:58.768407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:58.768407 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:58.768407 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:58.768407 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:58.768407 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:58.768407 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:58.768407 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:58.768407 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:58.769145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:58.769145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:58.769145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:58.769145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:58.769145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:58.769145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:58.769145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:58.769145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:58.769145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:58.769145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:58.769145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:58.769145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:58.769557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:58.769557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:58.769557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:58.769557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:58.769557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:58.769557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:58.769557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:58.769557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:58.769557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:58.769557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:58.769557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:58.769557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:58.769557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:58.769958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:58.769958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:58.769958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:58.769958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:58.769958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:58.769958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:58.769958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:58.769958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:58.769958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:58.769958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:58.769958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:58.769958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:58.769958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:58.769958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:58.769958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:58.770415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:58.771067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:58.771067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:58.771067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:58.771067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:58.771067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:58.771067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:59.192727 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:59.193285 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:59.193492 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:59.194682 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:59.195010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.195706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:59.195706 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:59.195706 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:59.195706 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:59.195706 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:59.195706 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:59.195706 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.195706 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:59.197167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.197167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:59.197167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:59.197167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:59.197167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.197167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:59.197167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:59.197167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.197167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:59.197167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:59.197167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:59.197167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.197680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:59.197680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:59.197680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:59.197680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:59.197680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:59.197680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:59.197680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:59.197680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:59.197680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:59.197680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:59.197680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:59.197680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:59.197680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:59.198109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.198109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:59.198979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.198979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:59.198979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:59.198979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:59.198979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:59.198979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:59.198979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.198979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:59.198979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:59.198979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.198979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:59.198979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:59.198979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.198979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:59.198979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:59.198979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:59.199757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:59.200315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:59.200315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.200315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:59.203692 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:59.203967 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:59.204078 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:59.204203 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:23:59.204780 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:59.205032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.205639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:59.205639 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:59.205639 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:59.205639 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:59.205639 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:59.205639 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:59.205639 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.205639 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:59.206477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.206477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:59.206477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:59.206477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:59.206477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.206477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:59.206477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:59.206477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:59.206477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.206477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:59.206477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:59.206477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:59.206477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:59.206477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:59.206477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:59.207000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:59.207000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:59.207000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:59.207000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:59.207000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:59.207000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:59.207000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:59.207000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.207000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:59.207627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.207627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:59.207627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:59.207627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:59.207627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.207627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:59.207627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:59.207627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:23:59.207627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:59.207627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:59.207627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.207627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:59.208010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:59.208010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:59.208010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.208010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:59.208010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:59.208010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:59.208010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:59.208010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:59.208010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:59.208010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:59.208010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:59.208010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:59.208010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:59.208010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:59.208434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:59.208434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:59.208434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.208434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:59.209213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.209213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:59.209213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:59.209213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:59.209213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:59.209213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:59.209213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.209213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:59.209213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:59.209213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.209213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:59.209213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:59.209213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.209213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:59.209213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:59.209213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:59.209730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:59.210260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:59.210260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:59.210260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:59.210260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:59.210260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:59.210260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.210260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:59.211714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:59.212038 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:59.212209 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:59.212444 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:59.212907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:59.213216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.213947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:59.213947 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:59.213947 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:59.213947 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:59.213947 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:59.213947 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:59.213947 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.213947 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:59.215119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.215119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:23:59.215119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:59.215119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:59.215119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.215119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:59.215119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:59.215119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:59.215119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.215119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:23:59.215119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:59.215119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:23:59.215119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:59.215119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:23:59.215119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:23:59.215678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:59.215678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:23:59.215678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:59.215678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:23:59.215678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:23:59.215678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:59.215678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:23:59.215678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.215678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:23:59.216568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.216568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:59.216568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:59.216568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:59.216568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.216568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:59.216568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:59.216568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:59.216568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:59.216568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.216568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:59.216878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:59.216878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:59.216878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.216878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:59.216878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:59.216878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:59.216878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:59.216878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:59.216878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:59.216878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:59.216878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:59.216878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:59.216878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:59.216878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:59.217244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:59.217244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:59.217244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.217244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.218279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:59.218773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:59.219459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:59.219459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:59.219459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.219459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:23:59.219459 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:23:59.219459 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:23:59.219459 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:23:59.219459 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:23:59.219777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:59.219777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:23:59.219907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:23:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:23:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:23:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:23:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:23:59.221171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.221171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:23:59.221171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:59.221171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:23:59.221171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.221171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:59.221171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:59.221171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.221171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:59.221171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:59.221171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:59.221171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.221523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:23:59.221523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:59.221523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:23:59.221523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:59.221523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:23:59.221523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:23:59.221523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:59.221523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:23:59.221523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:59.221523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:23:59.221523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:23:59.221523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:59.221523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:23:59.221927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.221927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:23:59.222177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.222177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:23:59.222177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:23:59.222177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:23:59.222177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:23:59.222177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:23:59.222177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.222177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:23:59.222177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:23:59.222177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.222177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:23:59.222177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:23:59.222177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.222177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:23:59.222177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:23:59.222177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:23:59.222666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:23:59.223163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:23:59.223163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:23:59.223163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:03.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:03.730470 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:03.730814 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:03.731828 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:03.770420 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:03.770420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:03.771170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:03.771170 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:03.771170 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:03.771170 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:03.771170 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:03.771170 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:03.771170 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:03.771170 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:03.772226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:03.772226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:03.772226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:03.772226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:03.772226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:03.772226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:03.772226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:03.772226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:03.772226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:03.772226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:03.772226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:03.772226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:03.772793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:03.772793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:03.772793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:03.772793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:03.772793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:03.772793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:03.772793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:03.772793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:03.772793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:03.772793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:03.772793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:03.772793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:03.772793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:03.773295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:03.773295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:03.773295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:03.773295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:03.773295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:03.773295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:03.773295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:03.773295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:03.773295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:03.773295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:03.773295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:03.773295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:03.773295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:03.773295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:03.773295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:03.773923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:03.774649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:03.774649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:03.774649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:03.774649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:03.774649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:03.774649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:04.193995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:04.194818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:04.194929 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:04.196194 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:04.196568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.196926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:04.196926 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:04.196926 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:04.196926 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:04.196926 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:04.196926 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:04.196926 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.196926 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:04.200215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.200215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:04.200215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:04.200215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:04.200215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.200215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:04.200215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:04.200215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.200215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:04.200215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:04.200215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:04.200215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.200644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:04.200644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:04.200644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:04.200644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:04.200644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:04.200644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:04.200644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:04.200644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:04.200644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:04.200644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:04.200644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:04.200644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:04.200644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:04.200872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.200872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:04.201955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.201955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:04.201955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:04.201955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:04.201955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:04.201955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:04.201955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.201955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:04.201955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:04.201955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.201955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:04.201955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:04.201955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.201955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:04.201955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:04.201955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:04.202305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:04.202894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:04.202894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.202894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:04.204140 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:04.204613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:04.204613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:04.204681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:24:04.204970 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:04.205131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.205540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:04.205540 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:04.205540 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:04.205540 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:04.205540 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:04.205540 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:04.205540 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.205540 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:04.206300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.206300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:04.206300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:04.206300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:04.206300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.206300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:04.206300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:04.206300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:04.206300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.206300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:04.206300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:04.206300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:04.206300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:04.206300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:04.206300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:04.206644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:04.206644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:04.206644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:04.206644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:04.206644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:04.206644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:04.206644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:04.206644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.206644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:04.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:04.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:04.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:04.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:04.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:04.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:24:04.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:04.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:04.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.207178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:04.207461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:04.207461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:04.207461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.207461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:04.207461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:04.207461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:04.207461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:04.207461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:04.207461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:04.207461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:04.207461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:04.207461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:04.207461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:04.207461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:04.207714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:04.207714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:04.207714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.207714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:04.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:04.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:04.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:04.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:04.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:04.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:04.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:04.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:04.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:04.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:04.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:04.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:04.208706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:04.209067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:04.209067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:04.209067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:04.209067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:04.209067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:04.209067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.209067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:04.213195 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:04.213594 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:04.213713 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:04.213847 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:04.214310 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:04.214609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.215531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:04.215531 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:04.215531 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:04.215531 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:04.215531 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:04.215531 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:04.215531 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.215531 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:04.216319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.216319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:04.216319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:04.216319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:04.216319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.216319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:04.216319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:04.216319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:04.216319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.216319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:04.216319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:04.216319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:04.216319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:04.216319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:04.216319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:04.216988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:04.216988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:04.216988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:04.216988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:04.216988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:04.216988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:04.216988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:04.216988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.216988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:04.217337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.217337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:04.217337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:04.217337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:04.217337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.217337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:04.217337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:04.217337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:04.217337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:04.217337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.217337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:04.217803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:04.217803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:04.217803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.217803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:04.217803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:04.217803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:04.217803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:04.217803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:04.217803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:04.217803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:04.217803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:04.217803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:04.217803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:04.217803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:04.218316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:04.218316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:04.218316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.218316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.218765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:04.219491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:04.220163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:04.220163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:04.220163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.220163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:04.220851 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:04.221103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:04.221200 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:04.221396 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:04.222027 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:04.222332 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:04.222482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.223283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:04.223283 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:04.223283 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:04.223283 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:04.223283 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:04.223283 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:04.223283 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.223283 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:04.224173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.224173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:04.224173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:04.224173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:04.224173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.224173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:04.224173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:04.224173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.224173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:04.224173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:04.224173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:04.224173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.224629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:04.224629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:04.224629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:04.224629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:04.224629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:04.224629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:04.224629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:04.224629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:04.224629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:04.224629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:04.224629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:04.224629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:04.224629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:04.225024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.225024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:04.225183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.225183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:04.225183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:04.225183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:04.225183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:04.225183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:04.225183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.225183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:04.225183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:04.225183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.225183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:04.225183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:04.225183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.225183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:04.225183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:04.225183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:04.225637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:04.226108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:04.226108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:04.226108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:07.096586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=986bc0c3-dcbb-40cb-a9ac-326c0639eeed, enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355', 'neutron:subnet_ids': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7 4daf396b-50dc-4100-9154-fd24fc0e5f1d'}, gateway_chassis=[], ha_chassis_group=d76fbafd-8edb-4449-bc9a-74c25bacc37f, ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:fa:98:92', name='lrp-77659748-a2b4-448f-aa2d-e166be8f2be9', networks=['172.24.5.167/24', '2001:db8::1b3/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=106381) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 24 10:24:08.730327 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:08.731019 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:08.731181 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:08.732447 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:08.766440 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:08.766911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:08.767868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:08.767868 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:08.767868 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:08.767868 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:08.767868 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:08.767868 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:08.767868 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:08.767868 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:08.768655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:08.768655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:08.768655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:08.768655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:08.768655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:08.768655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:08.768655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:08.768655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:08.768655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:08.768655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:08.768655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:08.768655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:08.769192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:08.769192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:08.769192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:08.769192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:08.769192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:08.769192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:08.769192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:08.769192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:08.769192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:08.769192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:08.769192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:08.769192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:08.769192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:08.769859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:08.769859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:08.769859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:08.769859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:08.769859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:08.769859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:08.769859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:08.769859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:08.769859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:08.769859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:08.769859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:08.769859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:08.769859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:08.769859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:08.769859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:08.770529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:08.771421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:08.771421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:08.771421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:08.771421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:08.771421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:08.771421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:09.079434 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=2beff6c5-e10b-4996-b22d-6345376f2a5e, enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355', 'neutron:subnet_ids': 'a3090689-5a84-48d5-9685-f418bb1fd559'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:e8:86:4d', name='lrp-bdf74d8f-c6f5-494e-8930-c04f3f6e0754', networks=['192.168.24.1/24'], options={}, peer=[], status={}) old= {{(pid=106381) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 24 10:24:09.113906 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a synchronized; highest priority chassis 6fdfe3a3-a87b-4dc6-9165-fd6037b04f84
Apr 24 10:24:09.114504 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': 'b30b34a1-477c-4ef7-aea4-d9540988f10a', 'neutron:router_id': '931f18d3-b7f8-4874-928b-3c06d4d5d355'}}) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:09.114937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a, chassis=6fdfe3a3-a87b-4dc6-9165-fd6037b04f84, priority=1, columns={}) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:09.115269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.115934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 24 10:24:09.115934 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:09.115934 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:09.115934 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:09.115934 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:09.115934 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:09.115934 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.115934 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event Traceback (most recent call last):
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     match.run(event, row, updates)
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 86, in run
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.link_network_ha_chassis_group(
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2411, in link_network_ha_chassis_group
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     next(self.gen)
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     next(self.gen)
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     with self.create_transaction(
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     self.result = self.commit()
Apr 24 10:24:09.116697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Apr 24 10:24:09.117532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:09.117532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     raise result.ex
Apr 24 10:24:09.117532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:09.117532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Apr 24 10:24:09.117532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Apr 24 10:24:09.117532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:09.117532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Apr 24 10:24:09.117532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.117532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.event 
Apr 24 10:24:09.194908 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:09.195478 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:09.195581 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:09.196518 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:09.196805 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:09.197043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.197903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:09.197903 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:09.197903 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:09.197903 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:09.197903 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:09.197903 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:09.197903 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.197903 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:09.198897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.198897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:09.198897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:09.198897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:09.198897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.198897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:09.198897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:09.198897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.198897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:09.198897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:09.198897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:09.198897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.199616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:09.199616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:09.199616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:09.199616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:09.199616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:09.199616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:09.199616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:09.199616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:09.199616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:09.199616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:09.199616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:09.199616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:09.199616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:09.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:09.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:09.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:09.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:09.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:09.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:09.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:09.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:09.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:09.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:09.200212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:09.200965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:09.201982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:09.201982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:09.201982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:09.201982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:09.201982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.201982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:09.204488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:09.204745 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:09.204857 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:09.205030 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:24:09.205421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:09.205743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.206396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:09.206396 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:09.206396 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:09.206396 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:09.206396 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:09.206396 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:09.206396 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.206396 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:09.207133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.207133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:09.207133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:09.207133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:09.207133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.207133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:09.207133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:09.207133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:09.207133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.207133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:09.207133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:09.207133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:09.207133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:09.207133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:09.207133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:09.207948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:09.207948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:09.207948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:09.207948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:09.207948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:09.207948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:09.207948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:09.207948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.207948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:09.207948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.207948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:09.207948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:09.207948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:09.207948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.208742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:09.208742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:09.208742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:24:09.208742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:09.208742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:09.208742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.208742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:09.208742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:09.208742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:09.208742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.208742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:09.208742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:09.208742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:09.209733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:09.209733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:09.209733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:09.209733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:09.209733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:09.209733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:09.209733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:09.209733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:09.209733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:09.209733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:09.209733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.209733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:09.210425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.210425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:09.210425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:09.210425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:09.210425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:09.210425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:09.210425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.210425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:09.210425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:09.210425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.210425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:09.210425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:09.210425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.210425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:09.210425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:09.210425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:09.211197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:09.212059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:09.212059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:09.212059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:09.212059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:09.212059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:09.212059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.212059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:09.213646 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:09.213907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:09.214043 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:09.214173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:09.214630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:09.214990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.215672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:09.215672 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:09.215672 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:09.215672 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:09.215672 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:09.215672 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:09.215672 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.215672 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:09.216394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.216394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:09.216394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:09.216394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:09.216394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.216394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:09.216394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:09.216394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:09.216394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.216394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:09.216394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:09.216394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:09.216394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:09.216394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:09.216394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:09.216815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:09.216815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:09.216815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:09.216815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:09.216815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:09.216815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:09.216815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:09.216815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.216815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:09.217273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.217273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:09.217273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:09.217273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:09.217273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.217273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:09.217273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:09.217273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:09.217273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:09.217273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.217273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:09.217652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:09.217652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:09.217652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.217652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:09.217652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:09.217652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:09.217652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:09.217652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:09.217652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:09.217652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:09.217652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:09.217652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:09.217652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:09.217652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:09.218043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:09.218043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:09.218043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.218043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.218417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:09.218898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:09.219445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:09.219445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:09.219445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.219445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:09.221259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:09.221580 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:09.221686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:09.221844 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:09.222222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:09.222609 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:09.222836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.223485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:09.223485 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:09.223485 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:09.223485 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:09.223485 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:09.223485 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:09.223485 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.223485 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:09.224269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.224269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:09.224269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:09.224269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:09.224269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.224269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:09.224269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:09.224269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.224269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:09.224269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:09.224269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:09.224269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.224588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:09.224588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:09.224588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:09.224588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:09.224588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:09.224588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:09.224588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:09.224588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:09.224588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:09.224588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:09.224588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:09.224588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:09.224588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:09.224911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.224911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:09.225237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.225237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:09.225237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:09.225237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:09.225237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:09.225237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:09.225237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.225237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:09.225237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:09.225237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.225237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:09.225237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:09.225237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.225237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:09.225237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:09.225237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:09.225704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:09.226194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:09.226194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:09.226194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:13.731212 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:13.732165 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:13.732165 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:13.732445 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:13.763564 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:13.764071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:13.764959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:13.764959 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:13.764959 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:13.764959 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:13.764959 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:13.764959 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:13.764959 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:13.764959 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:13.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:13.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:13.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:13.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:13.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:13.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:13.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:13.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:13.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:13.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:13.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:13.765904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:13.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:13.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:13.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:13.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:13.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:13.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:13.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:13.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:13.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:13.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:13.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:13.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:13.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:13.767751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:13.767751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:13.767751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:13.767751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:13.767751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:13.767751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:13.767751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:13.767751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:13.767751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:13.767751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:13.767751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:13.767751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:13.767751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:13.767751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:13.767751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:13.768643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:13.769311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:13.769311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:13.769311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:13.769311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:13.769311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:13.769311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:14.195838 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:14.196599 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:14.196825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:14.197992 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:14.198337 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:14.198744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:14.199721 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:14.199721 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:14.199721 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:14.199721 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:14.199721 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:14.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.199721 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:14.200892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.200892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:14.200892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:14.200892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:14.200892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.200892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:14.200892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:14.200892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.200892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:14.200892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:14.200892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:14.200892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.201463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:14.201463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:14.201463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:14.201463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:14.201463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:14.201463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:14.201463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:14.201463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:14.201463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:14.201463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:14.201463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:14.201463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:14.201463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:14.202009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.202009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:14.202433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.202433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:14.202433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:14.202433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:14.202433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:14.202433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:14.202433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.202433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:14.202433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:14.202433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.202433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:14.202433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:14.202433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.202433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:14.202433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:14.202433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:14.203002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:14.203542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:14.203542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.203542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:14.204841 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:14.205044 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:14.205211 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:14.205385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:24:14.205760 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:14.205961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.206531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:14.206531 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:14.206531 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:14.206531 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:14.206531 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:14.206531 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:14.206531 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.206531 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:14.207629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.207629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:14.207629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:14.207629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:14.207629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.207629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:14.207629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:14.207629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:14.207629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.207629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:14.207629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:14.207629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:14.207629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:14.207629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:14.207629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:14.208318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:14.208318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:14.208318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:14.208318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:14.208318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:14.208318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:14.208318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:14.208318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.208318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:14.209043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.209043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:14.209043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:14.209043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:14.209043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.209043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:14.209043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:14.209043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:24:14.209043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:14.209043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:14.209043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.209043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:14.209607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:14.209607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:14.209607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.209607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:14.209607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:14.209607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:14.209607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:14.209607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:14.209607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:14.209607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:14.209607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:14.209607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:14.209607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:14.209607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:14.210223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:14.210223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:14.210223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.210223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:14.210583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.210583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:14.210583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:14.210583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:14.210583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:14.210583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:14.210583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.210583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:14.210583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:14.210583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.210583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:14.210583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:14.210583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.210583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:14.210583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:14.210583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:14.211164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:14.211812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:14.211812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:14.211812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:14.211812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:14.211812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:14.211812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.211812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:14.214081 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:14.214387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:14.214551 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:14.214729 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:14.215115 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:14.215426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.215992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:14.215992 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:14.215992 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:14.215992 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:14.215992 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:14.215992 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:14.215992 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.215992 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:14.216874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.216874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:14.216874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:14.216874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:14.216874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.216874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:14.216874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:14.216874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:14.216874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.216874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:14.216874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:14.216874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:14.216874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:14.216874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:14.216874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:14.217504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:14.217504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:14.217504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:14.217504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:14.217504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:14.217504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:14.217504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:14.217504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.217504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:14.218215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.218215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:14.218215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:14.218215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:14.218215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.218215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:14.218215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:14.218215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:14.218215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:14.218215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.218215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:14.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:14.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:14.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:14.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:14.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:14.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:14.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:14.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:14.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:14.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:14.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:14.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:14.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:14.219350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:14.219350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:14.219350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.219350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:14.220322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:14.220877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:14.220877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:14.220877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.220877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:14.221620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:14.221822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:14.221970 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:14.222165 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:14.222518 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:14.222740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:14.222882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.223445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:14.223445 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:14.223445 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:14.223445 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:14.223445 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:14.223445 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:14.223445 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.223445 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:14.224566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.224566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:14.224566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:14.224566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:14.224566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.224566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:14.224566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:14.224566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.224566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:14.224566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:14.224566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:14.224566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.225134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:14.225134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:14.225134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:14.225134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:14.225134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:14.225134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:14.225134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:14.225134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:14.225134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:14.225134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:14.225134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:14.225134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:14.225134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:14.225759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.225759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:14.226062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.226062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:14.226062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:14.226062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:14.226062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:14.226062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:14.226062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.226062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:14.226062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:14.226062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.226062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:14.226062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:14.226062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.226062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:14.226062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:14.226062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:14.226619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:14.227196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:14.227196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:14.227196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:18.731854 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:18.732618 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:18.732618 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:18.733313 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:18.766058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:18.766501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:18.767413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:18.767413 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:18.767413 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:18.767413 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:18.767413 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:18.767413 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:18.767413 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:18.767413 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:18.768124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:18.768124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:18.768124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:18.768124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:18.768124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:18.768124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:18.768124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:18.768124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:18.768124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:18.768124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:18.768124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:18.768124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:18.768751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:18.768751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:18.768751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:18.768751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:18.768751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:18.768751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:18.768751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:18.768751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:18.768751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:18.768751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:18.768751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:18.768751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:18.768751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:18.769354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:18.769354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:18.769354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:18.769354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:18.769354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:18.769354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:18.769354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:18.769354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:18.769354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:18.769354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:18.769354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:18.769354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:18.769354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:18.769354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:18.769354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:18.770061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:18.770965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:18.770965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:18.770965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:18.770965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:18.770965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:18.770965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:19.197678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:19.198405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:19.198797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:19.200057 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:19.200340 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:19.200795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.201693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:19.201693 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:19.201693 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:19.201693 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:19.201693 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:19.201693 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:19.201693 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.201693 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:19.203274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.203274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:19.203274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:19.203274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:19.203274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.203274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:19.203274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:19.203274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.203274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:19.203274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:19.203274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:19.203274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.203926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:19.203926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:19.203926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:19.203926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:19.203926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:19.203926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:19.203926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:19.203926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:19.203926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:19.203926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:19.203926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:19.203926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:19.203926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:19.204611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.204611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:19.205128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.205128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:19.205128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:19.205128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:19.205128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:19.205128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:19.205128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.205128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:19.205128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:19.205128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.205128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:19.205128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:19.205128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.205128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:19.205128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:19.205128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:19.205745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:19.206264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:19.206264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.206264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:19.206264 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:19.206264 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:19.206264 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:19.206264 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:24:19.206515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:19.206557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.207033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:19.207033 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:19.207033 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:19.207033 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:19.207033 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:19.207033 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:19.207033 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.207033 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:19.207750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.207750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:19.207750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:19.207750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:19.207750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.207750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:19.207750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:19.207750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:19.207750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.207750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:19.207750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:19.207750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:19.207750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:19.207750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:19.207750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:19.208193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:19.208193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:19.208193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:19.208193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:19.208193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:19.208193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:19.208193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:19.208193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.208193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:19.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:19.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:19.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:19.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:19.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:19.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:24:19.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:19.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:19.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.208589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:19.208944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:19.208944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:19.208944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.208944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:19.208944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:19.208944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:19.208944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:19.208944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:19.208944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:19.208944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:19.208944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:19.208944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:19.208944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:19.208944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:19.209326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:19.209326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:19.209326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.209326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:19.209604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.209604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:19.209604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:19.209604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:19.209604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:19.209604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:19.209604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.209604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:19.209604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:19.209604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.209604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:19.209604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:19.209604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.209604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:19.209604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:19.209604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:19.210133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:19.210650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:19.210650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:19.210650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:19.210650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:19.210650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:19.210650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.210650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:19.214332 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:19.214593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:19.214702 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:19.214821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:19.215154 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:19.215400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.215875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:19.215875 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:19.215875 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:19.215875 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:19.215875 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:19.215875 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:19.215875 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.215875 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:19.216642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.216642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:19.216642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:19.216642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:19.216642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.216642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:19.216642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:19.216642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:19.216642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.216642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:19.216642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:19.216642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:19.216642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:19.216642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:19.216642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:19.217066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:19.217066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:19.217066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:19.217066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:19.217066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:19.217066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:19.217066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:19.217066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.217066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:19.217534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.217534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:19.217534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:19.217534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:19.217534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.217534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:19.217534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:19.217534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:19.217534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:19.217534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.217534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:19.217875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:19.217875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:19.217875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.217875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:19.217875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:19.217875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:19.217875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:19.217875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:19.217875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:19.217875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:19.217875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:19.217875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:19.217875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:19.217875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:19.218235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:19.218235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:19.218235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.218235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.218550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:19.219034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:19.219571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:19.219571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:19.219571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.219571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:19.221982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:19.222265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:19.222376 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:19.222547 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:19.222961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:19.223332 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:19.223587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.224229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:19.224229 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:19.224229 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:19.224229 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:19.224229 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:19.224229 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:19.224229 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.224229 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:19.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:19.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:19.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:19.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:19.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:19.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:19.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:19.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:19.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.225410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:19.225410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:19.225410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:19.225410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:19.225410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:19.225410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:19.225410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:19.225410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:19.225410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:19.225410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:19.225410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:19.225410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:19.225410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:19.225891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.225891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:19.225981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.225981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:19.225981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:19.225981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:19.225981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:19.225981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:19.225981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.225981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:19.225981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:19.225981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.225981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:19.225981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:19.225981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.225981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:19.225981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:19.225981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:19.226586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:19.227139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:19.227139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:19.227139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:23.732592 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:23.733468 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:23.733790 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:23.735088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:23.763886 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:23.764260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:23.765097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:23.765097 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:23.765097 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:23.765097 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:23.765097 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:23.765097 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:23.765097 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:23.765097 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:23.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.031 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:23.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:23.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:23.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:23.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:23.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:23.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:23.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:23.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:23.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:23.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:23.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:23.766531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:23.766531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:23.766531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:23.766531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:23.766531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:23.766531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:23.766531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:23.766531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:23.766531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:23.766531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:23.766531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:23.766531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:23.766531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:23.767070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:23.767070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:23.767070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:23.767070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:23.767070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:23.767070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:23.767070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:23.767070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:23.767070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:23.767070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:23.767070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:23.767070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:23.767070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:23.767070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:23.767070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:23.767753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:23.768717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:23.768717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:23.768717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:23.768717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:23.768717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:23.768717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:24.198670 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:24.199242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:24.199500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:24.200693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:24.201155 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:24.201570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.202684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:24.202684 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:24.202684 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:24.202684 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:24.202684 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:24.202684 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:24.202684 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.202684 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:24.204246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.204246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:24.204246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:24.204246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:24.204246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.204246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:24.204246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:24.204246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.204246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:24.204246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:24.204246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:24.204246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.204843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:24.204843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:24.204843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:24.204843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:24.204843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:24.204843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:24.204843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:24.204843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:24.204843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:24.204843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:24.204843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:24.204843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:24.204843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:24.205622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.205622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:24.206146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.206146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:24.206146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:24.206146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:24.206146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:24.206146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:24.206146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.206146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:24.206146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:24.206146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.206146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:24.206146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:24.206146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.206146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:24.206146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:24.206146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:24.206916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:24.207801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:24.207801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.207801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:24.207801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:24.207801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:24.207801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:24.207801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:24:24.207801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:24.208297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.208822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:24.208822 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:24.208822 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:24.208822 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:24.208822 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:24.208822 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:24.208822 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.208822 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:24.209618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.209618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:24.209618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:24.209618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:24.209618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.209618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:24.209618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:24.209618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:24.209618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.209618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:24.209618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:24.209618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:24.209618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:24.209618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:24.209618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:24.210108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:24.210108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:24.210108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:24.210108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:24.210108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:24.210108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:24.210108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:24.210108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.210108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:24.210519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.210519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:24.210519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:24.210519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:24.210519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.210519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:24.210519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:24.210519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:24:24.210519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:24.210519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:24.210519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.210519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:24.210904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:24.210904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:24.210904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.210904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:24.210904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:24.210904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:24.210904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:24.210904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:24.210904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:24.210904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:24.210904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:24.210904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:24.210904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:24.210904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:24.211321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:24.211321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:24.211321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.211321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:24.211586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.211586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:24.211586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:24.211586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:24.211586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:24.211586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:24.211586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.211586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:24.211586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:24.211586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.211586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:24.211586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:24.211586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.211586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:24.211586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:24.211586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:24.212067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:24.212613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:24.212613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:24.212613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:24.212613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:24.212613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:24.212613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.212613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:24.214707 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:24.215270 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:24.215611 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:24.215921 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:24.216358 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:24.216746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.217560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:24.217560 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:24.217560 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:24.217560 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:24.217560 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:24.217560 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:24.217560 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.217560 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:24.218750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.218750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:24.218750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:24.218750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:24.218750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.218750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:24.218750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:24.218750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:24.218750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.218750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:24.218750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:24.218750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:24.218750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:24.218750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:24.218750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:24.219207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:24.219207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:24.219207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:24.219207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:24.219207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:24.219207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:24.219207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:24.219207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.219207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:24.220098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.220098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:24.220098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:24.220098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:24.220098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.220098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:24.220098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:24.220098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:24.220098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:24.220098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.220098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:24.220525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:24.220525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:24.220525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.220525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:24.220525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:24.220525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:24.220525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:24.220525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:24.220525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:24.220525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:24.220525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:24.220525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:24.220525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:24.220525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:24.221032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:24.221032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:24.221032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.221032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:24.222339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:24.222887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:24.222887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:24.222887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.222887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:24.222887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:24.222887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:24.222887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:24.222887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:24.223156 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:24.223249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:24.223352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:24.223766 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:24.223766 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:24.223766 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:24.223766 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:24.223766 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:24.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:24.224969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.224969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:24.224969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:24.224969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:24.224969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.224969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:24.224969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:24.224969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.224969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:24.224969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:24.224969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:24.224969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.225348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:24.225348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:24.225348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:24.225348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:24.225348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:24.225348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:24.225348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:24.225348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:24.225348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:24.225348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:24.225348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:24.225348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:24.225348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:24.225725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.225725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:24.226041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.226041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:24.226041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:24.226041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:24.226041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:24.226041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:24.226041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.226041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:24.226041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:24.226041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.226041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:24.226041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:24.226041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.226041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:24.226041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:24.226041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:24.226635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:24.227167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:24.227167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:24.227167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:28.733627 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:28.734608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:28.734777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:28.736160 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:28.776310 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:28.776686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:28.778129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:28.778129 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:28.778129 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:28.778129 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:28.778129 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:28.778129 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:28.778129 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:28.778129 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:28.779399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:28.779399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:28.779399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:28.779399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:28.779399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:28.779399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:28.779399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:28.779399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:28.779399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:28.779399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:28.779399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:28.779399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:28.780010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:28.780010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:28.780010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:28.780010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:28.780010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:28.780010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:28.780010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:28.780010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:28.780010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:28.780010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:28.780010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:28.780010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:28.780010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:28.780636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:28.780636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:28.780875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:28.780875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:28.780875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:28.780875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:28.780875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:28.780875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:28.780875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:28.780875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:28.780875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:28.780875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:28.780875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:28.780875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:28.780875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:28.780875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:28.780875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:28.780875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:28.781682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:28.782667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:28.782667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:28.782667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:29.200274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:29.200274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:29.200274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:29.201317 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:29.201766 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:29.202054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.203065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:29.203065 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:29.203065 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:29.203065 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:29.203065 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:29.203065 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:29.203065 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.203065 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:29.204676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.204676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:29.204676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:29.204676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:29.204676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.204676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:29.204676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:29.204676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.204676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:29.204676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:29.204676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:29.204676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.205143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:29.205143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:29.205143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:29.205143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:29.205143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:29.205143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:29.205143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:29.205143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:29.205143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:29.205143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:29.205143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:29.205143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:29.205143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:29.205609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.205609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:29.206305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.206305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:29.206305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:29.206305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:29.206305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:29.206305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:29.206305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.206305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:29.206305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:29.206305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.206305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:29.206305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:29.206305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.206305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:29.206305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:29.206305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:29.206868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:29.207537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:29.207537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.207537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:29.207537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:29.207537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:29.207537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:29.207729 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:24:29.208036 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:29.208234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.208801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:29.208801 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:29.208801 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:29.208801 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:29.208801 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:29.208801 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:29.208801 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.208801 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:29.209933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.209933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:29.209933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:29.209933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:29.209933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.209933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:29.209933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:29.209933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:29.209933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.209933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:29.209933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:29.209933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:29.209933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:29.209933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:29.209933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:29.210456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:29.210456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:29.210456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:29.210456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:29.210456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:29.210456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:29.210456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:29.210456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.210456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:29.211330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.211330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:29.211330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:29.211330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:29.211330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.211330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:29.211330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:29.211330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:24:29.211330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:29.211330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:29.211330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.211330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:29.211842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:29.211842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:29.211842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.211842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:29.211842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:29.211842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:29.211842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:29.211842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:29.211842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:29.211842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:29.211842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:29.211842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:29.211842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:29.211842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:29.212354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:29.212354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:29.212354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.212354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:29.212522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.212522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:29.212522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:29.212522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:29.212522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:29.212522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:29.212522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.212522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:29.212522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:29.212522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.212522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:29.212522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:29.212522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.212522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:29.212522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:29.212522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:29.213000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:29.213622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:29.213622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:29.213622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:29.213622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:29.213622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:29.213622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.213622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:29.215132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:29.215420 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:29.215539 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:29.215668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:29.215982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:29.216212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.216747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:29.216747 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:29.216747 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:29.216747 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:29.216747 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:29.216747 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:29.216747 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.216747 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:29.217512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.217512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:29.217512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:29.217512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:29.217512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.217512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:29.217512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:29.217512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:29.217512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.217512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:29.217512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:29.217512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:29.217512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:29.217512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:29.217512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:29.218014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:29.218014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:29.218014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:29.218014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:29.218014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:29.218014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:29.218014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:29.218014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.218014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:29.218346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.218346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:29.218346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:29.218346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:29.218346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.218346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:29.218346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:29.218346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:29.218346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:29.218346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.218346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:29.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:29.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:29.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:29.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:29.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:29.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:29.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:29.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:29.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:29.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:29.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:29.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:29.218719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:29.219167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:29.219167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:29.219167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.219167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.219424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:29.220024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:29.220628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:29.220628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:29.220628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.220628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:29.222610 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:29.222895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:29.223053 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:29.223248 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:29.223672 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:29.224000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:29.224217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.225448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:29.225448 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:29.225448 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:29.225448 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:29.225448 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:29.225448 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:29.225448 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.225448 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:29.225902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.225902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:29.225902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:29.225902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:29.225902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.225902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:29.225902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:29.225902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.225902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:29.225902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:29.225902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:29.225902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.226563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:29.226563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:29.226563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:29.226563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:29.226563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:29.226563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:29.226563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:29.226563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:29.226563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:29.226563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:29.226563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:29.226563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:29.226563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:29.227186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.227186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:29.227186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.227186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:29.227186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:29.227186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:29.227186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:29.227186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:29.227186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.227186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:29.227186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:29.227186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.227186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:29.227186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:29.227186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:29.227984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:29.228900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:29.228900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:29.228900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:29.228900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:29.228900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:29.228900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:33.734237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:33.736230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:33.736230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:33.736230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:33.767718 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:33.768152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:33.769511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:33.769511 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:33.769511 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:33.769511 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:33.769511 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:33.769511 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:33.769511 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:33.769511 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:33.771148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:33.771148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:33.771148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:33.771148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:33.771148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:33.771148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:33.771148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:33.771148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:33.771148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:33.771148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:33.771148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:33.771148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:33.771806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:33.771806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:33.771806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:33.771806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:33.771806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:33.771806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:33.771806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:33.771806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:33.771806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:33.771806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:33.771806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:33.771806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:33.771806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:33.772486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:33.772486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:33.773264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:33.773264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:33.773264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:33.773264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:33.773264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:33.773264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:33.773264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:33.773264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:33.773264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:33.773264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:33.773264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:33.773264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:33.773264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:33.773264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:33.773264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:33.773264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:33.773926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:33.774510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:33.774510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:33.774510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:34.200599 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:34.203871 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:34.203871 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:34.204171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:34.204531 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:34.204728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.205570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:34.205570 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:34.205570 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:34.205570 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:34.205570 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:34.205570 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:34.205570 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.205570 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:34.206666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.206666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:34.206666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:34.206666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:34.206666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.206666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:34.206666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:34.206666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.206666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:34.206666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:34.206666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:34.206666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.207050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:34.207050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:34.207050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:34.207050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:34.207050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:34.207050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:34.207050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:34.207050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:34.207050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:34.207050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:34.207050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:34.207050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:34.207050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:34.207530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.207530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:34.207530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.207530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:34.207530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:34.207530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:34.207530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:34.207530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:34.207530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.207530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:34.207530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:34.207530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.207530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:34.207530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:34.207530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:34.207979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:34.208598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:34.208598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:34.208598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:34.208598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:34.208598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.208598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:34.208598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:34.208598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:34.208598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:34.208598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:24:34.208915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:34.209003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.209732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:34.209732 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:34.209732 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:34.209732 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:34.209732 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:34.209732 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:34.209732 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.209732 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:34.210621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.210621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:34.210621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:34.210621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:34.210621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.210621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:34.210621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:34.210621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:34.210621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.210621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:34.210621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:34.210621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:34.210621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:34.210621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:34.210621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:34.210945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:34.210945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:34.210945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:34.210945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:34.210945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:34.210945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:34.210945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:34.210945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.210945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:34.211513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.211513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:34.211513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:34.211513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:34.211513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.211513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:34.211513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:34.211513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:24:34.211513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:34.211513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:34.211513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.211513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:34.211775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:34.211775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:34.211775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.211775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:34.211775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:34.211775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:34.211775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:34.211775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:34.211775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:34.211775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:34.211775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:34.211775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:34.211775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:34.211775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:34.212041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:34.212041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:34.212041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.212041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:34.214798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.214798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:34.214798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:34.214798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:34.214798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:34.214798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:34.214798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.214798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:34.214798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:34.214798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.214798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:34.214798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:34.214798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.214798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:34.214798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:34.214798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:34.215143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:34.215492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:34.215492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:34.215492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:34.215492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:34.215492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:34.215492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.215492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:34.215492 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:34.215816 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:34.215947 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:34.216124 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:34.216613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:34.216868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.217595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:34.217595 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:34.217595 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:34.217595 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:34.217595 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:34.217595 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:34.217595 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.217595 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:34.218574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.218574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:34.218574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:34.218574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:34.218574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.218574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:34.218574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:34.218574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:34.218574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.218574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:34.218574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:34.218574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:34.218574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:34.218574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:34.218574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:34.218858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:34.218858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:34.218858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:34.218858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:34.218858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:34.218858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:34.218858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:34.218858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.218858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:34.219591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.219591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:34.219591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:34.219591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:34.219591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.219591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:34.219591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:34.219591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:34.219591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:34.219591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.219591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:34.219823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:34.219823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:34.219823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.219823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:34.219823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:34.219823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:34.219823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:34.219823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:34.219823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:34.219823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:34.219823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:34.219823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:34.219823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:34.219823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:34.220082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:34.220082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:34.220082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.220082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.220714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:34.221065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:34.221456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:34.221456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:34.221456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.221456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:34.224694 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:34.225074 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:34.225163 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:34.225317 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:34.225851 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:34.226235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:34.226396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.226900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:34.226900 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:34.226900 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:34.226900 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:34.226900 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:34.226900 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:34.226900 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.226900 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:34.227652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.227652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:34.227652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:34.227652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:34.227652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.227652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:34.227652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:34.227652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.227652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:34.227652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:34.227652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:34.227652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.227909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:34.227909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:34.227909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:34.227909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:34.227909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:34.227909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:34.227909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:34.227909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:34.227909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:34.227909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:34.227909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:34.227909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:34.227909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:34.228155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.228155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:34.228364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.228364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:34.228364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:34.228364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:34.228364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:34.228364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:34.228364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.228364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:34.228364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:34.228364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.228364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:34.228364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:34.228364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.228364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:34.228364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:34.228364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:34.228702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:34.229077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:34.229077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:34.229077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:38.735646 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:38.736583 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:38.736874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:38.738570 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:38.777674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:38.778011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:38.778836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:38.778836 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:38.778836 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:38.778836 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:38.778836 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:38.778836 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:38.778836 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:38.778836 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:38.779851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:38.779851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:38.779851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:38.779851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:38.779851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:38.779851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:38.779851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:38.779851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:38.779851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:38.779851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:38.779851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:38.779851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:38.780613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:38.780613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:38.780613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:38.780613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:38.780613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:38.780613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:38.780613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:38.780613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:38.780613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:38.780613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:38.780613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:38.780613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:38.780613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:38.781235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:38.781235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:38.781235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:38.781235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:38.781235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:38.781235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:38.781235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:38.781235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:38.781235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:38.781235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:38.781235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:38.781235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:38.781235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:38.781235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:38.781235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:38.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:38.782151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:38.782151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:38.782151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:38.782151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:38.782151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:38.782151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:39.203565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:39.204440 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:39.204652 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:39.206008 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:39.206533 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:39.206783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.207930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:39.207930 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:39.207930 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:39.207930 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:39.207930 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:39.207930 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:39.207930 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.207930 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:39.209981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.209981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:39.209981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:39.209981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:39.209981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.209981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:39.209981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:39.209981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.209981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:39.209981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:39.209981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:39.209981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.210531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:39.210531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:39.210531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:39.210531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:39.210531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:39.210531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:39.210531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:39.210531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:39.210531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:39.210531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:39.210531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:39.210531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:39.210531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:39.211092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.211092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:39.211092 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:39.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:39.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:39.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:39.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:39.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:39.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:39.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:39.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:39.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:39.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:39.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:39.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:39.212789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:39.213552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:39.213552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.213552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:39.213552 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:39.213552 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:39.213552 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:24:39.213552 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:39.213552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.213912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:39.213912 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:39.213912 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:39.213912 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:39.213912 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:39.213912 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:39.213912 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.213912 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:39.214773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.214773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:39.214773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:39.214773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:39.214773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.214773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:39.214773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:39.214773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:39.214773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.214773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:39.214773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:39.214773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:39.214773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:39.214773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:39.214773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:39.215460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:39.215460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:39.215460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:39.215460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:39.215460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:39.215460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:39.215460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:39.215460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.215460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:39.215811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.215811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:39.215811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:39.215811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:39.215811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.215811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:39.215811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:39.215811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:24:39.215811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:39.215811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:39.215811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.215811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:39.216135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:39.216135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:39.216135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.216135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:39.216135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:39.216135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:39.216135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:39.216135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:39.216135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:39.216135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:39.216135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:39.216135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:39.216135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:39.216135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:39.216498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:39.216498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:39.216498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.216498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:39.216844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.216844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:39.216844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:39.216844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:39.216844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:39.216844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:39.216844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.216844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:39.216844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:39.216844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.216844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:39.216844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:39.216844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.216844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:39.216844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:39.216844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:39.217275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:39.217748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:39.217748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:39.217748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:39.217748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:39.217748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:39.217748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.217748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:39.217748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:39.217748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:39.217748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:39.218028 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:39.218028 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:39.218331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.218835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:39.218835 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:39.218835 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:39.218835 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:39.218835 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:39.218835 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:39.218835 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.218835 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:39.220003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.220003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:39.220003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:39.220003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:39.220003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.220003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:39.220003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:39.220003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:39.220003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.220003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:39.220003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:39.220003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:39.220003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:39.220003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:39.220003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:39.220414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:39.220414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:39.220414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:39.220414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:39.220414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:39.220414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:39.220414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:39.220414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.220414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:39.220724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.220724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:39.220724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:39.220724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:39.220724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.220724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:39.220724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:39.220724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:39.220724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:39.220724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.220724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:39.221113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:39.221113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:39.221113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.221113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:39.221113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:39.221113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:39.221113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:39.221113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:39.221113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:39.221113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:39.221113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:39.221113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:39.221113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:39.221113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:39.221600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:39.221600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:39.221600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.221600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.221764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:39.222239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:39.223080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:39.223080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:39.223080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.223080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:39.225206 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:39.225540 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:39.225651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:39.225809 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:39.226265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:39.226682 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:39.226951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.227914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:39.227914 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:39.227914 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:39.227914 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:39.227914 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:39.227914 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:39.227914 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.227914 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:39.228779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.228779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:39.228779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:39.228779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:39.228779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.228779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:39.228779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:39.228779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.228779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:39.228779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:39.228779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:39.228779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.229267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:39.229267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:39.229267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:39.229267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:39.229267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:39.229267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:39.229267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:39.229267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:39.229267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:39.229267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:39.229267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:39.229267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:39.229267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:39.229826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.229826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:39.229826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.229826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:39.229826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:39.229826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:39.229826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:39.229826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:39.229826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.229826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:39.229826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:39.229826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.229826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:39.229826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:39.229826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:39.230449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:39.231224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:39.231224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:39.231224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:39.231224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:39.231224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:39.231224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:43.736448 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:43.737283 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:43.737604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:43.738972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:43.767347 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:43.767775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:43.768703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:43.768703 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:43.768703 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:43.768703 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:43.768703 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:43.768703 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:43.768703 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:43.768703 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:43.769647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.031 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:43.769647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:43.769647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:43.769647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:43.769647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:43.769647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:43.769647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:43.769647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:43.769647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:43.769647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:43.769647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:43.769647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:43.770266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:43.770266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:43.770266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:43.770266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:43.770266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:43.770266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:43.770266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:43.770266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:43.770266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:43.770266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:43.770266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:43.770266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:43.770266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:43.770880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:43.770880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:43.770880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:43.770880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:43.770880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:43.770880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:43.770880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:43.770880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:43.770880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:43.770880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:43.770880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:43.770880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:43.770880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:43.770880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:43.770880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:43.771556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:43.772441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:43.772441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:43.772441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:43.772441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:43.772441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:43.772441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:44.204397 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:44.204895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:44.205119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:44.205946 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:44.206294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:44.206586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.207494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:44.207494 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:44.207494 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:44.207494 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:44.207494 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:44.207494 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:44.207494 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.207494 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:44.209236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.209236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:44.209236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:44.209236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:44.209236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.209236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:44.209236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:44.209236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.209236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:44.209236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:44.209236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:44.209236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.209629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:44.209629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:44.209629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:44.209629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:44.209629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:44.209629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:44.209629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:44.209629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:44.209629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:44.209629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:44.209629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:44.209629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:44.209629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:44.210018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.210018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:44.211048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.211048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:44.211048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:44.211048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:44.211048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:44.211048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:44.211048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.211048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:44.211048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:44.211048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.211048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:44.211048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:44.211048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.211048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:44.211048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:44.211048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:44.211698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:44.212346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:44.212346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.212346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:44.212614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:44.213024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:44.213325 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:44.213600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:24:44.214206 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:44.214501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.215361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:44.215361 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:44.215361 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:44.215361 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:44.215361 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:44.215361 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:44.215361 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.215361 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:44.216561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.216561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:44.216561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:44.216561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:44.216561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.216561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:44.216561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:44.216561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:44.216561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.216561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:44.216561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:44.216561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:44.216561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:44.216561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:44.216561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:44.217268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:44.217268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:44.217268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:44.217268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:44.217268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:44.217268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:44.217268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:44.217268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.217268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:44.218167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.218167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:44.218167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:44.218167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:44.218167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.218167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:44.218167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:44.218167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:24:44.218167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:44.218167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:44.218167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.218167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:44.218535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:44.218535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:44.218535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.218535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:44.218535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:44.218535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:44.218535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:44.218535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:44.218535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:44.218535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:44.218535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:44.218535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:44.218535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:44.218535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:44.218920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:44.218920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:44.218920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.218920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:44.218920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:44.219513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.219513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:44.219513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:44.219513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:44.219513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:44.219513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:44.219513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.219513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:44.219513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:44.219513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.219513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:44.219513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:44.219513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.219513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:44.219513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:44.219513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:44.219970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:44.220465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:44.220465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:44.220465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:44.220465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:44.220465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:44.220465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.220465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:44.220465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:44.220465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:44.220465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:44.220761 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:44.220761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.220987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:44.220987 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:44.220987 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:44.220987 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:44.220987 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:44.220987 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:44.220987 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.220987 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:44.221773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.221773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:44.221773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:44.221773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:44.221773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.221773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:44.221773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:44.221773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:44.221773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.221773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:44.221773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:44.221773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:44.221773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:44.221773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:44.221773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:44.222181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:44.222181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:44.222181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:44.222181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:44.222181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:44.222181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:44.222181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:44.222181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.222181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:44.222679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.222679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:44.222679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:44.222679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:44.222679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.222679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:44.222679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:44.222679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:44.222679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:44.222679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.222679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:44.222982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:44.222982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:44.222982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.222982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:44.222982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:44.222982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:44.222982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:44.222982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:44.222982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:44.222982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:44.222982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:44.222982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:44.222982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:44.222982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:44.223394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:44.223394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:44.223394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.223394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.223833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:44.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:44.224818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:44.224818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:44.224818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.224818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:44.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:44.225823 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:44.225938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:44.226110 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:44.226539 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:44.226905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:44.227147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.227892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:44.227892 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:44.227892 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:44.227892 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:44.227892 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:44.227892 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:44.227892 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.227892 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:44.228769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.228769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:44.228769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:44.228769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:44.228769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.228769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:44.228769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:44.228769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.228769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:44.228769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:44.228769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:44.228769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.229098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:44.229098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:44.229098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:44.229098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:44.229098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:44.229098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:44.229098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:44.229098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:44.229098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:44.229098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:44.229098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:44.229098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:44.229098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:44.229583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.229583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:44.229867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.229867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:44.229867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:44.229867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:44.229867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:44.229867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:44.229867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.229867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:44.229867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:44.229867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.229867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:44.229867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:44.229867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.229867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:44.229867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:44.229867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:44.230287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:44.230801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:44.230801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:44.230801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:48.737130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:48.738009 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:48.738009 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:48.739178 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:48.773293 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:48.773527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:48.774161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:48.774161 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:48.774161 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:48.774161 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:48.774161 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:48.774161 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:48.774161 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:48.774161 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:48.774856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:48.774856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:48.774856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:48.774856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:48.774856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:48.774856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:48.774856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:48.774856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:48.774856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:48.774856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:48.774856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:48.774856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:48.775435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:48.775435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:48.775435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:48.775435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:48.775435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:48.775435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:48.775435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:48.775435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:48.775435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:48.775435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:48.775435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:48.775435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:48.775435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:48.775989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:48.775989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:48.775989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:48.775989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:48.775989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:48.775989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:48.775989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:48.775989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:48.775989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:48.775989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:48.775989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:48.775989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:48.775989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:48.775989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:48.775989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:48.776730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:48.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:48.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:48.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:48.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:48.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:48.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:49.205169 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:49.205644 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:49.205899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:49.206802 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:49.207044 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:49.207316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.208145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:49.208145 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:49.208145 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:49.208145 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:49.208145 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:49.208145 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:49.208145 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.208145 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:49.209705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.209705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:49.209705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:49.209705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:49.209705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.209705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:49.209705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:49.209705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.209705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:49.209705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:49.209705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:49.209705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.210728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:49.210728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:49.210728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:49.210728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:49.210728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:49.210728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:49.210728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:49.210728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:49.210728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:49.210728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:49.210728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:49.210728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:49.210728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:49.211405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.211405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:49.211405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.211405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:49.211405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:49.211405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:49.211405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:49.211405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:49.211405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.211405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:49.211405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:49.211405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.211405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:49.211405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:49.211405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:49.212232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:49.213083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:49.213083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:49.213083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:49.213083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:49.213083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.213083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:49.213083 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:49.213274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:49.213274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:49.213519 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:24:49.213704 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:49.213875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.214449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:49.214449 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:49.214449 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:49.214449 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:49.214449 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:49.214449 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:49.214449 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.214449 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:49.215312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.215312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:49.215312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:49.215312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:49.215312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.215312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:49.215312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:49.215312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:49.215312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.215312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:49.215312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:49.215312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:49.215312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:49.215312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:49.215312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:49.216261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:49.216261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:49.216261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:49.216261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:49.216261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:49.216261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:49.216261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:49.216261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.216261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:49.216261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.216261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:49.216261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:49.216261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:49.216261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.217089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:49.217089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:49.217089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:24:49.217089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:49.217089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:49.217089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.217089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:49.217089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:49.217089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:49.217089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.217089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:49.217089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:49.217089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:49.217926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:49.217926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:49.217926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:49.217926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:49.217926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:49.217926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:49.217926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:49.217926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:49.217926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:49.217926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:49.217926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.217926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:49.218694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.218694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:49.218694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:49.218694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:49.218694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:49.218694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:49.218694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.218694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:49.218694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:49.218694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.218694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:49.218694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:49.218694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.218694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:49.218694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:49.218694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:49.220130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:49.220871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:49.220871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:49.220871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:49.220871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:49.220871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:49.220871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.220871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:49.220871 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:49.220871 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:49.220871 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:49.221255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:49.221526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:49.221771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.222350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:49.222350 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:49.222350 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:49.222350 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:49.222350 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:49.222350 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:49.222350 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.222350 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:49.223514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.223514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:49.223514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:49.223514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:49.223514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.223514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:49.223514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:49.223514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:49.223514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.223514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:49.223514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:49.223514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:49.223514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:49.223514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:49.223514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:49.224120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:49.224120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:49.224120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:49.224120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:49.224120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:49.224120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:49.224120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:49.224120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.224120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:49.225402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.225402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:49.225402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:49.225402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:49.225402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.225402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:49.225402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:49.225402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:49.225402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:49.225402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.225402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:49.225989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:49.225989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:49.225989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.225989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:49.225989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:49.225989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:49.225989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:49.225989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:49.225989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:49.225989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:49.225989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:49.225989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:49.225989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:49.225989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:49.226617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:49.226617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:49.226617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.226617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.227496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:49.228280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:49.229615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:49.229615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:49.229615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.229615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:49.229615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:49.229615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:49.229615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:49.229615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:49.230117 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:49.230117 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:49.230117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.230117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:49.230117 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:49.230117 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:49.230117 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:49.230117 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:49.230117 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:49.230117 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.230117 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:49.230673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.230673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:49.230673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:49.230673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:49.230673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.230673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:49.230673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:49.230673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.230673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:49.230673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:49.230673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:49.230673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.231003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:49.231003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:49.231003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:49.231003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:49.231003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:49.231003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:49.231003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:49.231003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:49.231003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:49.231003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:49.231003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:49.231003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:49.231003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:49.231335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.231335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:49.231823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.231823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:49.231823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:49.231823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:49.231823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:49.231823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:49.231823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.231823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:49.231823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:49.231823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.231823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:49.231823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:49.231823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.231823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:49.231823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:49.231823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:49.232725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:49.233237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:49.233237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:49.233237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:53.737773 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:53.738594 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:53.738594 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:53.739941 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:53.743087 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=257 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:24:53.768853 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:53.769199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:53.770159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:53.770159 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:53.770159 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:53.770159 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:53.770159 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:53.770159 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:53.770159 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:53.770159 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:53.771697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.032 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:53.771697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:53.771697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:53.771697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:53.771697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:53.771697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:53.771697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:53.771697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:53.771697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:53.771697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:53.771697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:53.771697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:53.772648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:53.772648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:53.772648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:53.772648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:53.772648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:53.772648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:53.772648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:53.772648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:53.772648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:53.772648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:53.772648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:53.772648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:53.772648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:53.773696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:53.773696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:53.773696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:53.773696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:53.773696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:53.773696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:53.773696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:53.773696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:53.773696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:53.773696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:53.773696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:53.773696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:53.773696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:53.773696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:53.773696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:53.774535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:53.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:53.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:53.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:53.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:53.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:53.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:54.205763 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:54.206207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:54.206392 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:54.207894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:54.207894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:54.208105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.209114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:54.209114 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:54.209114 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:54.209114 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:54.209114 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:54.209114 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:54.209114 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.209114 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:54.210979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.210979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:54.210979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:54.210979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:54.210979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.210979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:54.210979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:54.210979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.210979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:54.210979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:54.210979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:54.210979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.211567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:54.211567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:54.211567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:54.211567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:54.211567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:54.211567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:54.211567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:54.211567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:54.211567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:54.211567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:54.211567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:54.211567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:54.211567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:54.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:54.212572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.212572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:54.212572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:54.212572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:54.212572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:54.212572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:54.212572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.212572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:54.212572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:54.212572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.212572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:54.212572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:54.212572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.212572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:54.212572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:54.212572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:54.213316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:54.214180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:54.214180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.214180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:54.214180 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:54.214180 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:54.214180 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:54.214180 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:24:54.214609 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:54.214950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.216021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:54.216021 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:54.216021 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:54.216021 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:54.216021 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:54.216021 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:54.216021 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.216021 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:54.216863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.216863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:54.216863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:54.216863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:54.216863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.216863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:54.216863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:54.216863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:54.216863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.216863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:54.216863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:54.216863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:54.216863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:54.216863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:54.216863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:54.217540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:54.217540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:54.217540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:54.217540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:54.217540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:54.217540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:54.217540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:54.217540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.217540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:54.217956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.217956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:54.217956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:54.217956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:54.217956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.217956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:54.217956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:54.217956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:24:54.217956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:54.217956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:54.217956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.217956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:54.218490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:54.218490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:54.218490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.218490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:54.218490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:54.218490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:54.218490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:54.218490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:54.218490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:54.218490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:54.218490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:54.218490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:54.218490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:54.218490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:54.219083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:54.219083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:54.219083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.219083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:54.219083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.219083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:54.219083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:54.219083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:54.219083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:54.219083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:54.219083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.219083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:54.219083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:54.219083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:54.219787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:54.220296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:54.220296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:54.220296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:54.220296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:54.220296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:54.220296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:54.220296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:54.220296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:54.220296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:54.220296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:54.220296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.220296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:54.220663 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:54.220938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:54.221053 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:54.221192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:54.221732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:54.222106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.222908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:54.222908 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:54.222908 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:54.222908 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:54.222908 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:54.222908 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:54.222908 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.222908 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:54.223832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.223832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:54.223832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:54.223832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:54.223832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.223832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:54.223832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:54.223832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:54.223832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.223832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:54.223832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:54.223832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:54.223832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:54.223832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:54.223832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:54.224101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:54.224101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:54.224101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:54.224101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:54.224101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:54.224101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:54.224101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:54.224101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.224101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:54.224790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.224790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:54.224790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:54.224790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:54.224790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.224790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:54.224790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:54.224790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:54.224790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:54.224790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.224790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:54.225007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:54.225007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:54.225007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.225007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:54.225007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:54.225007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:54.225007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:54.225007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:54.225007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:54.225007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:54.225007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:54.225007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:54.225007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:54.225007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:54.225250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:54.225250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:54.225250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.225250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.225969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:54.226300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:54.226655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:54.226655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:54.226655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.226655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:54.228021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:54.228290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:54.228434 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:54.228593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:54.229102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:54.229513 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:54.229754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.230547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:54.230547 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:54.230547 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:54.230547 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:54.230547 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:54.230547 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:54.230547 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.230547 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:54.231384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.231384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:54.231384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:54.231384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:54.231384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.231384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:54.231384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:54.231384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.231384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:54.231384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:54.231384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:54.231384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.231769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:54.231769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:54.231769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:54.231769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:54.231769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:54.231769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:54.231769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:54.231769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:54.231769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:54.231769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:54.231769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:54.231769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:54.231769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:54.232115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.232115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:54.232395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.232395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:54.232395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:54.232395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:54.232395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:54.232395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:54.232395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.232395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:54.232395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:54.232395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.232395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:54.232395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:54.232395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.232395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:54.232395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:54.232395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:54.232785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:54.233261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:54.233261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:54.233261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:58.738795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:58.739670 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:58.739775 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:58.741168 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:58.779762 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:58.779949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:58.780880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:58.780880 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:58.780880 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:58.780880 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:58.780880 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:58.780880 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:58.780880 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:58.780880 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:58.781937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:58.781937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:58.781937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:58.781937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:58.781937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:58.781937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:58.781937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:58.781937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:58.781937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:58.781937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:58.781937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:58.781937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:58.783389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:58.783389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:58.783389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:58.783389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:58.783389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:58.783389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:58.783389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:58.783389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:58.783389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:58.783389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:58.783389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:58.783389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:58.783389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:58.785109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:58.785109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:58.785109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:58.785109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:58.785109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:58.785109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:58.785109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:58.785109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:58.785109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:58.785109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:58.785109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:58.785109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:58.785109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:58.785109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:58.785109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:58.785970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:58.786958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:58.786958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:58.786958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:58.786958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:58.786958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:58.786958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:59.206447 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:59.207258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:59.207495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:59.208655 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:59.209164 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:59.209526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.210474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:59.210474 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:59.210474 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:59.210474 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:59.210474 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:59.210474 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:59.210474 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.210474 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:59.212039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.212039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:59.212039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:59.212039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:59.212039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.212039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:59.212039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:59.212039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.212039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:59.212039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:59.212039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:59.212039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.212961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:59.212961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:59.212961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:59.212961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:59.212961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:59.212961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:59.212961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:59.212961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:59.212961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:59.212961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:59.212961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:59.212961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:59.212961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:59.213677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.213677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:59.213994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.213994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:59.213994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:59.213994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:59.213994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:59.213994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:59.213994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.213994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:59.213994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:59.213994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.213994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:59.213994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:59.213994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.213994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:59.213994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:59.213994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:59.215509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:59.217699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:59.217699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.217699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:59.217699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:59.217699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:59.217699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:59.217699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:24:59.217699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:59.218420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:59.219241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.219241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:59.219241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:59.219241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:59.219241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:59.219241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:59.219241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:59.219241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:59.219241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:59.219241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:59.219241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:59.219241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:59.219241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:59.219241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:59.219241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.219241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:24:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.220332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:59.220857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:59.220857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:59.220857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.220857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:59.220857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:59.220857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:59.220857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:59.220857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:59.220857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:59.220857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:59.220857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:59.220857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:59.220857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:59.220857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:59.221314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:59.221314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:59.221314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.221314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:59.221314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.221314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:59.221314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:59.221314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:59.221314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:59.221314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:59.221314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.221314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:59.221314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:59.221314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:59.221745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:59.222712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:59.222712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:59.222712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:59.222712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:59.222712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:59.222712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:59.222712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:59.222712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:59.222712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:59.222712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:59.222712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.222712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:59.222712 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:59.222712 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:59.223706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:59.223706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:59.223706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:59.223706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.223706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:59.223706 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:59.223706 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:59.223706 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:59.223706 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:59.223706 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:59.223706 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.223706 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:59.224952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.224952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:24:59.224952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:59.224952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:59.224952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.224952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:59.224952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:59.224952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:59.224952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.224952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:24:59.224952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:59.224952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:24:59.224952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:59.224952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:24:59.224952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:24:59.225510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:59.225510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:24:59.225510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:59.225510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:24:59.225510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:24:59.225510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:59.225510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:24:59.225510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.225510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:24:59.226689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.226689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:59.226689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:59.226689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:59.226689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.226689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:59.226689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:59.226689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:59.226689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:59.226689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.226689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:59.226964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:59.226964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:59.226964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.226964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:59.226964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:59.226964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:59.226964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:59.226964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:59.226964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:59.226964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:59.226964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:59.226964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:59.226964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:59.226964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:59.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:59.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:59.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.229138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:59.229590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:59.230023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:59.230023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:59.230023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.230023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:24:59.230023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:24:59.230023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:24:59.230185 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:24:59.230385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:24:59.230692 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:59.231033 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:24:59.231250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.231920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:24:59.231920 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:59.231920 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:24:59.231920 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:24:59.231920 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:59.231920 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:24:59.231920 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.231920 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:24:59.232607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.232607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:24:59.232607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:59.232607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:24:59.232607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.232607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:59.232607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:59.232607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.232607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:59.232607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:59.232607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:59.232607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.233492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:24:59.233492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:59.233492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:24:59.233492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:59.233492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:24:59.233492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:24:59.233492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:59.233492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:24:59.233492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:59.233492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:24:59.233492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:24:59.233492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:59.233492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:24:59.234113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.234113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:24:59.234113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.234113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:24:59.234113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:24:59.234113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:24:59.234113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:24:59.234113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:24:59.234113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.234113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:24:59.234113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:24:59.234113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.234113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:24:59.234113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:24:59.234113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:24:59.234900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:24:59.236629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:24:59.236629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:24:59.236629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:24:59.236629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:24:59.236629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:24:59.236629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:03.739704 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:03.740708 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:03.740708 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:03.741625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:03.757003 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:03.769850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:03.769947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.770383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:03.770383 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:03.770383 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:03.770383 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:03.770383 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:03.770383 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:03.770383 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.770383 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:03.771062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.030 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.771062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:03.771062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:03.771062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:03.771062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:03.771062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:03.771062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:03.771062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:03.771062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:03.771062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:03.771062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:03.771062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:03.771491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:03.771491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:03.771491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:03.771491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:03.771491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:03.771491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:03.771491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:03.771491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:03.771491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:03.771491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:03.771491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:03.771491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:03.771491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:03.771865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.771865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:03.771865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.771865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:03.771865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:03.771865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:03.771865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:03.771865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:03.771865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:03.771865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:03.771865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:03.771865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:03.771865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:03.771865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:03.771865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:03.772316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:03.772950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:03.772950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:03.772950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:03.772950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:03.772950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.772950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:03.772950 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_for_inconsistencies {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:03.772950 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Checking Neutron and OVN revision consistency. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:03.777391 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:440}}
Apr 24 10:25:03.777558 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Number of inconsistencies found at create/update: networks=3, security_groups=1 {{(pid=106381) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:419}}
Apr 24 10:25:03.777636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 412fe0fb-d3c8-41ef-b742-c7e091bf5e56 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:25:03.806780 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, resource={'id': '412fe0fb-d3c8-41ef-b742-c7e091bf5e56', 'name': 'private', 'tenant_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'project_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['bedea127-581a-4245-bdcf-823b49c82996', 'd98dd98c-3740-4b7b-9054-95b7f384275a'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:19:49Z', 'updated_at': '2026-04-24T10:19:53Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 21598}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:03.807084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:03.807443 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-d9e6c44e-2c1f-4e1c-97fa-3abe15d536c8, external_ids_update=None, columns={'tag': 21598}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:03.807443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.807696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:03.807696 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:03.807696 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:03.807696 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:03.807696 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:03.807696 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:03.807696 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.807696 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:03.808789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 412fe0fb-d3c8-41ef-b742-c7e091bf5e56 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.808789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:03.808789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:25:03.808789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:25:03.808789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:25:03.808789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:25:03.808789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:25:03.808789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:03.808789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:03.808789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:03.808789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:03.809486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:03.809486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:03.809486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:03.809486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:03.809486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:03.809486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:03.809486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:03.809486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:03.809486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:03.809486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:03.809486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:03.809486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:03.809486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:03.809486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:03.810322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:03.810322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.810322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:03.810322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 86c46bc9-7739-46e7-9c49-62d2723e0d83 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:25:03.839178 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, resource={'id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'name': 'public', 'tenant_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'project_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['4daf396b-50dc-4100-9154-fd24fc0e5f1d', '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-24T10:19:55Z', 'updated_at': '2026-04-24T10:20:05Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:03.839549 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:03.839731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-b792be55-4fbf-4e4f-a9dc-10cee932ceea, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:03.839990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.840550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:03.840550 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:03.840550 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:03.840550 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:03.840550 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:03.840550 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:03.840550 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.840550 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:03.841613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 86c46bc9-7739-46e7-9c49-62d2723e0d83 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.841613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:03.841613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:25:03.841613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:25:03.841613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:25:03.841613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:25:03.841613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:25:03.841613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:03.841613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:03.841613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:03.841613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:03.842186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:03.842186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:03.842186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:03.842186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:03.842186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:03.842186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:03.842186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:03.842186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:03.842186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:03.842186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:03.842186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:03.842186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:03.842186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:03.842186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:03.843079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:03.843079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.843079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:03.843079 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 64c3f969-5120-406a-afc1-20f8f45b7533 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:25:03.861507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-64c3f969-5120-406a-afc1-20f8f45b7533, resource={'id': '64c3f969-5120-406a-afc1-20f8f45b7533', 'name': 'admin_net', 'tenant_id': '91bc93878b40449c8fd1c9924d8a3e8b', 'project_id': '91bc93878b40449c8fd1c9924d8a3e8b', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['18db2f65-6ba9-4ddd-8ab7-55370a16debc'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:23:22Z', 'updated_at': '2026-04-24T10:23:23Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 10837}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:03.861648 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-64c3f969-5120-406a-afc1-20f8f45b7533, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:03.861910 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-a26d15c8-ce05-4e3e-84bc-9aa33edf96fe, external_ids_update=None, columns={'tag': 10837}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:03.862038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.862512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:03.862512 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:03.862512 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:03.862512 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:03.862512 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:03.862512 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:03.862512 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.862512 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:03.863267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 64c3f969-5120-406a-afc1-20f8f45b7533 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.863267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:03.863267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:25:03.863267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:25:03.863267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:25:03.863267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:25:03.863267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:25:03.863267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:03.863267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:03.863267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:03.863267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:03.863777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:03.863777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:03.863777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:03.863777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:03.863777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:03.863777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:03.863777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:03.863777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:03.863777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:03.863777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:03.863777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:03.863777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:03.863777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:03.863777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:03.864465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:03.864465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:03.864465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:03.864465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 3d0c6ca5-dbcc-4bc5-8750-b9bbd17b5b5a (type: security_groups) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:25:03.922701 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.db.ovn_revision_numbers_db [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Successfully bumped revision number for resource 3d0c6ca5-dbcc-4bc5-8750-b9bbd17b5b5a (type: security_groups) to 9
Apr 24 10:25:03.922981 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_for_inconsistencies finished in 0.151 seconds
Apr 24 10:25:04.207488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:04.208358 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:04.208608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:04.209832 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:04.210143 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:04.210487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.211984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:04.211984 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:04.211984 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:04.211984 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:04.211984 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:04.211984 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:04.211984 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.211984 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:04.213929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.213929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:04.213929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:04.213929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:04.213929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.213929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:04.213929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:04.213929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.213929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:04.213929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:04.213929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:04.213929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.215134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:04.215134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:04.215134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:04.215134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:04.215134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:04.215134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:04.215134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:04.215134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:04.215134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:04.215134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:04.215134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:04.215134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:04.215134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:04.215710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.215710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:04.216797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.216797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:04.216797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:04.216797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:04.216797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:04.216797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:04.216797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.216797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:04.216797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:04.216797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.216797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:04.216797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:04.216797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.216797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:04.216797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:04.216797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:04.217762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:04.218932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:04.218932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.218932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:04.218932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:04.218932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:04.218932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:04.218932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:25:04.218932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:04.219325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:04.219759 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:04.219759 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:04.219759 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:04.219759 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:04.219759 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:04.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.219759 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:04.221179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.221179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:04.221179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:04.221179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:04.221179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.221179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:04.221179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:04.221179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:04.221179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.221179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:04.221179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:04.221179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:04.221179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:04.221179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:04.221179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:04.221543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:04.221543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:04.221543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:04.221543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:04.221543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:04.221543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:04.221543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:04.221543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.221543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:04.222567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.222567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:04.222567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:04.222567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:04.222567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.222567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:04.222567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:04.222567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:25:04.222567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:04.222567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:04.222567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.222567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:04.222866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:04.222866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:04.222866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.222866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:04.222866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:04.222866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:04.222866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:04.222866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:04.222866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:04.222866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:04.222866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:04.222866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:04.222866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:04.222866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:04.223218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:04.223218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:04.223218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.223218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:04.223939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.223939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:04.223939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:04.223939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:04.223939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:04.223939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:04.223939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.223939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:04.223939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:04.223939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.223939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:04.223939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:04.223939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.223939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:04.223939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:04.223939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:04.224319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:04.225104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:04.225104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:04.225104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:04.225104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:04.225104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:04.225104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.225104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:04.225104 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:04.225104 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:04.225288 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:04.225427 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:04.225937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:04.226172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.226815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:04.226815 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:04.226815 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:04.226815 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:04.226815 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:04.226815 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:04.226815 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.226815 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:04.227677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.227677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:04.227677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:04.227677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:04.227677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.227677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:04.227677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:04.227677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:04.227677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.227677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:04.227677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:04.227677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:04.227677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:04.227677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:04.227677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:04.227949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:04.227949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:04.227949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:04.227949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:04.227949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:04.227949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:04.227949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:04.227949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.227949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:04.228861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.228861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:04.228861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:04.228861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:04.228861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.228861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:04.228861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:04.228861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:04.228861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:04.228861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.228861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:04.229177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:04.229177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:04.229177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.229177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:04.229177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:04.229177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:04.229177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:04.229177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:04.229177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:04.229177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:04.229177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:04.229177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:04.229177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:04.229177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:04.229486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:04.229486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:04.229486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.229486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.230090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:04.230533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:04.231037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:04.231037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:04.231037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.231037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:04.231037 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:04.231167 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:04.231624 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:04.231624 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:04.231812 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:04.232533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.233606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:04.233606 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:04.233606 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:04.233606 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:04.233606 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:04.233606 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:04.233606 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.233606 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:04.234713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.234713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:04.234713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:04.234713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:04.234713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.234713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:04.234713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:04.234713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.234713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:04.234713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:04.234713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:04.234713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.235213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:04.235213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:04.235213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:04.235213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:04.235213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:04.235213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:04.235213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:04.235213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:04.235213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:04.235213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:04.235213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:04.235213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:04.235213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:04.235792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.235792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:04.235792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.235792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:04.235792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:04.235792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:04.235792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:04.235792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:04.235792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.235792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:04.235792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:04.235792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.235792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:04.235792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:04.235792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:04.236541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:04.237433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:04.237433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:04.237433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:04.237433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:04.237433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:04.237433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:08.740641 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:08.741782 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:08.741782 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:08.743216 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:08.778665 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:08.779086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:08.780043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:08.780043 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:08.780043 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:08.780043 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:08.780043 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:08.780043 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:08.780043 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:08.780043 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:08.781252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:08.781252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:08.781252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:08.781252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:08.781252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:08.781252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:08.781252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:08.781252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:08.781252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:08.781252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:08.781252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:08.781252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:08.781854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:08.781854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:08.781854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:08.781854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:08.781854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:08.781854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:08.781854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:08.781854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:08.781854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:08.781854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:08.781854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:08.781854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:08.781854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:08.782602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:08.782602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:08.782816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:08.782816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:08.782816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:08.782816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:08.782816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:08.782816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:08.782816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:08.782816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:08.782816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:08.782816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:08.782816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:08.782816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:08.782816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:08.782816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:08.782816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:08.782816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:08.783300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:08.783878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:08.783878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:08.783878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:09.208086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:09.208646 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:09.208794 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:09.209537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:09.209711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:09.209861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.210427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:09.210427 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:09.210427 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:09.210427 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:09.210427 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:09.210427 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:09.210427 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.210427 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:09.211291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.211291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:09.211291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:09.211291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:09.211291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.211291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:09.211291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:09.211291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.211291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:09.211291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:09.211291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:09.211291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.211619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:09.211619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:09.211619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:09.211619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:09.211619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:09.211619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:09.211619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:09.211619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:09.211619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:09.211619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:09.211619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:09.211619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:09.211619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:09.211937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.211937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:09.212384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.212384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:09.212384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:09.212384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:09.212384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:09.212384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:09.212384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.212384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:09.212384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:09.212384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.212384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:09.212384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:09.212384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.212384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:09.212384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:09.212384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:09.212775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:09.213234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:09.213234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.213234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:09.216817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:09.217260 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:09.217260 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:09.217360 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:25:09.217746 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:09.217973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.218584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:09.218584 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:09.218584 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:09.218584 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:09.218584 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:09.218584 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:09.218584 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.218584 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:09.219508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.219508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:09.219508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:09.219508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:09.219508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.219508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:09.219508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:09.219508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:09.219508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.219508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:09.219508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:09.219508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:09.219508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:09.219508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:09.219508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:09.219965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:09.219965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:09.219965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:09.219965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:09.219965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:09.219965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:09.219965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:09.219965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.219965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:09.220702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.220702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:09.220702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:09.220702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:09.220702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.220702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:09.220702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:09.220702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:25:09.220702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:09.220702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:09.220702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.220702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:09.221078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:09.221078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:09.221078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.221078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:09.221078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:09.221078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:09.221078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:09.221078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:09.221078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:09.221078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:09.221078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:09.221078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:09.221078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:09.221078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:09.221358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:09.221358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:09.221358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.221358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:09.221951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.221951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:09.221951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:09.221951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:09.221951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:09.221951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:09.221951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.221951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:09.221951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:09.221951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.221951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:09.221951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:09.221951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.221951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:09.221951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:09.221951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:09.222431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:09.222998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:09.222998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:09.222998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:09.222998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:09.222998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:09.222998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.222998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:09.225268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:09.225600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:09.225719 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:09.225846 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:09.226174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:09.226469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.226940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:09.226940 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:09.226940 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:09.226940 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:09.226940 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:09.226940 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:09.226940 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.226940 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:09.227656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.227656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:09.227656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:09.227656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:09.227656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.227656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:09.227656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:09.227656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:09.227656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.227656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:09.227656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:09.227656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:09.227656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:09.227656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:09.227656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:09.228070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:09.228070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:09.228070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:09.228070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:09.228070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:09.228070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:09.228070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:09.228070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.228070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:09.228598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.228598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:09.228598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:09.228598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:09.228598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.228598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:09.228598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:09.228598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:09.228598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:09.228598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.228598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:09.228933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:09.228933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:09.228933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.228933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:09.228933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:09.228933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:09.228933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:09.228933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:09.228933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:09.228933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:09.228933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:09.228933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:09.228933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:09.228933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:09.229321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:09.229321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:09.229321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.229321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:09.230179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:09.230738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:09.230738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:09.230738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.230738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:09.231321 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:09.231636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:09.231744 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:09.231892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:09.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:09.232454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:09.232619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.233064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:09.233064 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:09.233064 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:09.233064 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:09.233064 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:09.233064 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:09.233064 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.233064 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:09.233860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.233860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:09.233860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:09.233860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:09.233860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.233860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:09.233860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:09.233860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.233860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:09.233860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:09.233860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:09.233860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.234249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:09.234249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:09.234249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:09.234249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:09.234249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:09.234249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:09.234249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:09.234249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:09.234249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:09.234249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:09.234249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:09.234249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:09.234249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:09.234684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.234684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:09.234851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.234851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:09.234851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:09.234851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:09.234851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:09.234851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:09.234851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.234851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:09.234851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:09.234851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.234851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:09.234851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:09.234851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.234851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:09.234851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:09.234851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:09.235292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:09.235912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:09.235912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:09.235912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:13.741355 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:13.742651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:13.742651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:13.743627 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:13.782043 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:13.782275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:13.783170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:13.783170 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:13.783170 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:13.783170 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:13.783170 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:13.783170 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:13.783170 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:13.783170 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:13.784206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:13.784206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:13.784206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:13.784206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:13.784206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:13.784206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:13.784206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:13.784206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:13.784206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:13.784206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:13.784206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:13.784206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:13.784910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:13.784910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:13.784910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:13.784910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:13.784910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:13.784910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:13.784910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:13.784910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:13.784910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:13.784910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:13.784910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:13.784910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:13.784910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:13.785640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:13.785640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:13.785640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:13.785640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:13.785640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:13.785640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:13.785640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:13.785640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:13.785640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:13.785640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:13.785640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:13.785640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:13.785640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:13.785640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:13.785640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:13.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:13.787880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:13.787880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:13.787880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:13.787880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:13.787880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:13.787880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:14.208751 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:14.209293 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:14.209536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:14.211208 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:14.211778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:14.212118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.213446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:14.213446 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:14.213446 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:14.213446 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:14.213446 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:14.213446 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:14.213446 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.213446 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:14.215307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.215307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:14.215307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:14.215307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:14.215307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.215307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:14.215307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:14.215307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.215307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:14.215307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:14.215307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:14.215307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.215864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:14.215864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:14.215864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:14.215864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:14.215864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:14.215864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:14.215864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:14.215864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:14.215864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:14.215864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:14.215864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:14.215864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:14.215864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:14.216234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.216234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:14.217144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.217144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:14.217144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:14.217144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:14.217144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:14.217144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:14.217144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.217144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:14.217144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:14.217144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.217144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:14.217144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:14.217144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.217144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:14.217144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:14.217144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:14.217908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:14.218726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:14.218726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.218726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:14.218726 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:14.218726 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:14.218726 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:14.218726 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:25:14.219488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:14.219932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.220839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:14.220839 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:14.220839 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:14.220839 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:14.220839 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:14.220839 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:14.220839 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.220839 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:14.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:14.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:14.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:14.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:14.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:14.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:14.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:14.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:14.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:14.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:14.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:14.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:14.222258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:14.222258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:14.222258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:14.222258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:14.222258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:14.222258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:14.222258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:14.222258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.222258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:14.222669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.222669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:14.222669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:14.222669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:14.222669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.222669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:14.222669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:14.222669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:25:14.222669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:14.222669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:14.222669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.222669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:14.223197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:14.223197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:14.223197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.223197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:14.223197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:14.223197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:14.223197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:14.223197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:14.223197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:14.223197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:14.223197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:14.223197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:14.223197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:14.223197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:14.223764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:14.223764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:14.223764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.223764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:14.223764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.223764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:14.223764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:14.223764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:14.223764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:14.223764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:14.223764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.223764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:14.223764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:14.223764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:14.224481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:14.225101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:14.225101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:14.225101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:14.225101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:14.225101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:14.225101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:14.225101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:14.225101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:14.225101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:14.225101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:14.225101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.225101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:14.225806 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:14.226107 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:14.226208 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:14.226360 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:14.226731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:14.226919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.227433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:14.227433 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:14.227433 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:14.227433 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:14.227433 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:14.227433 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:14.227433 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.227433 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:14.228196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.228196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:14.228196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:14.228196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:14.228196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.228196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:14.228196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:14.228196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:14.228196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.228196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:14.228196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:14.228196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:14.228196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:14.228196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:14.228196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:14.228864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:14.228864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:14.228864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:14.228864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:14.228864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:14.228864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:14.228864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:14.228864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.228864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:14.229246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.229246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:14.229246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:14.229246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:14.229246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.229246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:14.229246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:14.229246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:14.229246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:14.229246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.229246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:14.229784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:14.229784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:14.229784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.229784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:14.229784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:14.229784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:14.229784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:14.229784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:14.229784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:14.229784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:14.229784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:14.229784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:14.229784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:14.229784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:14.230348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:14.230348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:14.230348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.230348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:14.230348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.230348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:14.230348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:14.230348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:14.230348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:14.230348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:14.230348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.230348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:14.230348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:14.230348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:14.230998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:14.231505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:14.231505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:14.231505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:14.231505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:14.231505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:14.231505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:14.231505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:14.231505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:14.231505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:14.231505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.231505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:14.231817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:14.232188 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:14.232339 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:14.232574 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:14.232984 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:14.233170 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:14.233294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.233914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:14.233914 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:14.233914 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:14.233914 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:14.233914 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:14.233914 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:14.233914 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.233914 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:14.235300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.235300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:14.235300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:14.235300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:14.235300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.235300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:14.235300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:14.235300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.235300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:14.235300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:14.235300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:14.235300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.235586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:14.235586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:14.235586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:14.235586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:14.235586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:14.235586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:14.235586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:14.235586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:14.235586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:14.235586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:14.235586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:14.235586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:14.235586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:14.235898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.235898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:14.236652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.236652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:14.236652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:14.236652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:14.236652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:14.236652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:14.236652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.236652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:14.236652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:14.236652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.236652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:14.236652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:14.236652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.236652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:14.236652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:14.236652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:14.237159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:14.238022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:14.238022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:14.238022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:18.742082 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:18.742942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:18.742942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:18.742942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:18.774315 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:18.774783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:18.775665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:18.775665 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:18.775665 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:18.775665 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:18.775665 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:18.775665 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:18.775665 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:18.775665 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:18.776455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:18.776455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:18.776455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:18.776455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:18.776455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:18.776455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:18.776455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:18.776455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:18.776455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:18.776455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:18.776455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:18.776455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:18.776971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:18.776971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:18.776971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:18.776971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:18.776971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:18.776971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:18.776971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:18.776971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:18.776971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:18.776971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:18.776971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:18.776971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:18.776971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:18.777502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:18.777502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:18.777502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:18.777502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:18.777502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:18.777502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:18.777502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:18.777502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:18.777502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:18.777502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:18.777502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:18.777502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:18.777502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:18.777502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:18.777502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:18.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:18.778846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:18.778846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:18.778846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:18.778846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:18.778846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:18.778846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:19.210624 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:19.211461 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:19.211769 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:19.212908 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:19.213101 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:19.213271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.214020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:19.214020 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:19.214020 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:19.214020 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:19.214020 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:19.214020 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:19.214020 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.214020 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:19.215577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.215577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:19.215577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:19.215577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:19.215577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.215577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:19.215577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:19.215577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.215577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:19.215577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:19.215577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:19.215577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.215842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:19.215842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:19.215842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:19.215842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:19.215842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:19.215842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:19.215842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:19.215842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:19.215842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:19.215842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:19.215842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:19.215842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:19.215842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:19.216100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.216100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:19.216767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.216767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:19.216767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:19.216767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:19.216767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:19.216767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:19.216767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.216767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:19.216767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:19.216767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.216767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:19.216767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:19.216767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.216767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:19.216767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:19.216767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:19.217176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:19.217673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:19.217673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.217673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:19.218082 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:19.218213 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:19.218411 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:19.218615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:25:19.219017 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:19.219257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.219884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:19.219884 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:19.219884 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:19.219884 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:19.219884 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:19.219884 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:19.219884 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.219884 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:19.220981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.220981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:19.220981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:19.220981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:19.220981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.220981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:19.220981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:19.220981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:19.220981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.220981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:19.220981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:19.220981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:19.220981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:19.220981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:19.220981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:19.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:19.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:19.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:19.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:19.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:19.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:19.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:19.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.221636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:19.222093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.222093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:19.222093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:19.222093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:19.222093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.222093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:19.222093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:19.222093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:25:19.222093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:19.222093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:19.222093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.222093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:19.222977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:19.222977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:19.222977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.222977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:19.222977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:19.222977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:19.222977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:19.222977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:19.222977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:19.222977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:19.222977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:19.222977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:19.222977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:19.222977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:19.223406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:19.223406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:19.223406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.223406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:19.223406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.223406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:19.223406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:19.223406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:19.223406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:19.223406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:19.223406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.223406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:19.223406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:19.223406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:19.223766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:19.224220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:19.224220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:19.224220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:19.224220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:19.224220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:19.224220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:19.224220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:19.224220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:19.224220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:19.224220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:19.224220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.224220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:19.226233 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:19.226616 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:19.226792 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:19.226992 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:19.227531 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:19.227882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.228825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:19.228825 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:19.228825 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:19.228825 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:19.228825 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:19.228825 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:19.228825 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.228825 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:19.230062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.230062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:19.230062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:19.230062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:19.230062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.230062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:19.230062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:19.230062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:19.230062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.230062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:19.230062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:19.230062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:19.230062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:19.230062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:19.230062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:19.230325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:19.230325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:19.230325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:19.230325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:19.230325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:19.230325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:19.230325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:19.230325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.230325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:19.231473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.231473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:19.231473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:19.231473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:19.231473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.231473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:19.231473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:19.231473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:19.231473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:19.231473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.231473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:19.231691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:19.231691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:19.231691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.231691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:19.231691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:19.231691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:19.231691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:19.231691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:19.231691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:19.231691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:19.231691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:19.231691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:19.231691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:19.231691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:19.231929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:19.231929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:19.231929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.231929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.233115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:19.233430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:19.233757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:19.233757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:19.233757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.233757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:19.233757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:19.233853 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:19.234133 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:19.234236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:19.234722 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:19.235168 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:19.235563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.236294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:19.236294 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:19.236294 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:19.236294 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:19.236294 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:19.236294 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:19.236294 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.236294 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:19.237242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.237242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:19.237242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:19.237242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:19.237242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.237242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:19.237242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:19.237242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.237242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:19.237242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:19.237242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:19.237242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.237916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:19.237916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:19.237916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:19.237916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:19.237916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:19.237916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:19.237916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:19.237916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:19.237916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:19.237916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:19.237916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:19.237916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:19.237916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:19.238261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.238261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:19.238773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.238773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:19.238773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:19.238773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:19.238773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:19.238773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:19.238773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.238773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:19.238773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:19.238773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.238773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:19.238773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:19.238773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.238773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:19.238773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:19.238773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:19.239205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:19.239748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:19.239748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:19.239748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:23.742673 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:23.743499 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:23.743499 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:23.744935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:23.786141 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:23.786834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:23.787863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:23.787863 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:23.787863 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:23.787863 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:23.787863 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:23.787863 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:23.787863 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:23.787863 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:23.789008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.044 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:23.789008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:23.789008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:23.789008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:23.789008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:23.789008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:23.789008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:23.789008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:23.789008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:23.789008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:23.789008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:23.789008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:23.789597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:23.789597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:23.789597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:23.789597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:23.789597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:23.789597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:23.789597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:23.789597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:23.789597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:23.789597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:23.789597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:23.789597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:23.789597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:23.790159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:23.790159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:23.790159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:23.790159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:23.790159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:23.790159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:23.790159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:23.790159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:23.790159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:23.790159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:23.790159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:23.790159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:23.790159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:23.790159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:23.790159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:23.790875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:23.791775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:23.791775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:23.791775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:23.791775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:23.791775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:23.791775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:24.211529 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:24.212150 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:24.212361 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:24.213603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:24.213983 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:24.214273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.215261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:24.215261 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:24.215261 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:24.215261 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:24.215261 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:24.215261 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:24.215261 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.215261 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:24.216905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.216905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:24.216905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:24.216905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:24.216905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.216905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:24.216905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:24.216905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.216905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:24.216905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:24.216905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:24.216905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.217486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:24.217486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:24.217486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:24.217486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:24.217486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:24.217486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:24.217486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:24.217486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:24.217486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:24.217486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:24.217486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:24.217486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:24.217486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:24.218084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.218084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:24.218722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.218722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:24.218722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:24.218722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:24.218722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:24.218722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:24.218722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.218722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:24.218722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:24.218722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.218722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:24.218722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:24.218722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.218722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:24.218722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:24.218722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:24.219465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:24.220287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:24.220287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.220287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:24.220864 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:24.221190 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:24.221383 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:24.221574 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:25:24.222197 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:24.222629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.223392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:24.223392 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:24.223392 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:24.223392 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:24.223392 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:24.223392 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:24.223392 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.223392 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:24.224738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.224738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:24.224738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:24.224738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:24.224738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.224738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:24.224738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:24.224738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:24.224738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.224738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:24.224738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:24.224738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:24.224738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:24.224738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:24.224738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:24.225546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:24.225546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:24.225546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:24.225546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:24.225546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:24.225546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:24.225546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:24.225546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.225546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:24.225995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.225995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:24.225995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:24.225995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:24.225995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.225995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:24.225995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:24.225995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:25:24.225995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:24.225995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:24.225995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.225995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:24.226856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:24.226856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:24.226856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.226856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:24.226856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:24.226856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:24.226856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:24.226856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:24.226856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:24.226856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:24.226856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:24.226856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:24.226856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:24.226856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:24.228097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:24.228097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:24.228097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.228097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:24.228097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.228097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:24.228097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:24.228097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:24.228097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:24.228097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:24.228097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.228097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:24.228097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:24.228097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:24.228897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:24.229775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:24.229775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:24.229775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:24.229775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:24.229775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:24.229775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:24.229775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:24.229775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:24.229775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:24.229775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:24.229775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.229775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:24.229775 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:24.229775 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:24.230173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:24.230173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:24.230173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:24.230173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.230173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:24.230173 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:24.230173 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:24.230173 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:24.230173 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:24.230173 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:24.230173 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.230173 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:24.230554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.230554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:24.230554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:24.230554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:24.230554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.230554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:24.230554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:24.230554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:24.230554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.230554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:24.230554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:24.230554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:24.230554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:24.230554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:24.230554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:24.230956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:24.230956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:24.230956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:24.230956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:24.230956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:24.230956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:24.230956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:24.230956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.230956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:24.230956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.230956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:24.230956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:24.230956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:24.230956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.231362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:24.231362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:24.231362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:24.231362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:24.231362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.231362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:24.231362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:24.231362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:24.231362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.231362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:24.231362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:24.231362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:24.231362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:24.231737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:24.231737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:24.231737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:24.231737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:24.231737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:24.231737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:24.231737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:24.231737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:24.231737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:24.231737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.231737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.232168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:24.232773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:24.233426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:24.233426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:24.233426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.233426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:24.233897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:24.234119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:24.234216 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:24.234379 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:24.234811 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:24.235082 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:24.235264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.235817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:24.235817 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:24.235817 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:24.235817 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:24.235817 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:24.235817 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:24.235817 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.235817 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:24.236637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.236637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:24.236637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:24.236637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:24.236637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.236637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:24.236637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:24.236637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.236637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:24.236637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:24.236637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:24.236637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.237006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:24.237006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:24.237006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:24.237006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:24.237006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:24.237006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:24.237006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:24.237006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:24.237006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:24.237006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:24.237006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:24.237006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:24.237006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:24.237409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.237409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:24.237618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.237618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:24.237618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:24.237618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:24.237618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:24.237618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:24.237618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.237618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:24.237618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:24.237618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.237618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:24.237618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:24.237618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.237618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:24.237618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:24.237618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:24.238105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:24.238662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:24.238662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:24.238662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:28.743251 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:28.744125 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:28.744125 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:28.745427 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:28.774343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:28.774765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:28.775638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:28.775638 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:28.775638 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:28.775638 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:28.775638 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:28.775638 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:28.775638 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:28.775638 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:28.776396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.032 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:28.776396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:28.776396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:28.776396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:28.776396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:28.776396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:28.776396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:28.776396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:28.776396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:28.776396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:28.776396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:28.776396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:28.777091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:28.777091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:28.777091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:28.777091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:28.777091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:28.777091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:28.777091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:28.777091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:28.777091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:28.777091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:28.777091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:28.777091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:28.777091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:28.778020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:28.778020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:28.778020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:28.778020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:28.778020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:28.778020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:28.778020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:28.778020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:28.778020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:28.778020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:28.778020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:28.778020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:28.778020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:28.778020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:28.778020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:28.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:28.779269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:28.779269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:28.779269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:28.779269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:28.779269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:28.779269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:29.212059 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:29.212596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:29.212743 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:29.213635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:29.213985 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:29.214325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.215181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:29.215181 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:29.215181 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:29.215181 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:29.215181 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:29.215181 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:29.215181 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.215181 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:29.216313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.216313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:29.216313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:29.216313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:29.216313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.216313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:29.216313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:29.216313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.216313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:29.216313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:29.216313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:29.216313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.217008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:29.217008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:29.217008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:29.217008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:29.217008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:29.217008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:29.217008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:29.217008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:29.217008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:29.217008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:29.217008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:29.217008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:29.217008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:29.217578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.217578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:29.217578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.217578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:29.217578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:29.217578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:29.217578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:29.217578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:29.217578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.217578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:29.217578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:29.217578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.217578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:29.217578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:29.217578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:29.218570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:29.219106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:29.219106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:29.219106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:29.219106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:29.219106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.219106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:29.221407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:29.221749 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:29.221853 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:29.221976 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:25:29.222394 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:29.222541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.222955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:29.222955 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:29.222955 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:29.222955 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:29.222955 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:29.222955 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:29.222955 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.222955 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:29.223701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.223701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:29.223701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:29.223701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:29.223701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.223701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:29.223701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:29.223701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:29.223701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.223701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:29.223701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:29.223701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:29.223701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:29.223701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:29.223701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:29.224620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:29.224620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:29.224620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:29.224620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:29.224620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:29.224620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:29.224620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:29.224620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.224620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:29.224620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.224620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:29.224620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:29.224620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:29.224620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.225474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:29.225474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:29.225474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:25:29.225474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:29.225474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:29.225474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.225474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:29.225474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:29.225474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:29.225474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.225474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:29.225474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:29.225474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:29.226317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:29.226317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:29.226317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:29.226317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:29.226317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:29.226317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:29.226317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:29.226317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:29.226317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:29.226317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:29.226317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.226317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:29.226831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.226831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:29.226831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:29.226831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:29.226831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:29.226831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:29.226831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.226831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:29.226831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:29.226831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.226831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:29.226831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:29.226831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.226831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:29.226831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:29.226831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:29.227302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:29.227826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:29.227826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:29.227826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:29.227826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:29.227826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:29.227826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.227826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:29.228021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:29.228338 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:29.228478 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:29.228618 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:29.228866 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:29.229030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.229405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:29.229405 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:29.229405 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:29.229405 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:29.229405 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:29.229405 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:29.229405 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.229405 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:29.230205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.230205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:29.230205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:29.230205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:29.230205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.230205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:29.230205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:29.230205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:29.230205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.230205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:29.230205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:29.230205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:29.230205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:29.230205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:29.230205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:29.230687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:29.230687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:29.230687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:29.230687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:29.230687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:29.230687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:29.230687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:29.230687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.230687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:29.231145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.231145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:29.231145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:29.231145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:29.231145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.231145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:29.231145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:29.231145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:29.231145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:29.231145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.231145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:29.231562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:29.231562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:29.231562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.231562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:29.231562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:29.231562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:29.231562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:29.231562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:29.231562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:29.231562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:29.231562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:29.231562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:29.231562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:29.231562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:29.232018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:29.232018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:29.232018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.232018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.232303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:29.232820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:29.233312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:29.233312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:29.233312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.233312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:29.234330 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:29.234713 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:29.234840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:29.235007 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:29.235464 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:29.235802 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:29.236033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.236721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:29.236721 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:29.236721 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:29.236721 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:29.236721 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:29.236721 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:29.236721 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.236721 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:29.237578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.237578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:29.237578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:29.237578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:29.237578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.237578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:29.237578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:29.237578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.237578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:29.237578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:29.237578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:29.237578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.237962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:29.237962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:29.237962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:29.237962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:29.237962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:29.237962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:29.237962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:29.237962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:29.237962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:29.237962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:29.237962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:29.237962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:29.237962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:29.238346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.238346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:29.238694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.238694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:29.238694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:29.238694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:29.238694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:29.238694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:29.238694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.238694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:29.238694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:29.238694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.238694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:29.238694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:29.238694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.238694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:29.238694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:29.238694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:29.239179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:29.239745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:29.239745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:29.239745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:33.744046 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:33.744800 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:33.744800 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:33.746058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:33.778385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:33.778839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:33.779672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:33.779672 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:33.779672 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:33.779672 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:33.779672 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:33.779672 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:33.779672 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:33.779672 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:33.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:33.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:33.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:33.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:33.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:33.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:33.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:33.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:33.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:33.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:33.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:33.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:33.781136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:33.781136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:33.781136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:33.781136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:33.781136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:33.781136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:33.781136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:33.781136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:33.781136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:33.781136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:33.781136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:33.781136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:33.781136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:33.781809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:33.781809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:33.781809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:33.781809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:33.781809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:33.781809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:33.781809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:33.781809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:33.781809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:33.781809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:33.781809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:33.781809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:33.781809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:33.781809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:33.781809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:33.782615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:33.783877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:33.783877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:33.783877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:33.783877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:33.783877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:33.783877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:34.212666 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:34.213639 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:34.213863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:34.214907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:34.215229 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:34.215550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.216464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:34.216464 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:34.216464 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:34.216464 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:34.216464 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:34.216464 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:34.216464 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.216464 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:34.218067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.218067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:34.218067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:34.218067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:34.218067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.218067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:34.218067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:34.218067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.218067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:34.218067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:34.218067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:34.218067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.218774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:34.218774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:34.218774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:34.218774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:34.218774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:34.218774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:34.218774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:34.218774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:34.218774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:34.218774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:34.218774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:34.218774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:34.218774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:34.219391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.219391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:34.219900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.219900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:34.219900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:34.219900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:34.219900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:34.219900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:34.219900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.219900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:34.219900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:34.219900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.219900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:34.219900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:34.219900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.219900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:34.219900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:34.219900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:34.220799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:34.221297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:34.221297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.221297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:34.221810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:34.222034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:34.222157 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:34.222270 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:25:34.222784 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:34.223088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.223870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:34.223870 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:34.223870 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:34.223870 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:34.223870 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:34.223870 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:34.223870 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.223870 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:34.224769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.224769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:34.224769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:34.224769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:34.224769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.224769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:34.224769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:34.224769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:34.224769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.224769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:34.224769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:34.224769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:34.224769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:34.224769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:34.224769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:34.225221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:34.225221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:34.225221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:34.225221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:34.225221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:34.225221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:34.225221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:34.225221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.225221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:34.225654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.225654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:34.225654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:34.225654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:34.225654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.225654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:34.225654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:34.225654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:25:34.225654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:34.225654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:34.225654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.225654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:34.225983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:34.225983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:34.225983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.225983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:34.225983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:34.225983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:34.225983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:34.225983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:34.225983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:34.225983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:34.225983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:34.225983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:34.225983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:34.225983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:34.226350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:34.226350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:34.226350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.226350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:34.226693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.226693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:34.226693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:34.226693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:34.226693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:34.226693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:34.226693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.226693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:34.226693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:34.226693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.226693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:34.226693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:34.226693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.226693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:34.226693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:34.226693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:34.227182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:34.227663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:34.227663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:34.227663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:34.227663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:34.227663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:34.227663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.227663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:34.228407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:34.228613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:34.228740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:34.228865 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:34.229379 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:34.229820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.230520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:34.230520 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:34.230520 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:34.230520 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:34.230520 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:34.230520 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:34.230520 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.230520 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:34.231355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.231355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:34.231355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:34.231355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:34.231355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.231355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:34.231355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:34.231355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:34.231355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.231355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:34.231355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:34.231355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:34.231355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:34.231355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:34.231355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:34.232282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:34.232282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:34.232282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:34.232282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:34.232282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:34.232282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:34.232282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:34.232282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.232282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:34.232282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.232282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:34.232282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:34.232282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:34.232282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.233065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:34.233065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:34.233065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:34.233065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:34.233065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.233065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:34.233065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:34.233065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:34.233065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.233065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:34.233065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:34.233065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:34.233065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:34.233725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:34.233725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:34.233725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:34.233725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:34.233725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:34.233725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:34.233725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:34.233725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:34.233725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:34.233725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.233725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:34.233725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:34.234316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.235987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:34.237414 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:34.237414 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:34.237414 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:34.237414 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:34.237414 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:34.237414 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:34.237779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.237779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:34.237779 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:34.237779 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:34.237779 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:34.237779 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:34.237779 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:34.237779 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.237779 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:34.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:34.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:34.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:34.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:34.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:34.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:34.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:34.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:34.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.238986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:34.238986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:34.238986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:34.238986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:34.238986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:34.238986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:34.238986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:34.238986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:34.238986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:34.238986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:34.238986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:34.238986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:34.238986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:34.239331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.239331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:34.239514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.239514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:34.239514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:34.239514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:34.239514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:34.239514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:34.239514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.239514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:34.239514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:34.239514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.239514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:34.239514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:34.239514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.239514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:34.239514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:34.239514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:34.240000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:34.240515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:34.240515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:34.240515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:38.744741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:38.745874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:38.746033 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:38.746917 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:38.780621 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:38.781187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:38.782264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:38.782264 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:38.782264 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:38.782264 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:38.782264 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:38.782264 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:38.782264 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:38.782264 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:38.783495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:38.783495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:38.783495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:38.783495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:38.783495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:38.783495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:38.783495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:38.783495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:38.783495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:38.783495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:38.783495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:38.783495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:38.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:38.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:38.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:38.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:38.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:38.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:38.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:38.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:38.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:38.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:38.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:38.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:38.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:38.784742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:38.784742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:38.784974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:38.784974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:38.784974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:38.784974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:38.784974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:38.784974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:38.784974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:38.784974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:38.784974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:38.784974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:38.784974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:38.784974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:38.784974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:38.784974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:38.784974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:38.784974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:38.785795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:38.787186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:38.787186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:38.787186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:39.213799 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:39.214243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:39.214421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:39.215130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:39.215335 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:39.215552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.216220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:39.216220 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:39.216220 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:39.216220 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:39.216220 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:39.216220 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:39.216220 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.216220 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:39.217178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.217178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:39.217178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:39.217178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:39.217178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.217178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:39.217178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:39.217178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.217178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:39.217178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:39.217178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:39.217178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.217835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:39.217835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:39.217835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:39.217835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:39.217835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:39.217835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:39.217835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:39.217835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:39.217835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:39.217835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:39.217835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:39.217835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:39.217835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:39.218519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.218519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:39.218519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.218519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:39.218519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:39.218519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:39.218519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:39.218519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:39.218519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.218519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:39.218519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:39.218519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.218519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:39.218519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:39.218519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:39.219293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:39.220263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:39.220263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:39.220263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:39.220263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:39.220263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.220263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:39.222194 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:39.222556 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:39.222681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:39.222791 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:25:39.223123 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:39.223309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.223772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:39.223772 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:39.223772 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:39.223772 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:39.223772 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:39.223772 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:39.223772 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.223772 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:39.224670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.224670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:39.224670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:39.224670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:39.224670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.224670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:39.224670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:39.224670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:39.224670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.224670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:39.224670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:39.224670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:39.224670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:39.224670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:39.224670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:39.225688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:39.225688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:39.225688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:39.225688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:39.225688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:39.225688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:39.225688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:39.225688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.225688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:39.226261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.226261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:39.226261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:39.226261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:39.226261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.226261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:39.226261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:39.226261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:25:39.226261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:39.226261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:39.226261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.226261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:39.226631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:39.226631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:39.226631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.226631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:39.226631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:39.226631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:39.226631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:39.226631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:39.226631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:39.226631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:39.226631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:39.226631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:39.226631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:39.226631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:39.227025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:39.227025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:39.227025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.227025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:39.227919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.227919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:39.227919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:39.227919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:39.227919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:39.227919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:39.227919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.227919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:39.227919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:39.227919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.227919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:39.227919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:39.227919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.227919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:39.227919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:39.227919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:39.228360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:39.228870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:39.228870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:39.228870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:39.228870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:39.228870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:39.228870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.228870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:39.228870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:39.229153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:39.229153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:39.229221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:39.229475 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:39.229689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.230121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:39.230121 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:39.230121 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:39.230121 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:39.230121 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:39.230121 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:39.230121 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.230121 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:39.230928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.230928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:39.230928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:39.230928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:39.230928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.230928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:39.230928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:39.230928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:39.230928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.230928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:39.230928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:39.230928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:39.230928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:39.230928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:39.230928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:39.231344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:39.231344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:39.231344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:39.231344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:39.231344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:39.231344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:39.231344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:39.231344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.231344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:39.231839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.231839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:39.231839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:39.231839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:39.231839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.231839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:39.231839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:39.231839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:39.231839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:39.231839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.231839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:39.232178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:39.232178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:39.232178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.232178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:39.232178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:39.232178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:39.232178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:39.232178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:39.232178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:39.232178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:39.232178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:39.232178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:39.232178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:39.232178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:39.232605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:39.232605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:39.232605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.232605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.232974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:39.233486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:39.234083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:39.234083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:39.234083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.234083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:39.235260 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:39.235632 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:39.235781 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:39.235936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:39.236419 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:39.236803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:39.237060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.237882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:39.237882 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:39.237882 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:39.237882 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:39.237882 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:39.237882 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:39.237882 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.237882 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:39.238674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.238674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:39.238674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:39.238674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:39.238674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.238674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:39.238674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:39.238674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.238674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:39.238674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:39.238674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:39.238674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.239022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:39.239022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:39.239022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:39.239022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:39.239022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:39.239022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:39.239022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:39.239022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:39.239022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:39.239022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:39.239022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:39.239022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:39.239022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:39.239415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.239415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:39.239624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.239624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:39.239624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:39.239624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:39.239624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:39.239624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:39.239624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.239624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:39.239624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:39.239624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.239624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:39.239624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:39.239624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.239624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:39.239624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:39.239624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:39.240027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:39.240545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:39.240545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:39.240545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:43.746194 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:43.747216 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:43.747216 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:43.747752 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:43.780890 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:43.781254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:43.781994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:43.781994 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:43.781994 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:43.781994 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:43.781994 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:43.781994 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:43.781994 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:43.781994 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:43.783027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:43.783027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:43.783027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:43.783027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:43.783027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:43.783027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:43.783027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:43.783027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:43.783027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:43.783027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:43.783027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:43.783027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:43.783418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:43.783418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:43.783418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:43.783418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:43.783418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:43.783418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:43.783418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:43.783418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:43.783418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:43.783418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:43.783418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:43.783418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:43.783418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:43.783808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:43.783808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:43.784075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:43.784075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:43.784075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:43.784075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:43.784075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:43.784075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:43.784075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:43.784075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:43.784075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:43.784075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:43.784075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:43.784075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:43.784075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:43.784075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:43.784075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:43.784075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:43.784699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:43.785217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:43.785217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:43.785217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:44.214419 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:44.215412 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:44.215822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:44.217167 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:44.217551 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:44.217822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.218878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:44.218878 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:44.218878 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:44.218878 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:44.218878 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:44.218878 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:44.218878 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.218878 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:44.220573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.220573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:44.220573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:44.220573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:44.220573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.220573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:44.220573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:44.220573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.220573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:44.220573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:44.220573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:44.220573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.221470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:44.221470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:44.221470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:44.221470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:44.221470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:44.221470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:44.221470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:44.221470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:44.221470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:44.221470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:44.221470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:44.221470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:44.221470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:44.222333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.222333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:44.222333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.222333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:44.222333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:44.222333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:44.222333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:44.222333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:44.222333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.222333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:44.222333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:44.222333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.222333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:44.222333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:44.222333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:44.223028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:44.223557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:44.223557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:44.223557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:44.223557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:44.223557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.223557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:44.223557 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:44.223557 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:44.223557 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:44.223557 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:25:44.223877 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:44.224207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.225041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:44.225041 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:44.225041 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:44.225041 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:44.225041 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:44.225041 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:44.225041 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.225041 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:44.225815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.225815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:44.225815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:44.225815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:44.225815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.225815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:44.225815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:44.225815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:44.225815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.225815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:44.225815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:44.225815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:44.225815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:44.225815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:44.225815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:44.226518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:44.226518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:44.226518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:44.226518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:44.226518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:44.226518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:44.226518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:44.226518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.226518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:44.227272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.227272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:44.227272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:44.227272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:44.227272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.227272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:44.227272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:44.227272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:25:44.227272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:44.227272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:44.227272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.227272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:44.227699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:44.227699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:44.227699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.227699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:44.227699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:44.227699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:44.227699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:44.227699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:44.227699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:44.227699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:44.227699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:44.227699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:44.227699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:44.227699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:44.228059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:44.228059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:44.228059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.228059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:44.228199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.228199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:44.228199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:44.228199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:44.228199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:44.228199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:44.228199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.228199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:44.228199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:44.228199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.228199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:44.228199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:44.228199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.228199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:44.228199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:44.228199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:44.228709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:44.229276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:44.229276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:44.229276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:44.229276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:44.229276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:44.229276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.229276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:44.229276 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:44.229276 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:44.229604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:44.229604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:44.230246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:44.230801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.231723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:44.231723 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:44.231723 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:44.231723 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:44.231723 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:44.231723 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:44.231723 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.231723 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:44.232456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.232456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:44.232456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:44.232456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:44.232456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.232456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:44.232456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:44.232456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:44.232456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.232456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:44.232456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:44.232456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:44.232456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:44.232456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:44.232456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:44.232881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:44.232881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:44.232881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:44.232881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:44.232881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:44.232881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:44.232881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:44.232881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.232881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:44.233334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.233334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:44.233334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:44.233334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:44.233334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.233334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:44.233334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:44.233334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:44.233334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:44.233334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.233334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:44.233723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:44.233723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:44.233723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.233723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:44.233723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:44.233723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:44.233723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:44.233723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:44.233723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:44.233723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:44.233723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:44.233723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:44.233723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:44.233723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:44.234127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:44.234127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:44.234127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.234127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.234382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:44.234899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:44.235461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:44.235461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:44.235461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.235461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:44.235821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:44.236116 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:44.236213 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:44.236486 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:44.236814 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:44.237120 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:44.237280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.237858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:44.237858 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:44.237858 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:44.237858 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:44.237858 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:44.237858 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:44.237858 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.237858 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:44.238713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.238713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:44.238713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:44.238713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:44.238713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.238713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:44.238713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:44.238713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.238713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:44.238713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:44.238713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:44.238713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:44.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:44.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:44.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:44.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:44.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:44.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:44.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:44.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:44.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:44.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:44.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:44.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:44.239421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.239421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:44.239718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.239718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:44.239718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:44.239718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:44.239718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:44.239718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:44.239718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.239718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:44.239718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:44.239718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.239718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:44.239718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:44.239718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.239718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:44.239718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:44.239718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:44.240154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:44.240740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:44.240740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:44.240740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:48.746738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:48.747345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:48.747345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:48.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:48.778724 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:48.778950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:48.779700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:48.779700 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:48.779700 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:48.779700 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:48.779700 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:48.779700 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:48.779700 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:48.779700 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:48.780793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.032 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:48.780793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:48.780793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:48.780793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:48.780793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:48.780793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:48.780793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:48.780793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:48.780793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:48.780793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:48.780793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:48.780793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:48.781438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:48.781438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:48.781438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:48.781438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:48.781438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:48.781438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:48.781438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:48.781438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:48.781438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:48.781438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:48.781438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:48.781438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:48.781438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:48.782051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:48.782051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:48.782051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:48.782051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:48.782051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:48.782051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:48.782051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:48.782051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:48.782051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:48.782051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:48.782051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:48.782051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:48.782051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:48.782051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:48.782051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:48.782782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:48.783679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:48.783679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:48.783679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:48.783679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:48.783679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:48.783679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:49.215406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:49.215917 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:49.216046 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:49.217103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:49.217484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:49.217764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.218621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:49.218621 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:49.218621 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:49.218621 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:49.218621 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:49.218621 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:49.218621 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.218621 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:49.220014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.220014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:49.220014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:49.220014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:49.220014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.220014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:49.220014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:49.220014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.220014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:49.220014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:49.220014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:49.220014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.220586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:49.220586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:49.220586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:49.220586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:49.220586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:49.220586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:49.220586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:49.220586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:49.220586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:49.220586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:49.220586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:49.220586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:49.220586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:49.220966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.220966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:49.221899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.221899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:49.221899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:49.221899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:49.221899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:49.221899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:49.221899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.221899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:49.221899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:49.221899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.221899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:49.221899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:49.221899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.221899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:49.221899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:49.221899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:49.222492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:49.223146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:49.223146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.223146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:49.223146 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:49.223583 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:49.223713 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:49.223842 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:25:49.224308 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:49.224554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.225206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:49.225206 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:49.225206 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:49.225206 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:49.225206 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:49.225206 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:49.225206 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.225206 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:49.226385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.226385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:49.226385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:49.226385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:49.226385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.226385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:49.226385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:49.226385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:49.226385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.226385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:49.226385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:49.226385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:49.226385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:49.226385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:49.226385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:49.226849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:49.226849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:49.226849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:49.226849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:49.226849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:49.226849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:49.226849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:49.226849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.226849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:49.227601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.227601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:49.227601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:49.227601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:49.227601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.227601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:49.227601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:49.227601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:25:49.227601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:49.227601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:49.227601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.227601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:49.228065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:49.228065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:49.228065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.228065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:49.228065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:49.228065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:49.228065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:49.228065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:49.228065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:49.228065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:49.228065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:49.228065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:49.228065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:49.228065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:49.228556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:49.228556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:49.228556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.228556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:49.229071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.229071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:49.229071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:49.229071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:49.229071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:49.229071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:49.229071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.229071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:49.229071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:49.229071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.229071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:49.229071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:49.229071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.229071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:49.229071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:49.229071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:49.229620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:49.230316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:49.230316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:49.230316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:49.230316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:49.230316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:49.230316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.230316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:49.230316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:49.230316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:49.230316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:49.230794 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:49.230794 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:49.231026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.231735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:49.231735 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:49.231735 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:49.231735 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:49.231735 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:49.231735 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:49.231735 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.231735 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:49.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:49.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:49.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:49.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:49.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:49.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:49.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:49.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:49.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:49.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:49.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:49.232446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:49.233066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:49.233066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:49.233066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:49.233066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:49.233066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:49.233066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:49.233066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:49.233066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.233066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:49.233066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.233066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:49.233066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:49.233066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:49.233066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.233709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:49.233709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:49.233709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:49.233709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:49.233709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.233709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:49.233709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:49.233709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:49.233709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.233709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:49.233709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:49.233709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:49.233709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:49.234106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:49.234106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:49.234106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:49.234106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:49.234106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:49.234106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:49.234106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:49.234106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:49.234106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:49.234106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.234106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:49.234106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:49.234578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.235146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:49.236296 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:49.236563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:49.236636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:49.236757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:49.237133 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:49.237608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:49.237848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.238599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:49.238599 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:49.238599 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:49.238599 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:49.238599 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:49.238599 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:49.238599 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.238599 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:49.239583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.239583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:49.239583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:49.239583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:49.239583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.239583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:49.239583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:49.239583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.239583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:49.239583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:49.239583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:49.239583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.240156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:49.240156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:49.240156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:49.240156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:49.240156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:49.240156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:49.240156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:49.240156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:49.240156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:49.240156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:49.240156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:49.240156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:49.240156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:49.240687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.240687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:49.240687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.240687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:49.240687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:49.240687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:49.240687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:49.240687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:49.240687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.240687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:49.240687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:49.240687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.240687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:49.240687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:49.240687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:49.241158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:49.241725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:49.241725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:49.241725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:49.241725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:49.241725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:49.241725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:53.747807 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:53.748681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:53.748681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:53.749761 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:53.758027 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=325,neutron:UPDATE=1 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:25:53.785979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:53.786268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:53.786953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:53.786953 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:53.786953 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:53.786953 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:53.786953 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:53.786953 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:53.786953 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:53.786953 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:53.787762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:53.787762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:53.787762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:53.787762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:53.787762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:53.787762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:53.787762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:53.787762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:53.787762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:53.787762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:53.787762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:53.787762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:53.788003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:53.788003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:53.788003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:53.788003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:53.788003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:53.788003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:53.788003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:53.788003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:53.788003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:53.788003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:53.788003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:53.788003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:53.788003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:53.788247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:53.788247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:53.788539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:53.788539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:53.788539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:53.788539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:53.788539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:53.788539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:53.788539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:53.788539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:53.788539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:53.788539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:53.788539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:53.788539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:53.788539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:53.788539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:53.788539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:53.788539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:53.788825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:53.789155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:53.789155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:53.789155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:54.216184 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:54.216850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:54.217091 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:54.218132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:54.218382 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:54.218530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.219741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:54.219741 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:54.219741 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:54.219741 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:54.219741 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:54.219741 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:54.219741 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.219741 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:54.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:54.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:54.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:54.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:54.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:54.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:54.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:54.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:54.220676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.221404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:54.221404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:54.221404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:54.221404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:54.221404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:54.221404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:54.221404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:54.221404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:54.221404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:54.221404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:54.221404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:54.221404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:54.221404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:54.221897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.221897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:54.221897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.221897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:54.221897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:54.221897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:54.221897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:54.221897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:54.221897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.221897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:54.221897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:54.221897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.221897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:54.221897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:54.221897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:54.222560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:54.223436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:54.223436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:54.223436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:54.223436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:54.223436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.223436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:54.224138 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:54.224449 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:54.224564 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:54.224746 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:25:54.225085 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:54.225277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.225729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:54.225729 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:54.225729 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:54.225729 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:54.225729 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:54.225729 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:54.225729 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.225729 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:54.226583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.226583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:54.226583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:54.226583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:54.226583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.226583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:54.226583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:54.226583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:54.226583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.226583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:54.226583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:54.226583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:54.226583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:54.226583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:54.226583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:54.226971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:54.226971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:54.226971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:54.226971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:54.226971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:54.226971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:54.226971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:54.226971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.226971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:54.227466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.227466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:54.227466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:54.227466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:54.227466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.227466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:54.227466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:54.227466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:25:54.227466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:54.227466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:54.227466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.227466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:54.227799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:54.227799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:54.227799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.227799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:54.227799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:54.227799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:54.227799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:54.227799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:54.227799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:54.227799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:54.227799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:54.227799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:54.227799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:54.227799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:54.228157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:54.228157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:54.228157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.228157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:54.228477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.228477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:54.228477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:54.228477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:54.228477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:54.228477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:54.228477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.228477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:54.228477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:54.228477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.228477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:54.228477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:54.228477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.228477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:54.228477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:54.228477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:54.228888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:54.229324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:54.229324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:54.229324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:54.229324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:54.229324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:54.229324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.229324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:54.230301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:54.231274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:54.231643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:54.232004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:54.232543 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:54.232915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.233845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:54.233845 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:54.233845 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:54.233845 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:54.233845 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:54.233845 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:54.233845 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.233845 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:54.235362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.235362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:54.235362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:54.235362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:54.235362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.235362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:54.235362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:54.235362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:54.235362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.235362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:54.235362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:54.235362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:54.235362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:54.235362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:54.235362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:54.235811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:54.235811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:54.235811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:54.235811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:54.235811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:54.235811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:54.235811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:54.235811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.235811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:54.237116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.237116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:54.237116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:54.237116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:54.237116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.237116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:54.237116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:54.237116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:54.237116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:54.237116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.237116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:54.237458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:54.237458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:54.237458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.237458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:54.237458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:54.237458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:54.237458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:54.237458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:54.237458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:54.237458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:54.237458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:54.237458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:54.237458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:54.237458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:54.237812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:54.237812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:54.237812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.237812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:54.237812 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.240016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:54.240495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:54.240939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:54.240939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:54.240939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.240939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:54.240939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:54.240939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:54.240939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:54.240939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:54.241200 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:54.241200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.241467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:54.241467 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:54.241467 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:54.241467 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:54.241467 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:54.241467 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:54.241467 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.241467 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:54.242037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.242037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:54.242037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:54.242037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:54.242037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.242037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:54.242037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:54.242037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.242037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:54.242037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:54.242037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:54.242037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.242660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:54.242660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:54.242660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:54.242660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:54.242660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:54.242660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:54.242660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:54.242660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:54.242660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:54.242660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:54.242660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:54.242660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:54.242660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:54.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:54.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:54.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:54.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:54.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:54.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:54.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:54.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:54.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:54.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:54.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:54.244000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:54.244991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:54.244991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:54.244991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:54.244991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:54.244991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:54.244991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:58.748634 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:58.749474 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:58.749474 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:58.750280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:58.782847 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:58.783231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:58.784036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:58.784036 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:58.784036 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:58.784036 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:58.784036 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:58.784036 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:58.784036 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:58.784036 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:58.785165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:58.785165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:58.785165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:58.785165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:58.785165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:58.785165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:58.785165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:58.785165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:58.785165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:58.785165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:58.785165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:58.785165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:58.785928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:58.785928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:58.785928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:58.785928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:58.785928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:58.785928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:58.785928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:58.785928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:58.785928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:58.785928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:58.785928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:58.785928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:58.785928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:58.786635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:58.786635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:58.786635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:58.786635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:58.786635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:58.786635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:58.786635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:58.786635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:58.786635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:58.786635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:58.786635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:58.786635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:58.786635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:58.786635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:58.786635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:58.787330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:58.788228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:58.788228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:58.788228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:58.788228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:58.788228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:58.788228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:59.216912 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:59.217398 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:59.217665 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:59.218656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:59.219032 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:59.219356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.220238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:59.220238 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:59.220238 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:59.220238 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:59.220238 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:59.220238 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:59.220238 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.220238 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:59.222110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.222110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:59.222110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:59.222110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:59.222110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.222110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:59.222110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:59.222110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.222110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:59.222110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:59.222110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:59.222110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.222577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:59.222577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:59.222577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:59.222577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:59.222577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:59.222577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:59.222577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:59.222577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:59.222577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:59.222577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:59.222577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:59.222577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:59.222577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:59.223065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.223065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:59.225047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.225047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:59.225047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:59.225047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:59.225047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:59.225047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:59.225047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.225047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:59.225047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:59.225047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.225047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:59.225047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:59.225047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.225047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:59.225047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:59.225047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:59.225566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:59.226112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:59.226112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.226112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:59.226112 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:59.226112 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:59.226112 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:59.226310 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:25:59.226542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:59.226746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.227111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:59.227111 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:59.227111 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:59.227111 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:59.227111 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:59.227111 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:59.227111 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.227111 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:59.227776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.227776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:59.227776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:59.227776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:59.227776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.227776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:59.227776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:59.227776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:59.227776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.227776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:59.227776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:59.227776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:59.227776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:59.227776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:59.227776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:59.228251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:59.228251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:59.228251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:59.228251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:59.228251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:59.228251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:59.228251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:59.228251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.228251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:59.228810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.228810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:59.228810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:59.228810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:59.228810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.228810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:59.228810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:59.228810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:25:59.228810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:59.228810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:59.228810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.228810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:59.229182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:59.229182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:59.229182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.229182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:59.229182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:59.229182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:59.229182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:59.229182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:59.229182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:59.229182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:59.229182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:59.229182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:59.229182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:59.229182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:59.229634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:59.229634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:59.229634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.229634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:59.229926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.229926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:59.229926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:59.229926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:59.229926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:59.229926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:59.229926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.229926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:59.229926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:59.229926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.229926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:59.229926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:59.229926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.229926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:59.229926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:59.229926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:59.230405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:59.231005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:59.231005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:59.231005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:59.231005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:59.231005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:59.231005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.231005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:59.231005 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:59.231226 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:59.231461 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:59.231515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:59.231711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:59.231919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.232265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:59.232265 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:59.232265 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:59.232265 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:59.232265 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:59.232265 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:59.232265 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.232265 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:59.232889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.232889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:25:59.232889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:59.232889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:59.232889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.232889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:59.232889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:59.232889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:59.232889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.232889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:25:59.232889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:59.232889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:25:59.232889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:59.232889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:25:59.232889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:25:59.233330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:59.233330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:25:59.233330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:59.233330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:25:59.233330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:25:59.233330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:59.233330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:25:59.233330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.233330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:25:59.233863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.233863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:59.233863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:59.233863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:59.233863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.233863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:59.233863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:59.233863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:59.233863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:59.233863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.233863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:59.234213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:59.234213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:59.234213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.234213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:59.234213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:59.234213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:59.234213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:59.234213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:59.234213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:59.234213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:59.234213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:59.234213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:59.234213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:59.234213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:59.234630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:59.234630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:59.234630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.234630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:59.235432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:59.235995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:59.235995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:59.235995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.235995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:25:59.240266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:25:59.240454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:25:59.240529 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:25:59.240658 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:25:59.240853 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:59.241063 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:25:59.241191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.241589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:25:59.241589 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:59.241589 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:25:59.241589 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:25:59.241589 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:59.241589 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:25:59.241589 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.241589 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:25:59.242269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.242269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:25:59.242269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:59.242269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:25:59.242269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.242269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:59.242269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:59.242269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.242269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:59.242269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:59.242269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:59.242269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.242632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:25:59.242632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:59.242632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:25:59.242632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:59.242632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:25:59.242632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:25:59.242632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:59.242632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:25:59.242632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:59.242632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:25:59.242632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:25:59.242632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:59.242632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:25:59.243025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.243025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:25:59.243192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.243192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:25:59.243192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:25:59.243192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:25:59.243192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:25:59.243192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:25:59.243192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.243192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:25:59.243192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:25:59.243192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.243192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:25:59.243192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:25:59.243192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.243192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:25:59.243192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:25:59.243192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:25:59.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:25:59.244357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:25:59.244357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:25:59.244357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:03.749316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:03.750284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:03.750284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:03.750562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:03.789129 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:03.789333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:03.790062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:03.790062 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:03.790062 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:03.790062 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:03.790062 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:03.790062 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:03.790062 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:03.790062 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:03.791222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:03.791222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:03.791222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:03.791222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:03.791222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:03.791222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:03.791222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:03.791222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:03.791222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:03.791222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:03.791222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:03.791222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:03.791895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:03.791895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:03.791895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:03.791895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:03.791895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:03.791895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:03.791895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:03.791895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:03.791895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:03.791895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:03.791895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:03.791895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:03.791895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:03.792801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:03.792801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:03.793116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:03.793116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:03.793116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:03.793116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:03.793116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:03.793116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:03.793116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:03.793116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:03.793116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:03.793116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:03.793116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:03.793116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:03.793116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:03.793116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:03.793116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:03.793116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:03.793658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:03.794185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:03.794185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:03.794185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:04.217595 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:04.217931 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:04.218047 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:04.219069 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:04.219505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:04.219857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.220747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:04.220747 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:04.220747 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:04.220747 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:04.220747 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:04.220747 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:04.220747 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.220747 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:04.222505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.222505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:04.222505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:04.222505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:04.222505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.222505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:04.222505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:04.222505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.222505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:04.222505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:04.222505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:04.222505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.223273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:04.223273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:04.223273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:04.223273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:04.223273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:04.223273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:04.223273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:04.223273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:04.223273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:04.223273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:04.223273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:04.223273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:04.223273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:04.223981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.223981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:04.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:04.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:04.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:04.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:04.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:04.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:04.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:04.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:04.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:04.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:04.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:04.225048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:04.226013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:04.226883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:04.226883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.226883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:04.226883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:04.226883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:04.226883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:04.226883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:26:04.227232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:04.227674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.228655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:04.228655 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:04.228655 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:04.228655 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:04.228655 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:04.228655 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:04.228655 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.228655 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:04.229239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.229239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:04.229239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:04.229239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:04.229239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.229239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:04.229239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:04.229239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:04.229239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.229239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:04.229239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:04.229239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:04.229239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:04.229239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:04.229239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:04.230072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:04.230072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:04.230072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:04.230072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:04.230072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:04.230072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:04.230072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:04.230072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.230072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:04.230072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.230072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:04.230072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:04.230072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:04.230072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.230751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:04.230751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:04.230751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:26:04.230751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:04.230751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:04.230751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.230751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:04.230751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:04.230751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:04.230751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.230751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:04.230751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:04.230751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:04.231494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:04.231494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:04.231494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:04.231494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:04.231494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:04.231494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:04.231494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:04.231494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:04.231494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:04.231494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:04.231494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.231494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:04.232260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.232260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:04.232260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:04.232260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:04.232260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:04.232260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:04.232260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.232260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:04.232260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:04.232260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.232260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:04.232260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:04.232260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.232260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:04.232260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:04.232260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:04.232862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:04.233407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:04.233407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:04.233407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:04.233407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:04.233407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:04.233407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.233407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:04.233407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:04.233407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:04.233407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:04.233721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:04.233721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:04.233721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.234192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:04.234192 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:04.234192 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:04.234192 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:04.234192 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:04.234192 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:04.234192 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.234192 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:04.235576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.235576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:04.235576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:04.235576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:04.235576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.235576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:04.235576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:04.235576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:04.235576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.235576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:04.235576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:04.235576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:04.235576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:04.235576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:04.235576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:04.236111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:04.236111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:04.236111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:04.236111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:04.236111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:04.236111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:04.236111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:04.236111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.236111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:04.236558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.236558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:04.236558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:04.236558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:04.236558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.236558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:04.236558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:04.236558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:04.236558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:04.236558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.236558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:04.237051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:04.237051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:04.237051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.237051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:04.237051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:04.237051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:04.237051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:04.237051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:04.237051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:04.237051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:04.237051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:04.237051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:04.237051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:04.237051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:04.237628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:04.237628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:04.237628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.237628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.237852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:04.238396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:04.239031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:04.239031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:04.239031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.239031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:04.240624 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:04.240868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:04.240984 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:04.241138 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:04.241465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:04.241695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:04.241846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.242304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:04.242304 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:04.242304 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:04.242304 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:04.242304 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:04.242304 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:04.242304 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.242304 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:04.243211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.243211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:04.243211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:04.243211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:04.243211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.243211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:04.243211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:04.243211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.243211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:04.243211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:04.243211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:04.243211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.243819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:04.243819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:04.243819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:04.243819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:04.243819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:04.243819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:04.243819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:04.243819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:04.243819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:04.243819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:04.243819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:04.243819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:04.243819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:04.244203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.244203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:04.244271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.244271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:04.244271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:04.244271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:04.244271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:04.244271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:04.244271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.244271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:04.244271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:04.244271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.244271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:04.244271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:04.244271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.244271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:04.244271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:04.244271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:04.244842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:04.245441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:04.245441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:04.245441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:08.750183 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:08.750929 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:08.750929 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:08.751991 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:08.790670 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:08.791117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:08.792075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:08.792075 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:08.792075 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:08.792075 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:08.792075 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:08.792075 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:08.792075 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:08.792075 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:08.793269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:08.793269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:08.793269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:08.793269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:08.793269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:08.793269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:08.793269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:08.793269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:08.793269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:08.793269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:08.793269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:08.793269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:08.794132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:08.794132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:08.794132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:08.794132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:08.794132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:08.794132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:08.794132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:08.794132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:08.794132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:08.794132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:08.794132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:08.794132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:08.794132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:08.795004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:08.795004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:08.795004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:08.795004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:08.795004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:08.795004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:08.795004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:08.795004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:08.795004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:08.795004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:08.795004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:08.795004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:08.795004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:08.795004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:08.795004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:08.796436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:08.797681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:08.797681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:08.797681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:08.797681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:08.797681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:08.797681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:09.218159 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:09.219047 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:09.219047 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:09.220055 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:09.220514 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:09.220830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.222036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:09.222036 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:09.222036 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:09.222036 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:09.222036 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:09.222036 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:09.222036 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.222036 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:09.223946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.223946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:09.223946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:09.223946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:09.223946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.223946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:09.223946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:09.223946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.223946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:09.223946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:09.223946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:09.223946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.224681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:09.224681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:09.224681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:09.224681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:09.224681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:09.224681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:09.224681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:09.224681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:09.224681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:09.224681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:09.224681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:09.224681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:09.224681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:09.225506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.225506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:09.225932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.225932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:09.225932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:09.225932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:09.225932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:09.225932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:09.225932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.225932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:09.225932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:09.225932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.225932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:09.225932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:09.225932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.225932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:09.225932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:09.225932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:09.227553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:09.228062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:09.228062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.228062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:09.228062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:09.228062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:09.228062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:09.228062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:26:09.229119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:09.229664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.236018 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:09.236926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:09.236926 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:09.236926 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:09.236926 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:09.236926 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:09.236926 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:09.236926 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.236926 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:09.238087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.238087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:09.238087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:09.238087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:09.238087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.238087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:09.238087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:09.238087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:09.238087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.238087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:09.238087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:09.238087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:09.238087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:09.238087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:09.238087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:09.238560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:09.238560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:09.238560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:09.238560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:09.238560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:09.238560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:09.238560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:09.238560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.238560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:09.239271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.011 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.239271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:09.239271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:09.239271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:09.239271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.239271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:09.239271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:09.239271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:26:09.239271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:09.239271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:09.239271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.239271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:09.239683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:09.239683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:09.239683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.239683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:09.239683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:09.239683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:09.239683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:09.239683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:09.239683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:09.239683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:09.239683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:09.239683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:09.239683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:09.239683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:09.240120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:09.240120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:09.240120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.240120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:09.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:09.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:09.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:09.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:09.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:09.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:09.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:09.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:09.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:09.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:09.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:09.240756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:09.241403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:09.242103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:09.242103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:09.242103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:09.242103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:09.242103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:09.242103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.242103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:09.242103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:09.242103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:09.242103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:09.242414 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:09.242592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.243330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:09.243330 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:09.243330 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:09.243330 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:09.243330 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:09.243330 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:09.243330 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.243330 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:09.244555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.244555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:09.244555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:09.244555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:09.244555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.244555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:09.244555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:09.244555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:09.244555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.244555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:09.244555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:09.244555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:09.244555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:09.244555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:09.244555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:09.245033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:09.245033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:09.245033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:09.245033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:09.245033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:09.245033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:09.245033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:09.245033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.245033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:09.245033 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:09.246137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.246137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:09.246137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:09.246137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:09.246137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.246137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:09.246137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:09.246137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:09.246137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:09.246137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.246137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:09.246590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:09.246590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:09.246590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.246590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:09.246590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:09.246590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:09.246590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:09.246590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:09.246590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:09.246590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:09.246590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:09.246590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:09.246590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:09.246590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:09.247022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:09.247022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:09.247022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.247022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.247306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:09.247953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:09.248852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:09.248852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:09.248852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.248852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:09.248852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:09.248852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:09.248852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:09.248852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:09.249110 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:09.249110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.249590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:09.249590 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:09.249590 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:09.249590 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:09.249590 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:09.249590 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:09.249590 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.249590 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:09.250458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.250458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:09.250458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:09.250458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:09.250458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.250458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:09.250458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:09.250458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.250458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:09.250458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:09.250458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:09.250458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.250846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:09.250846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:09.250846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:09.250846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:09.250846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:09.250846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:09.250846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:09.250846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:09.250846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:09.250846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:09.250846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:09.250846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:09.250846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:09.251216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.251216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:09.251300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.251300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:09.251300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:09.251300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:09.251300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:09.251300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:09.251300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.251300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:09.251300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:09.251300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.251300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:09.251300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:09.251300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.251300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:09.251300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:09.251300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:09.251790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:09.252358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:09.252358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:09.252358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:13.750890 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:13.751515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:13.751515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:13.752989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:13.783292 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:13.783620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:13.784348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:13.784348 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:13.784348 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:13.784348 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:13.784348 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:13.784348 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:13.784348 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:13.784348 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:13.784978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:13.784978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:13.784978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:13.784978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:13.784978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:13.784978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:13.784978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:13.784978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:13.784978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:13.784978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:13.784978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:13.784978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:13.785650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:13.785650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:13.785650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:13.785650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:13.785650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:13.785650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:13.785650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:13.785650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:13.785650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:13.785650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:13.785650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:13.785650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:13.785650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:13.786249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:13.786249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:13.786249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:13.786249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:13.786249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:13.786249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:13.786249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:13.786249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:13.786249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:13.786249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:13.786249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:13.786249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:13.786249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:13.786249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:13.786249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:13.787017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:13.787907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:13.787907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:13.787907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:13.787907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:13.787907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:13.787907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:14.218766 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:14.219442 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:14.219681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:14.221863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:14.222268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:14.223118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.223398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:14.223398 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:14.223398 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:14.223398 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:14.223398 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:14.223398 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:14.223398 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.223398 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:14.225087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.225087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:14.225087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:14.225087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:14.225087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.225087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:14.225087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:14.225087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.225087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:14.225087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:14.225087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:14.225087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.225731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:14.225731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:14.225731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:14.225731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:14.225731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:14.225731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:14.225731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:14.225731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:14.225731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:14.225731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:14.225731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:14.225731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:14.225731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:14.226544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.226544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:14.226717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.226717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:14.226717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:14.226717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:14.226717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:14.226717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:14.226717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.226717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:14.226717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:14.226717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.226717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:14.226717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:14.226717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.226717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:14.226717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:14.226717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:14.227654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:14.228470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:14.228470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.228470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:14.228470 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:14.228470 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:14.228470 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:14.228470 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:26:14.228811 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:14.229080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.229932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:14.229932 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:14.229932 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:14.229932 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:14.229932 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:14.229932 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:14.229932 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.229932 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:14.231015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.231015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:14.231015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:14.231015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:14.231015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.231015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:14.231015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:14.231015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:14.231015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.231015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:14.231015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:14.231015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:14.231015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:14.231015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:14.231015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:14.231499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:14.231499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:14.231499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:14.231499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:14.231499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:14.231499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:14.231499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:14.231499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.231499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:14.232386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.232386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:14.232386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:14.232386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:14.232386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.232386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:14.232386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:14.232386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:26:14.232386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:14.232386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:14.232386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.232386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:14.232762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:14.232762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:14.232762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.232762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:14.232762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:14.232762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:14.232762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:14.232762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:14.232762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:14.232762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:14.232762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:14.232762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:14.232762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:14.232762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:14.233126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:14.233126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:14.233126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.233126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:14.233126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.233126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:14.233126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:14.233126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:14.233126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:14.233126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:14.233126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.233126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:14.233126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:14.233126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:14.233535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:14.234064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:14.234064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:14.234064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:14.234064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:14.234064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:14.234064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:14.234064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:14.234064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:14.234064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:14.234064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:14.234064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.234064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:14.241174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:14.241542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:14.241741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:14.241935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:14.242519 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:14.242914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.243887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:14.243887 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:14.243887 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:14.243887 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:14.243887 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:14.243887 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:14.243887 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.243887 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:14.245113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.245113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:14.245113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:14.245113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:14.245113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.245113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:14.245113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:14.245113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:14.245113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.245113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:14.245113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:14.245113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:14.245113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:14.245113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:14.245113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:14.245771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:14.245771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:14.245771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:14.245771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:14.245771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:14.245771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:14.245771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:14.245771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.245771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:14.246526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.246526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:14.246526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:14.246526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:14.246526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.246526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:14.246526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:14.246526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:14.246526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:14.246526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.246526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:14.247055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:14.247055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:14.247055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.247055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:14.247055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:14.247055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:14.247055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:14.247055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:14.247055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:14.247055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:14.247055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:14.247055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:14.247055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:14.247055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:14.247643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:14.247643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:14.247643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.247643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.248320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:14.249588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:14.250938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:14.250938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:14.250938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.250938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:14.250938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:14.250938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:14.250938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:14.250938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:14.251721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:14.251721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:14.251721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.251913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:14.251913 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:14.251913 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:14.251913 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:14.251913 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:14.251913 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:14.251913 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.251913 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:14.252759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.252759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:14.252759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:14.252759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:14.252759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.252759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:14.252759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:14.252759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.252759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:14.252759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:14.252759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:14.252759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.253142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:14.253142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:14.253142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:14.253142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:14.253142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:14.253142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:14.253142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:14.253142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:14.253142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:14.253142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:14.253142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:14.253142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:14.253142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:14.253536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.253536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:14.253698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.253698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:14.253698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:14.253698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:14.253698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:14.253698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:14.253698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.253698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:14.253698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:14.253698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.253698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:14.253698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:14.253698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.253698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:14.253698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:14.253698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:14.254165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:14.254711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:14.254711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:14.254711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:18.751404 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:18.752192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:18.752192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:18.753647 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:18.787747 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:18.788057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:18.788980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:18.788980 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:18.788980 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:18.788980 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:18.788980 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:18.788980 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:18.788980 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:18.788980 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:18.790033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:18.790033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:18.790033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:18.790033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:18.790033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:18.790033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:18.790033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:18.790033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:18.790033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:18.790033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:18.790033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:18.790033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:18.790692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:18.790692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:18.790692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:18.790692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:18.790692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:18.790692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:18.790692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:18.790692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:18.790692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:18.790692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:18.790692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:18.790692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:18.790692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:18.791343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:18.791343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:18.791529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:18.791529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:18.791529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:18.791529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:18.791529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:18.791529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:18.791529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:18.791529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:18.791529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:18.791529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:18.791529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:18.791529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:18.791529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:18.791529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:18.791529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:18.791529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:18.792341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:18.793311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:18.793311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:18.793311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:19.219487 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:19.220296 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:19.220296 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:19.221239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:19.223560 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:19.223560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.223560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:19.223560 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:19.223560 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:19.223560 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:19.223560 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:19.223560 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:19.223560 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.223560 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:19.223560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.223560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:19.223560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:19.223560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:19.224484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.224484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:19.224484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:19.224484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.224484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:19.224484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:19.224484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:19.224484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.224484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:19.224484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:19.224484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:19.224484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:19.224484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:19.224484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:19.225043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:19.225043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:19.225043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:19.225043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:19.225043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:19.225043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:19.225043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:19.225043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.225043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:19.225043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.225043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:19.225043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:19.225646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:19.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:19.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:19.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:19.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:19.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:19.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:19.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:19.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:19.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:19.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:19.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:19.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:19.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.227284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:19.228480 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:19.228578 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:19.228738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:19.228931 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:26:19.229482 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:19.229871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.230863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:19.230863 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:19.230863 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:19.230863 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:19.230863 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:19.230863 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:19.230863 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.230863 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:19.232137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.232137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:19.232137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:19.232137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:19.232137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.232137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:19.232137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:19.232137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:19.232137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.232137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:19.232137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:19.232137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:19.232137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:19.232137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:19.232137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:19.233907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:19.233907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:19.233907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:19.233907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:19.233907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:19.233907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:19.233907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:19.233907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.233907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:19.233907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.233907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:19.233907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:19.233907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:19.233907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.234691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:19.234691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:19.234691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:26:19.234691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:19.234691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:19.234691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.234691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:19.234691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:19.234691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:19.234691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.234691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:19.234691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:19.234691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:19.235551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:19.235551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:19.235551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:19.235551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:19.235551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:19.235551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:19.235551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:19.235551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:19.235551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:19.235551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:19.235551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.235551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:19.236225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.236225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:19.236225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:19.236225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:19.236225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:19.236225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:19.236225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.236225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:19.236225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:19.236225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.236225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:19.236225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:19.236225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.236225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:19.236225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:19.236225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:19.237271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:19.238532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:19.238532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:19.238532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:19.238532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:19.238532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:19.238532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.238532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:19.241632 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:19.242148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:19.242286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:19.242490 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:19.242907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:19.243155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.243727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:19.243727 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:19.243727 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:19.243727 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:19.243727 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:19.243727 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:19.243727 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.243727 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:19.244685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.244685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:19.244685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:19.244685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:19.244685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.244685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:19.244685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:19.244685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:19.244685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.244685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:19.244685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:19.244685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:19.244685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:19.244685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:19.244685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:19.245092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:19.245092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:19.245092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:19.245092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:19.245092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:19.245092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:19.245092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:19.245092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.245092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:19.245713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.245713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:19.245713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:19.245713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:19.245713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.245713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:19.245713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:19.245713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:19.245713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:19.245713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.245713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:19.246092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:19.246092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:19.246092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.246092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:19.246092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:19.246092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:19.246092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:19.246092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:19.246092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:19.246092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:19.246092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:19.246092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:19.246092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:19.246092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:19.246501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:19.246501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:19.246501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.246501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:19.247229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:19.247770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:19.247770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:19.247770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.247770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:19.248963 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:19.249581 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:19.249775 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:19.250055 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:19.250575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:19.250943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:19.251210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.251996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:19.251996 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:19.251996 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:19.251996 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:19.251996 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:19.251996 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:19.251996 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.251996 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:19.253523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.253523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:19.253523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:19.253523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:19.253523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.253523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:19.253523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:19.253523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.253523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:19.253523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:19.253523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:19.253523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.253911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:19.253911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:19.253911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:19.253911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:19.253911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:19.253911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:19.253911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:19.253911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:19.253911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:19.253911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:19.253911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:19.253911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:19.253911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:19.254303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.254303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:19.255289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.255289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:19.255289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:19.255289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:19.255289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:19.255289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:19.255289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.255289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:19.255289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:19.255289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.255289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:19.255289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:19.255289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.255289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:19.255289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:19.255289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:19.255796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:19.256351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:19.256351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:19.256351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:23.752082 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:23.753199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:23.753199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:23.754272 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:23.788778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:23.789150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:23.790103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:23.790103 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:23.790103 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:23.790103 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:23.790103 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:23.790103 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:23.790103 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:23.790103 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:23.791937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:23.791937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:23.791937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:23.791937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:23.791937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:23.791937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:23.791937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:23.791937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:23.791937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:23.791937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:23.791937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:23.791937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:23.792759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:23.792759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:23.792759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:23.792759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:23.792759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:23.792759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:23.792759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:23.792759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:23.792759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:23.792759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:23.792759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:23.792759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:23.792759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:23.793452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:23.793452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:23.793753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:23.793753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:23.793753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:23.793753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:23.793753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:23.793753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:23.793753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:23.793753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:23.793753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:23.793753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:23.793753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:23.793753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:23.793753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:23.793753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:23.793753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:23.793753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:23.794614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:23.795624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:23.795624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:23.795624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:24.220220 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:24.220801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:24.220950 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:24.221624 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:24.221800 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:24.221946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.222510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:24.222510 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:24.222510 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:24.222510 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:24.222510 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:24.222510 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:24.222510 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.222510 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:24.223471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.223471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:24.223471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:24.223471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:24.223471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.223471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:24.223471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:24.223471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.223471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:24.223471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:24.223471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:24.223471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.223881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:24.223881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:24.223881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:24.223881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:24.223881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:24.223881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:24.223881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:24.223881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:24.223881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:24.223881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:24.223881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:24.223881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:24.223881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:24.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.224272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:24.224523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.224523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:24.224523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:24.224523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:24.224523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:24.224523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:24.224523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.224523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:24.224523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:24.224523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.224523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:24.224523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:24.224523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.224523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:24.224523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:24.224523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:24.225036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:24.225693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:24.225693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.225693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:24.228639 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:24.228855 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:24.228949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:24.229097 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:26:24.229395 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:24.229591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.230009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:24.230009 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:24.230009 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:24.230009 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:24.230009 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:24.230009 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:24.230009 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.230009 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:24.230761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.230761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:24.230761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:24.230761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:24.230761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.230761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:24.230761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:24.230761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:24.230761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.230761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:24.230761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:24.230761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:24.230761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:24.230761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:24.230761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:24.231590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:24.231590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:24.231590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:24.231590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:24.231590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:24.231590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:24.231590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:24.231590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.231590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:24.231886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.231886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:24.231886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:24.231886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:24.231886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.231886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:24.231886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:24.231886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:26:24.231886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:24.231886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:24.231886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.231886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:24.232266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:24.232266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:24.232266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.232266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:24.232266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:24.232266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:24.232266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:24.232266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:24.232266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:24.232266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:24.232266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:24.232266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:24.232266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:24.232266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:24.232639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:24.232639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:24.232639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.232639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:24.232746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.232746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:24.232746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:24.232746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:24.232746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:24.232746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:24.232746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.232746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:24.232746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:24.232746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.232746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:24.232746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:24.232746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.232746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:24.232746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:24.232746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:24.233232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:24.233828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:24.233828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:24.233828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:24.233828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:24.233828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:24.233828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.233828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:24.242155 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:24.242515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:24.242713 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:24.242915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:24.243465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:24.243830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.244664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:24.244664 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:24.244664 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:24.244664 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:24.244664 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:24.244664 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:24.244664 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.244664 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:24.246250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:24.246250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:24.246250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:24.246250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:24.246250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:24.246250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:24.246250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:24.246250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.246250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:24.247228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.247228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:24.247228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:24.247228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:24.247228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.247228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:24.247228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:24.247228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:24.247228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:24.247228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.247228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:24.247580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:24.247580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:24.247580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.247580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:24.247580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:24.247580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:24.247580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:24.247580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:24.247580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:24.247580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:24.247580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:24.247580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:24.247580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:24.247580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:24.248012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:24.248012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:24.248012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.248012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.248739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:24.249988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:24.251090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:24.251090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:24.251090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.251090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:24.251090 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:24.251090 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:24.251090 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:24.251090 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:24.251428 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:24.251428 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:24.251705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.252910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:24.252910 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:24.252910 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:24.252910 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:24.252910 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:24.252910 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:24.252910 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.252910 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:24.253812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.253812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:24.253812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:24.253812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:24.253812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.253812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:24.253812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:24.253812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.253812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:24.253812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:24.253812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:24.253812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.254879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:24.254879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:24.254879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:24.254879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:24.254879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:24.254879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:24.254879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:24.254879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:24.254879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:24.254879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:24.254879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:24.254879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:24.254879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:24.255316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.255316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:24.255316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.255316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:24.255316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:24.255316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:24.255316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:24.255316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:24.255316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.255316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:24.255316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:24.255316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.255316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:24.255316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:24.255316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:24.255840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:24.256441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:24.256441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:24.256441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:24.256441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:24.256441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:24.256441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:28.752794 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:28.753388 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:28.753501 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:28.754276 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:28.786762 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:28.787093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:28.787824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:28.787824 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:28.787824 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:28.787824 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:28.787824 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:28.787824 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:28.787824 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:28.787824 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:28.788824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:28.788824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:28.788824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:28.788824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:28.788824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:28.788824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:28.788824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:28.788824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:28.788824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:28.788824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:28.788824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:28.788824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:28.789515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:28.789515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:28.789515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:28.789515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:28.789515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:28.789515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:28.789515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:28.789515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:28.789515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:28.789515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:28.789515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:28.789515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:28.789515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:28.790589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:28.790589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:28.790589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:28.790589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:28.790589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:28.790589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:28.790589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:28.790589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:28.790589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:28.790589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:28.790589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:28.790589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:28.790589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:28.790589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:28.790589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:28.792198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:28.794710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:28.794710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:28.794710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:28.794710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:28.794710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:28.794710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:29.220982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:29.221314 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:29.221500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:29.222406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:29.222630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:29.222833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.223475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:29.223475 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:29.223475 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:29.223475 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:29.223475 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:29.223475 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:29.223475 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.223475 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:29.224747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.224747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:29.224747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:29.224747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:29.224747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.224747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:29.224747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:29.224747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.224747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:29.224747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:29.224747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:29.224747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.225534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:29.225534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:29.225534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:29.225534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:29.225534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:29.225534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:29.225534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:29.225534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:29.225534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:29.225534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:29.225534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:29.225534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:29.225534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:29.226354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.226354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:29.226354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.226354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:29.226354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:29.226354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:29.226354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:29.226354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:29.226354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.226354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:29.226354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:29.226354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.226354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:29.226354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:29.226354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:29.227187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:29.228089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:29.228089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:29.228089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:29.228089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:29.228089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.228089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:29.229106 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:29.229407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:29.229550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:29.229731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:26:29.231113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:29.231623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.232453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:29.232453 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:29.232453 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:29.232453 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:29.232453 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:29.232453 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:29.232453 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.232453 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:29.233357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.233357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:29.233357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:29.233357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:29.233357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.233357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:29.233357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:29.233357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:29.233357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.233357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:29.233357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:29.233357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:29.233357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:29.233357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:29.233357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:29.233877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:29.233877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:29.233877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:29.233877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:29.233877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:29.233877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:29.233877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:29.233877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.233877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:29.234505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.234505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:29.234505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:29.234505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:29.234505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.234505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:29.234505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:29.234505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:26:29.234505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:29.234505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:29.234505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.234505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:29.235029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:29.235029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:29.235029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.235029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:29.235029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:29.235029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:29.235029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:29.235029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:29.235029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:29.235029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:29.235029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:29.235029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:29.235029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:29.235029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:29.235616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:29.235616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:29.235616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.235616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:29.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:29.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:29.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:29.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:29.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:29.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:29.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:29.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:29.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:29.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:29.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:29.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:29.236483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:29.237295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:29.237295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:29.237295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:29.237295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:29.237295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:29.237295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.237295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:29.242643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:29.242934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:29.243043 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:29.243222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:29.243713 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:29.244001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.244622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:29.244622 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:29.244622 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:29.244622 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:29.244622 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:29.244622 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:29.244622 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.244622 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:29.245615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.245615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:29.245615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:29.245615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:29.245615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.245615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:29.245615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:29.245615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:29.245615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.245615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:29.245615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:29.245615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:29.245615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:29.245615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:29.245615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:29.246301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:29.246301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:29.246301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:29.246301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:29.246301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:29.246301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:29.246301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:29.246301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.246301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:29.246853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.246853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:29.246853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:29.246853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:29.246853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.246853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:29.246853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:29.246853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:29.246853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:29.246853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.246853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:29.247423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:29.247423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:29.247423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.247423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:29.247423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:29.247423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:29.247423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:29.247423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:29.247423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:29.247423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:29.247423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:29.247423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:29.247423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:29.247423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:29.248095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:29.248095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:29.248095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.248095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.248493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:29.249501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:29.250298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:29.250298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:29.250298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.250298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:29.250298 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:29.250582 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:29.250582 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:29.250715 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:29.251164 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:29.251449 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:29.251600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.252212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:29.252212 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:29.252212 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:29.252212 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:29.252212 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:29.252212 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:29.252212 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.252212 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:29.253173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.253173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:29.253173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:29.253173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:29.253173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.253173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:29.253173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:29.253173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.253173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:29.253173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:29.253173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:29.253173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.253766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:29.253766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:29.253766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:29.253766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:29.253766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:29.253766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:29.253766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:29.253766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:29.253766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:29.253766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:29.253766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:29.253766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:29.253766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:29.254286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.254286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:29.254518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.254518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:29.254518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:29.254518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:29.254518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:29.254518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:29.254518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.254518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:29.254518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:29.254518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.254518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:29.254518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:29.254518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.254518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:29.254518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:29.254518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:29.255051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:29.255573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:29.255573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:29.255573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:33.753516 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:33.754667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:33.754795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:33.756025 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:33.796604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:33.796823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:33.797680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:33.797680 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:33.797680 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:33.797680 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:33.797680 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:33.797680 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:33.797680 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:33.797680 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:33.798990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:33.798990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:33.798990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:33.798990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:33.798990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:33.798990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:33.798990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:33.798990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:33.798990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:33.798990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:33.798990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:33.798990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:33.799701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:33.799701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:33.799701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:33.799701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:33.799701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:33.799701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:33.799701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:33.799701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:33.799701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:33.799701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:33.799701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:33.799701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:33.799701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:33.800259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:33.800259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:33.800391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:33.800391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:33.800391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:33.800391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:33.800391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:33.800391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:33.800391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:33.800391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:33.800391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:33.800391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:33.800391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:33.800391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:33.800391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:33.800391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:33.800391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:33.800391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:33.801100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:33.801933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:33.801933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:33.801933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:34.221432 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:34.222092 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:34.222252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:34.223391 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:34.223918 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:34.224190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.225217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:34.225217 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:34.225217 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:34.225217 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:34.225217 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:34.225217 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:34.225217 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.225217 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:34.226680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.226680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:34.226680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:34.226680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:34.226680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.226680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:34.226680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:34.226680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.226680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:34.226680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:34.226680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:34.226680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.227077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:34.227077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:34.227077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:34.227077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:34.227077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:34.227077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:34.227077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:34.227077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:34.227077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:34.227077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:34.227077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:34.227077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:34.227077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:34.227461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.227461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:34.228045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.228045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:34.228045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:34.228045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:34.228045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:34.228045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:34.228045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.228045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:34.228045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:34.228045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.228045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:34.228045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:34.228045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.228045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:34.228045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:34.228045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:34.229039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:34.230025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:34.230025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.230025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:34.230025 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:34.230025 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:34.230025 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:34.230025 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:26:34.231243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:34.231243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.231535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:34.231535 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:34.231535 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:34.231535 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:34.231535 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:34.231535 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:34.231535 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.231535 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:34.232344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.232344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:34.232344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:34.232344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:34.232344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.232344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:34.232344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:34.232344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:34.232344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.232344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:34.232344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:34.232344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:34.232344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:34.232344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:34.232344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:34.233611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:34.233611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:34.233611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:34.233611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:34.233611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:34.233611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:34.233611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:34.233611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.233611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:34.233611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.233611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:34.233611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:34.233611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:34.233611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.234437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:34.234437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:34.234437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:26:34.234437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:34.234437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:34.234437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.234437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:34.234437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:34.234437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:34.234437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.234437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:34.234437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:34.234437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:34.235214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:34.235214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:34.235214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:34.235214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:34.235214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:34.235214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:34.235214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:34.235214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:34.235214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:34.235214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:34.235214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.235214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:34.236088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.236088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:34.236088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:34.236088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:34.236088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:34.236088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:34.236088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.236088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:34.236088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:34.236088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.236088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:34.236088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:34.236088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.236088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:34.236088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:34.236088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:34.236863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:34.237240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:34.237240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:34.237240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:34.237240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:34.237240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:34.237240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.237240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:34.243040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:34.243311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:34.243514 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:34.243702 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:34.244215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:34.244519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.245096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:34.245096 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:34.245096 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:34.245096 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:34.245096 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:34.245096 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:34.245096 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.245096 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:34.246078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.246078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:34.246078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:34.246078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:34.246078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.246078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:34.246078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:34.246078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:34.246078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.246078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:34.246078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:34.246078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:34.246078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:34.246078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:34.246078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:34.247146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:34.247146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:34.247146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:34.247146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:34.247146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:34.247146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:34.247146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:34.247146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.247146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:34.247670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.247670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:34.247670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:34.247670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:34.247670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.247670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:34.247670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:34.247670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:34.247670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:34.247670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.247670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:34.248271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:34.248271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:34.248271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.248271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:34.248271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:34.248271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:34.248271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:34.248271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:34.248271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:34.248271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:34.248271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:34.248271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:34.248271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:34.248271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:34.248949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:34.248949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:34.248949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.248949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.249339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:34.250234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:34.251177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:34.251177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:34.251177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.251177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:34.251177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:34.251177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:34.251177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:34.251525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:34.251947 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:34.252292 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:34.252575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.253355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:34.253355 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:34.253355 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:34.253355 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:34.253355 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:34.253355 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:34.253355 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.253355 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:34.254912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.254912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:34.254912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:34.254912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:34.254912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.254912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:34.254912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:34.254912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.254912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:34.254912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:34.254912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:34.254912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.255326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:34.255326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:34.255326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:34.255326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:34.255326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:34.255326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:34.255326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:34.255326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:34.255326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:34.255326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:34.255326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:34.255326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:34.255326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:34.255742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.255742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:34.256676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.256676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:34.256676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:34.256676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:34.256676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:34.256676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:34.256676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.256676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:34.256676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:34.256676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.256676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:34.256676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:34.256676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.256676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:34.256676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:34.256676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:34.257194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:34.257789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:34.257789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:34.257789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:38.754334 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:38.755217 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:38.755217 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:38.756039 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:38.788811 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:38.789235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:38.790302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:38.790302 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:38.790302 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:38.790302 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:38.790302 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:38.790302 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:38.790302 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:38.790302 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:38.791417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:38.791417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:38.791417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:38.791417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:38.791417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:38.791417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:38.791417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:38.791417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:38.791417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:38.791417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:38.791417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:38.791417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:38.792042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:38.792042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:38.792042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:38.792042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:38.792042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:38.792042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:38.792042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:38.792042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:38.792042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:38.792042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:38.792042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:38.792042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:38.792042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:38.792786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:38.792786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:38.792786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:38.792786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:38.792786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:38.792786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:38.792786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:38.792786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:38.792786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:38.792786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:38.792786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:38.792786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:38.792786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:38.792786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:38.792786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:38.793505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:38.794329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:38.794329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:38.794329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:38.794329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:38.794329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:38.794329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:39.222178 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:39.222909 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:39.223113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:39.224088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:39.224387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:39.224666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.225497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:39.225497 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:39.225497 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:39.225497 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:39.225497 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:39.225497 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:39.225497 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.225497 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:39.226953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.226953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:39.226953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:39.226953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:39.226953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.226953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:39.226953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:39.226953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.226953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:39.226953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:39.226953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:39.226953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.227723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:39.227723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:39.227723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:39.227723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:39.227723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:39.227723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:39.227723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:39.227723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:39.227723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:39.227723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:39.227723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:39.227723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:39.227723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:39.228363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.228363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:39.228526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.228526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:39.228526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:39.228526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:39.228526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:39.228526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:39.228526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.228526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:39.228526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:39.228526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.228526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:39.228526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:39.228526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.228526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:39.228526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:39.228526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:39.229478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:39.230771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:39.230771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.230771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:39.230771 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:39.230771 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:39.230771 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:39.230771 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:26:39.231175 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:39.231175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.231555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:39.231555 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:39.231555 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:39.231555 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:39.231555 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:39.231555 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:39.231555 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.231555 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:39.232275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.232275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:39.232275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:39.232275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:39.232275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.232275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:39.232275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:39.232275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:39.232275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.232275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:39.232275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:39.232275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:39.232275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:39.232275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:39.232275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:39.232778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:39.232778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:39.232778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:39.232778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:39.232778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:39.232778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:39.232778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:39.232778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.232778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:39.233124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.233124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:39.233124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:39.233124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:39.233124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.233124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:39.233124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:39.233124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:26:39.233124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:39.233124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:39.233124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.233124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:39.233580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:39.233580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:39.233580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.233580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:39.233580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:39.233580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:39.233580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:39.233580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:39.233580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:39.233580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:39.233580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:39.233580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:39.233580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:39.233580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:39.233944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:39.233944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:39.233944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.233944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:39.234252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.234252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:39.234252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:39.234252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:39.234252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:39.234252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:39.234252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.234252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:39.234252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:39.234252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.234252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:39.234252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:39.234252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.234252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:39.234252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:39.234252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:39.234710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:39.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:39.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:39.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:39.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:39.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:39.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:39.243491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:39.243989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:39.244151 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:39.244347 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:39.244910 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:39.245175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.245774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:39.245774 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:39.245774 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:39.245774 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:39.245774 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:39.245774 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:39.245774 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.245774 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:39.246720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.246720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:39.246720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:39.246720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:39.246720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.246720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:39.246720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:39.246720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:39.246720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.246720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:39.246720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:39.246720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:39.246720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:39.246720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:39.246720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:39.247293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:39.247293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:39.247293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:39.247293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:39.247293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:39.247293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:39.247293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:39.247293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.247293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:39.247805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.247805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:39.247805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:39.247805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:39.247805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.247805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:39.247805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:39.247805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:39.247805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:39.247805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.247805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:39.248243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:39.248243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:39.248243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.248243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:39.248243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:39.248243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:39.248243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:39.248243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:39.248243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:39.248243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:39.248243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:39.248243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:39.248243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:39.248243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:39.248932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:39.248932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:39.248932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.248932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.249264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:39.249906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:39.250615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:39.250615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:39.250615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.250615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:39.251068 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:39.251381 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:39.251565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:39.251748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:39.252046 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:39.252278 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:39.252446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.252937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:39.252937 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:39.252937 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:39.252937 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:39.252937 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:39.252937 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:39.252937 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.252937 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:39.253767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.253767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:39.253767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:39.253767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:39.253767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.253767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:39.253767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:39.253767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.253767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:39.253767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:39.253767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:39.253767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.254224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:39.254224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:39.254224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:39.254224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:39.254224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:39.254224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:39.254224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:39.254224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:39.254224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:39.254224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:39.254224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:39.254224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:39.254224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:39.254705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.254705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:39.254792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.254792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:39.254792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:39.254792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:39.254792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:39.254792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:39.254792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.254792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:39.254792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:39.254792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.254792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:39.254792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:39.254792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.254792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:39.254792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:39.254792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:39.255350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:39.256100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:39.256100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:39.256100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:43.755103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:43.755995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:43.755995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:43.756906 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:43.785522 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:43.785718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:43.786280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:43.786280 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:43.786280 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:43.786280 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:43.786280 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:43.786280 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:43.786280 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:43.786280 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:43.787068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.031 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:43.787068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:43.787068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:43.787068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:43.787068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:43.787068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:43.787068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:43.787068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:43.787068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:43.787068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:43.787068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:43.787068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:43.788082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:43.788082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:43.788082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:43.788082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:43.788082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:43.788082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:43.788082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:43.788082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:43.788082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:43.788082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:43.788082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:43.788082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:43.788082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:43.788765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:43.788765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:43.788765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:43.788765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:43.788765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:43.788765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:43.788765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:43.788765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:43.788765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:43.788765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:43.788765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:43.788765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:43.788765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:43.788765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:43.788765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:43.789730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:43.790626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:43.790626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:43.790626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:43.790626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:43.790626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:43.790626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:44.222885 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:44.223252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:44.223541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:44.224685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:44.225023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:44.225282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.226281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:44.226281 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:44.226281 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:44.226281 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:44.226281 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:44.226281 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:44.226281 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.226281 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:44.228113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.228113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:44.228113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:44.228113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:44.228113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.228113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:44.228113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:44.228113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.228113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:44.228113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:44.228113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:44.228113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.228720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:44.228720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:44.228720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:44.228720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:44.228720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:44.228720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:44.228720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:44.228720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:44.228720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:44.228720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:44.228720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:44.228720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:44.228720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:44.229253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.229253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:44.230019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.230019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:44.230019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:44.230019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:44.230019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:44.230019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:44.230019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.230019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:44.230019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:44.230019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.230019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:44.230019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:44.230019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.230019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:44.230019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:44.230019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:44.230782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:44.232803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:44.232803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.232803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:44.232803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:44.232803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:44.232803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:44.232803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:26:44.232803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:44.233200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.233200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:44.233200 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:44.233200 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:44.233200 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:44.233200 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:44.233200 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:44.233200 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.233200 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:44.234223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.234223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:44.234223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:44.234223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:44.234223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.234223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:44.234223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:44.234223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:44.234223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.234223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:44.234223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:44.234223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:44.234223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:44.234223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:44.234223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:44.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:44.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:44.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:44.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:44.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:44.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:44.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:44.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.234918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:44.235678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.235678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:44.235678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:44.235678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:44.235678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.235678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:44.235678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:44.235678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:26:44.235678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:44.235678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:44.235678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.235678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:44.236143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:44.236143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:44.236143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.236143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:44.236143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:44.236143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:44.236143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:44.236143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:44.236143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:44.236143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:44.236143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:44.236143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:44.236143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:44.236143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:44.236790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:44.236790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:44.236790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.236790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:44.237897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.237897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:44.237897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:44.237897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:44.237897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:44.237897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:44.237897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.237897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:44.237897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:44.237897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.237897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:44.237897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:44.237897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.237897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:44.237897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:44.237897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:44.238410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:44.238881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:44.238881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:44.238881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:44.238881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:44.238881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:44.238881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.238881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:44.243854 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:44.244017 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:44.244105 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:44.244198 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:44.244795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:44.245305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.246061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:44.246061 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:44.246061 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:44.246061 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:44.246061 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:44.246061 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:44.246061 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.246061 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:44.246648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.246648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:44.246648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:44.246648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:44.246648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.246648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:44.246648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:44.246648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:44.246648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.246648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:44.246648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:44.246648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:44.246648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:44.246648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:44.246648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:44.247070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:44.247070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:44.247070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:44.247070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:44.247070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:44.247070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:44.247070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:44.247070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.247070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:44.247322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.247322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:44.247322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:44.247322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:44.247322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.247322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:44.247322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:44.247322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:44.247322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:44.247322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.247322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:44.247689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:44.247689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:44.247689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.247689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:44.247689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:44.247689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:44.247689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:44.247689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:44.247689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:44.247689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:44.247689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:44.247689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:44.247689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:44.247689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:44.248131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:44.248131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:44.248131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.248131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.248251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:44.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:44.249290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:44.249290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:44.249290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.249290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:44.251448 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:44.251651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:44.251758 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:44.251900 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:44.252351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:44.252757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:44.253000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.253882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:44.253882 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:44.253882 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:44.253882 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:44.253882 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:44.253882 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:44.253882 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.253882 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:44.254719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.254719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:44.254719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:44.254719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:44.254719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.254719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:44.254719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:44.254719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.254719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:44.254719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:44.254719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:44.254719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.255038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:44.255038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:44.255038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:44.255038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:44.255038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:44.255038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:44.255038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:44.255038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:44.255038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:44.255038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:44.255038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:44.255038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:44.255038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:44.255347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.255347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:44.255798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.255798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:44.255798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:44.255798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:44.255798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:44.255798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:44.255798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.255798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:44.255798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:44.255798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.255798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:44.255798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:44.255798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.255798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:44.255798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:44.255798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:44.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:44.256770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:44.256770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:44.256770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:48.758705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:48.758705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:48.758705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:48.758705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:48.794649 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:48.795099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:48.796009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:48.796009 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:48.796009 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:48.796009 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:48.796009 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:48.796009 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:48.796009 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:48.796009 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:48.796806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:48.796806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:48.796806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:48.796806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:48.796806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:48.796806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:48.796806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:48.796806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:48.796806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:48.796806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:48.796806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:48.796806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:48.797503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:48.797503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:48.797503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:48.797503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:48.797503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:48.797503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:48.797503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:48.797503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:48.797503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:48.797503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:48.797503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:48.797503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:48.797503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:48.798124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:48.798124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:48.798124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:48.798124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:48.798124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:48.798124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:48.798124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:48.798124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:48.798124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:48.798124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:48.798124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:48.798124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:48.798124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:48.798124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:48.798124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:48.798783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:48.800132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:48.800132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:48.800132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:48.800132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:48.800132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:48.800132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:49.223484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:49.223895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:49.224028 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:49.224972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:49.225258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:49.225539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.226225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:49.226225 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:49.226225 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:49.226225 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:49.226225 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:49.226225 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:49.226225 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.226225 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:49.226958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.226958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:49.226958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:49.226958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:49.226958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.226958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:49.226958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:49.226958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.226958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:49.226958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:49.226958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:49.226958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.227614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:49.227614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:49.227614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:49.227614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:49.227614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:49.227614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:49.227614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:49.227614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:49.227614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:49.227614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:49.227614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:49.227614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:49.227614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:49.228208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.228208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:49.228208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.228208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:49.228208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:49.228208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:49.228208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:49.228208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:49.228208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.228208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:49.228208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:49.228208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.228208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:49.228208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:49.228208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:49.228885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:49.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:49.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:49.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:49.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:49.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.229699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:49.230850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:49.231021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:49.231120 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:49.231237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:26:49.231651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:49.231912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.232547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:49.232547 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:49.232547 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:49.232547 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:49.232547 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:49.232547 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:49.232547 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.232547 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:49.233223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.233223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:49.233223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:49.233223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:49.233223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.233223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:49.233223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:49.233223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:49.233223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.233223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:49.233223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:49.233223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:49.233223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:49.233223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:49.233223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:49.233957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:49.233957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:49.233957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:49.233957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:49.233957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:49.233957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:49.233957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:49.233957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.233957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:49.233957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.233957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:49.233957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:49.233957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:49.233957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.234395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:49.234395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:49.234395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:26:49.234395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:49.234395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:49.234395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.234395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:49.234395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:49.234395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:49.234395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.234395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:49.234395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:49.234395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:49.234737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:49.234737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:49.234737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:49.234737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:49.234737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:49.234737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:49.234737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:49.234737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:49.234737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:49.234737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:49.234737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.234737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:49.235042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.235042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:49.235042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:49.235042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:49.235042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:49.235042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:49.235042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.235042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:49.235042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:49.235042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.235042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:49.235042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:49.235042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.235042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:49.235042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:49.235042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:49.235470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:49.235926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:49.235926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:49.235926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:49.235926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:49.235926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:49.235926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.235926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:49.244167 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:49.244535 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:49.244709 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:49.244900 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:49.245314 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:49.245690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.246346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:49.246346 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:49.246346 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:49.246346 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:49.246346 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:49.246346 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:49.246346 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.246346 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:49.247638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.247638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:49.247638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:49.247638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:49.247638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.247638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:49.247638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:49.247638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:49.247638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.247638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:49.247638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:49.247638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:49.247638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:49.247638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:49.247638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:49.248037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:49.248037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:49.248037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:49.248037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:49.248037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:49.248037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:49.248037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:49.248037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.248037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:49.249019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.249019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:49.249019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:49.249019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:49.249019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.249019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:49.249019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:49.249019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:49.249019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:49.249019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.249019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:49.249306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:49.249306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:49.249306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.249306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:49.249306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:49.249306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:49.249306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:49.249306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:49.249306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:49.249306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:49.249306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:49.249306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:49.249306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:49.249306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:49.249686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:49.249686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:49.249686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.249686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.250934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:49.251684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:49.252503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:49.252503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:49.252503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.252503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:49.252503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:49.252503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:49.252503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:49.252503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:49.252958 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:49.253271 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:49.253536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.254178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:49.254178 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:49.254178 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:49.254178 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:49.254178 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:49.254178 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:49.254178 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.254178 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:49.254967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.254967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:49.254967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:49.254967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:49.254967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.254967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:49.254967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:49.254967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.254967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:49.254967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:49.254967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:49.254967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.255545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:49.255545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:49.255545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:49.255545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:49.255545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:49.255545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:49.255545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:49.255545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:49.255545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:49.255545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:49.255545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:49.255545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:49.255545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:49.255994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.255994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:49.255994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.255994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:49.255994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:49.255994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:49.255994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:49.255994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:49.255994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.255994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:49.255994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:49.255994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.255994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:49.255994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:49.255994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:49.256541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:49.257188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:49.257188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:49.257188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:49.257188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:49.257188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:49.257188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:53.757434 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:53.758229 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:53.758229 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:53.759237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:53.769159 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=242 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:26:53.843345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:53.843511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:53.844747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:53.844747 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:53.844747 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:53.844747 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:53.844747 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:53.844747 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:53.844747 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:53.844747 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:53.845450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.087 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:53.845450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:53.845450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:53.845450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:53.845450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:53.845450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:53.845450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:53.845450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:53.845450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:53.845450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:53.845450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:53.845450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:53.846388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:53.846388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:53.846388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:53.846388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:53.846388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:53.846388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:53.846388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:53.846388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:53.846388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:53.846388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:53.846388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:53.846388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:53.846388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:53.846877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:53.846877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:53.846877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:53.846877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:53.846877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:53.846877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:53.846877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:53.846877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:53.846877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:53.846877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:53.846877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:53.846877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:53.846877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:53.846877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:53.846877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:53.847438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:53.848229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:53.848229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:53.848229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:53.848229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:53.848229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:53.848229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:54.224109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:54.224592 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:54.224769 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:54.225999 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:54.226359 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:54.226638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.227545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:54.227545 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:54.227545 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:54.227545 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:54.227545 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:54.227545 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:54.227545 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.227545 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:54.231229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.231229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:54.231229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:54.231229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:54.231229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.231229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:54.231229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:54.231229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.231229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:54.231229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:54.231229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:54.231229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.232194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:54.232194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:54.232194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:54.232194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:54.232194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:54.232194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:54.232194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:54.232194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:54.232194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:54.232194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:54.232194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:54.232194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:54.232194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:54.233014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.233014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:54.233014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.233014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:54.233014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:54.233014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:54.233014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:54.233014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:54.233014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.233014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:54.233014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:54.233014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.233014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:54.233014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:54.233014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:54.234049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:54.235473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:54.235473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:54.235473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:54.235473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:54.235473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.235473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:54.235473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:54.235473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:54.235473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:54.235473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:26:54.236203 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:54.236203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.236203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:54.236203 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:54.236203 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:54.236203 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:54.236203 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:54.236203 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:54.236203 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.236203 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:54.236203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.236203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:54.236203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:54.236203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:54.237184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:54.238549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.238549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:54.238549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.238549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:54.238549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:54.238549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:54.238549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.238549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:54.238549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:54.238549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:26:54.238549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:54.238549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:54.239632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.239632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:54.239632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:54.239632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:54.239632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.239632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:54.239632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:54.239632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:54.239632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:54.239632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:54.239632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:54.239632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:54.239632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:54.239632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:54.240615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:54.240615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:54.240615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:54.240615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:54.240615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.240615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:54.240615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.240615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:54.240615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:54.240615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:54.240615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:54.240615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:54.240615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.240615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.241499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:54.241985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:54.241985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:54.241985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:54.241985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:54.241985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:54.241985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:54.241985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:54.241985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:54.241985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:54.241985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:54.241985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:54.241985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:54.241985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.241985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:54.244481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:54.244669 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:54.244802 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:54.244924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:54.245398 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:54.245804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.246485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:54.246485 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:54.246485 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:54.246485 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:54.246485 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:54.246485 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:54.246485 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.246485 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:54.247222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.247222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:54.247222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:54.247222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:54.247222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.247222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:54.247222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:54.247222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:54.247222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.247222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:54.247222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:54.247222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:54.247222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:54.247222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:54.247222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:54.247845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:54.247845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:54.247845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:54.247845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:54.247845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:54.247845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:54.247845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:54.247845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.247845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:54.248135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.248135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:54.248135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:54.248135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:54.248135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.248135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:54.248135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:54.248135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:54.248135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:54.248135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.248135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:54.248429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:54.248429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:54.248429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.248429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:54.248429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:54.248429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:54.248429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:54.248429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:54.248429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:54.248429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:54.248429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:54.248429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:54.248429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:54.248429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:54.248745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:54.248745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:54.248745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.248745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.249238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:54.249578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:54.249900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:54.249900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:54.249900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.249900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:54.252074 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:54.252331 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:54.252465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:54.252607 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:54.253151 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:54.253499 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:54.253800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.254528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:54.254528 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:54.254528 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:54.254528 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:54.254528 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:54.254528 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:54.254528 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.254528 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:54.255325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.255325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:54.255325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:54.255325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:54.255325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.255325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:54.255325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:54.255325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.255325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:54.255325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:54.255325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:54.255325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.255824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:54.255824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:54.255824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:54.255824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:54.255824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:54.255824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:54.255824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:54.255824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:54.255824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:54.255824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:54.255824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:54.255824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:54.255824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:54.256276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.256276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:54.256276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.256276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:54.256276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:54.256276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:54.256276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:54.256276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:54.256276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.256276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:54.256276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:54.256276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.256276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:54.256276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:54.256276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:54.256901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:54.257619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:54.257619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:54.257619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:54.257619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:54.257619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:54.257619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:58.758024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:58.761808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:58.761808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:58.761808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:58.794869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:58.794869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:58.795074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:58.795074 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:58.795074 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:58.795074 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:58.795074 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:58.795074 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:58.795074 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:58.795074 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:58.795845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:58.795845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:58.795845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:58.795845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:58.795845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:58.795845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:58.795845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:58.795845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:58.795845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:58.795845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:58.795845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:58.795845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:58.796615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:58.796615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:58.796615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:58.796615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:58.796615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:58.796615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:58.796615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:58.796615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:58.796615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:58.796615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:58.796615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:58.796615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:58.796615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:58.797209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:58.797209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:58.797209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:58.797209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:58.797209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:58.797209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:58.797209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:58.797209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:58.797209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:58.797209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:58.797209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:58.797209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:58.797209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:58.797209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:58.797209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:58.797888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:58.799032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:58.799032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:58.799032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:58.799032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:58.799032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:58.799032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:59.224865 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:59.225259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:59.225470 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:59.226348 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:59.226652 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:59.226873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.227755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:59.227755 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:59.227755 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:59.227755 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:59.227755 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:59.227755 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:59.227755 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.227755 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:59.229298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.229298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:59.229298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:59.229298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:59.229298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.229298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:59.229298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:59.229298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.229298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:59.229298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:59.229298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:59.229298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.229758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:59.229758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:59.229758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:59.229758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:59.229758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:59.229758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:59.229758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:59.229758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:59.229758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:59.229758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:59.229758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:59.229758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:59.229758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:59.230175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.230175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:59.230989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.230989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:59.230989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:59.230989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:59.230989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:59.230989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:59.230989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.230989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:59.230989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:59.230989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.230989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:59.230989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:59.230989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.230989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:59.230989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:59.230989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:59.231556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:59.232172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:59.232172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.232172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:59.233435 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:59.233643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:59.233769 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:59.233851 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:26:59.234163 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:59.234342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.234844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:59.234844 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:59.234844 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:59.234844 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:59.234844 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:59.234844 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:59.234844 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.234844 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:59.235628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.235628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:59.235628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:59.235628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:59.235628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.235628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:59.235628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:59.235628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:59.235628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.235628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:59.235628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:59.235628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:59.235628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:59.235628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:59.235628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:59.236045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:59.236045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:59.236045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:59.236045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:59.236045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:59.236045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:59.236045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:59.236045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.236045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:59.236584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.236584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:59.236584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:59.236584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:59.236584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.236584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:59.236584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:59.236584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:26:59.236584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:59.236584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:59.236584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.236584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:59.236947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:59.236947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:59.236947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.236947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:59.236947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:59.236947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:59.236947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:59.236947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:59.236947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:59.236947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:59.236947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:59.236947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:59.236947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:59.236947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:59.237355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:59.237355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:59.237355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.237355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:59.237958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.237958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:59.237958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:59.237958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:59.237958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:59.237958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:59.237958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.237958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:59.237958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:59.237958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.237958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:59.237958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:59.237958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.237958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:59.237958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:59.237958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:59.238974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:59.239940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:59.239940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:59.239940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:59.239940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:59.239940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:59.239940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.239940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:59.244874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:59.245118 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:59.245253 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:59.245456 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:59.245702 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:59.245925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.246422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:59.246422 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:59.246422 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:59.246422 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:59.246422 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:59.246422 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:59.246422 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.246422 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:59.247126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.247126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:26:59.247126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:59.247126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:59.247126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.247126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:59.247126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:59.247126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:59.247126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.247126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:26:59.247126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:59.247126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:26:59.247126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:59.247126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:26:59.247126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:26:59.247778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:59.247778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:26:59.247778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:59.247778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:26:59.247778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:26:59.247778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:59.247778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:26:59.247778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.247778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:26:59.248202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.248202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:59.248202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:59.248202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:59.248202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.248202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:59.248202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:59.248202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:59.248202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:59.248202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.248202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:59.248805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:59.248805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:59.248805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.248805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:59.248805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:59.248805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:59.248805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:59.248805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:59.248805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:59.248805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:59.248805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:59.248805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:59.248805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:59.248805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:59.249451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:59.249451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:59.249451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.249451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:59.249451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.249451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:59.249451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:59.249451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:59.249451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:59.249451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:59.249451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.249451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:59.249451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:59.249451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:59.250059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:59.251393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:59.251393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:59.251393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:59.251393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:59.251393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:59.251393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:59.251393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:59.251393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:59.251393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:59.251393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.251393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:26:59.252540 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:26:59.252721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:26:59.252861 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:26:59.253056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:26:59.253525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:59.253947 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:26:59.254182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.254926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:26:59.254926 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:59.254926 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:26:59.254926 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:26:59.254926 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:59.254926 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:26:59.254926 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.254926 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:26:59.255837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.255837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:26:59.255837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:59.255837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:26:59.255837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.255837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:59.255837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:59.255837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.255837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:59.255837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:59.255837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:59.255837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.256551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:26:59.256551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:59.256551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:26:59.256551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:59.256551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:26:59.256551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:26:59.256551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:59.256551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:26:59.256551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:59.256551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:26:59.256551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:26:59.256551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:59.256551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:26:59.257224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.257224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:26:59.257224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.257224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:26:59.257224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:26:59.257224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:26:59.257224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:26:59.257224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:26:59.257224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.257224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:26:59.257224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:26:59.257224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.257224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:26:59.257224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:26:59.257224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:26:59.257656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:26:59.258261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:26:59.258261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:26:59.258261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:26:59.258261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:26:59.258261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:26:59.258261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:03.758790 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:03.760106 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:03.760287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:03.761129 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:03.799630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:03.799997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:03.800914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:03.800914 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:03.800914 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:03.800914 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:03.800914 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:03.800914 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:03.800914 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:03.800914 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:03.802017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:03.802017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:03.802017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:03.802017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:03.802017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:03.802017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:03.802017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:03.802017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:03.802017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:03.802017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:03.802017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:03.802017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:03.802678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:03.802678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:03.802678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:03.802678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:03.802678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:03.802678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:03.802678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:03.802678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:03.802678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:03.802678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:03.802678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:03.802678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:03.802678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:03.803700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:03.803700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:03.803700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:03.803700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:03.803700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:03.803700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:03.803700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:03.803700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:03.803700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:03.803700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:03.803700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:03.803700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:03.803700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:03.803700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:03.803700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:03.804670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:03.806255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:03.806255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:03.806255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:03.806255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:03.806255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:03.806255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:04.225560 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:04.226101 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:04.226154 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:04.227348 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:04.227750 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:04.227971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.228850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:04.228850 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:04.228850 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:04.228850 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:04.228850 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:04.228850 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:04.228850 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.228850 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:04.230506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.230506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:04.230506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:04.230506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:04.230506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.230506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:04.230506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:04.230506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.230506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:04.230506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:04.230506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:04.230506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.231075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:04.231075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:04.231075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:04.231075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:04.231075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:04.231075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:04.231075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:04.231075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:04.231075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:04.231075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:04.231075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:04.231075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:04.231075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:04.231628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.231628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:04.232181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:04.233595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:04.234920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:04.234920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.234920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:04.234920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:04.234920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:04.234920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:04.234920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:27:04.234920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:04.235318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.236084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:04.236084 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:04.236084 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:04.236084 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:04.236084 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:04.236084 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:04.236084 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.236084 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:04.237296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.237296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:04.237296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:04.237296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:04.237296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.237296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:04.237296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:04.237296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:04.237296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.237296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:04.237296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:04.237296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:04.237296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:04.237296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:04.237296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:04.237650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:04.237650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:04.237650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:04.237650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:04.237650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:04.237650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:04.237650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:04.237650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.237650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:04.238683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.238683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:04.238683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:04.238683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:04.238683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.238683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:04.238683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:04.238683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:27:04.238683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:04.238683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:04.238683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.238683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:04.239084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:04.239084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:04.239084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.239084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:04.239084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:04.239084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:04.239084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:04.239084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:04.239084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:04.239084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:04.239084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:04.239084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:04.239084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:04.239084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:04.239482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:04.239482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:04.239482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.239482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:04.239725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.239725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:04.239725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:04.239725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:04.239725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:04.239725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:04.239725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.239725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:04.239725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:04.239725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.239725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:04.239725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:04.239725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.239725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:04.239725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:04.239725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:04.240317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:04.240670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:04.240670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:04.240670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:04.240670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:04.240670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:04.240670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.240670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:04.245175 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:04.245401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:04.245601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:04.245726 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:04.246183 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:04.246568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.247214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:04.247214 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:04.247214 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:04.247214 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:04.247214 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:04.247214 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:04.247214 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.247214 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:04.248344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.248344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:04.248344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:04.248344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:04.248344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.248344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:04.248344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:04.248344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:04.248344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.248344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:04.248344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:04.248344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:04.248344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:04.248344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:04.248344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:04.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:04.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:04.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:04.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:04.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:04.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:04.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:04.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.248744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:04.249855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.249855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:04.249855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:04.249855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:04.249855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.249855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:04.249855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:04.249855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:04.249855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:04.249855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.249855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:04.250205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:04.250205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:04.250205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.250205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:04.250205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:04.250205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:04.250205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:04.250205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:04.250205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:04.250205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:04.250205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:04.250205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:04.250205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:04.250205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:04.250560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:04.250560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:04.250560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.250560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.251659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:04.252104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:04.252611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:04.252611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:04.252611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.252611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:04.252863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:04.253429 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:04.253646 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:04.253884 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:04.254343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:04.254704 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:04.254918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.255722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:04.255722 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:04.255722 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:04.255722 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:04.255722 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:04.255722 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:04.255722 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.255722 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:04.256804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.256804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:04.256804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:04.256804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:04.256804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.256804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:04.256804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:04.256804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.256804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:04.256804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:04.256804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:04.256804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.257133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:04.257133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:04.257133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:04.257133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:04.257133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:04.257133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:04.257133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:04.257133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:04.257133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:04.257133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:04.257133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:04.257133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:04.257133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:04.257457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.257457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:04.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:04.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:04.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:04.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:04.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:04.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:04.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:04.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:04.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:04.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:04.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:04.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:04.258248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:04.258750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:04.258750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:04.258750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:08.760248 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:08.761047 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:08.761047 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:08.761732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:08.797152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:08.797629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:08.798724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:08.798724 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:08.798724 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:08.798724 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:08.798724 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:08.798724 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:08.798724 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:08.798724 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:08.799901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:08.799901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:08.799901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:08.799901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:08.799901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:08.799901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:08.799901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:08.799901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:08.799901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:08.799901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:08.799901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:08.799901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:08.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:08.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:08.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:08.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:08.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:08.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:08.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:08.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:08.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:08.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:08.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:08.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:08.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:08.800715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:08.800715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:08.801001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:08.801001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:08.801001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:08.801001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:08.801001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:08.801001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:08.801001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:08.801001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:08.801001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:08.801001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:08.801001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:08.801001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:08.801001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:08.801001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:08.801001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:08.801001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:08.801472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:08.801961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:08.801961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:08.801961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:09.226150 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:09.226571 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:09.226744 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:09.227890 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:09.228249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:09.228516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.229357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:09.229357 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:09.229357 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:09.229357 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:09.229357 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:09.229357 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:09.229357 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.229357 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:09.230843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.230843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:09.230843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:09.230843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:09.230843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.230843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:09.230843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:09.230843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.230843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:09.230843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:09.230843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:09.230843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.232252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:09.232252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:09.232252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:09.232252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:09.232252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:09.232252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:09.232252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:09.232252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:09.232252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:09.232252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:09.232252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:09.232252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:09.232252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:09.232894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.232894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:09.232894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.232894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:09.232894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:09.232894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:09.232894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:09.232894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:09.232894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.232894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:09.232894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:09.232894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.232894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:09.232894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:09.232894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:09.233624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:09.234451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:09.234451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:09.234451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:09.234451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:09.234451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.234451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:09.234451 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:09.234451 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:09.234964 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:09.234964 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:27:09.235211 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:09.235624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.236491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:09.236491 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:09.236491 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:09.236491 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:09.236491 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:09.236491 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:09.236491 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.236491 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:09.237896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.237896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:09.237896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:09.237896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:09.237896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.237896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:09.237896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:09.237896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:09.237896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.237896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:09.237896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:09.237896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:09.237896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:09.237896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:09.237896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:09.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:09.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:09.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:09.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:09.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:09.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:09.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:09.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.238531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:09.239339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.239339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:09.239339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:09.239339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:09.239339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.239339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:09.239339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:09.239339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:27:09.239339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:09.239339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:09.239339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.239339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:09.239807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:09.239807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:09.239807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.239807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:09.239807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:09.239807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:09.239807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:09.239807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:09.239807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:09.239807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:09.239807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:09.239807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:09.239807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:09.239807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:09.240347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:09.240347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:09.240347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.240347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:09.241107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.241107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:09.241107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:09.241107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:09.241107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:09.241107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:09.241107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.241107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:09.241107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:09.241107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.241107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:09.241107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:09.241107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.241107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:09.241107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:09.241107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:09.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:09.242088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:09.242088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:09.242088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:09.242088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:09.242088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:09.242088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.242088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:09.245470 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:09.245671 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:09.245783 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:09.245913 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:09.246347 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:09.246776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.247515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:09.247515 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:09.247515 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:09.247515 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:09.247515 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:09.247515 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:09.247515 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.247515 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:09.248254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.248254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:09.248254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:09.248254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:09.248254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.248254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:09.248254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:09.248254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:09.248254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.248254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:09.248254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:09.248254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:09.248254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:09.248254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:09.248254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:09.248702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:09.248702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:09.248702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:09.248702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:09.248702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:09.248702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:09.248702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:09.248702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.248702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:09.249113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.249113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:09.249113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:09.249113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:09.249113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.249113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:09.249113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:09.249113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:09.249113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:09.249113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.249113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:09.249461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:09.249461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:09.249461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.249461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:09.249461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:09.249461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:09.249461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:09.249461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:09.249461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:09.249461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:09.249461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:09.249461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:09.249461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:09.249461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:09.249855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:09.249855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:09.249855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.249855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.250163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:09.250685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:09.251422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:09.251422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:09.251422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.251422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:09.253408 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:09.253597 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:09.253693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:09.253846 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:09.254287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:09.254709 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:09.254935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.255616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:09.255616 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:09.255616 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:09.255616 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:09.255616 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:09.255616 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:09.255616 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.255616 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:09.256476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.256476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:09.256476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:09.256476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:09.256476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.256476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:09.256476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:09.256476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.256476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:09.256476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:09.256476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:09.256476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.256837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:09.256837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:09.256837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:09.256837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:09.256837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:09.256837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:09.256837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:09.256837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:09.256837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:09.256837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:09.256837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:09.256837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:09.256837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:09.257184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.257184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:09.257433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.257433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:09.257433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:09.257433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:09.257433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:09.257433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:09.257433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.257433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:09.257433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:09.257433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.257433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:09.257433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:09.257433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.257433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:09.257433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:09.257433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:09.257893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:09.258467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:09.258467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:09.258467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:13.761857 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:13.762588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:13.762869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:13.764562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:13.804435 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:13.804919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:13.805801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:13.805801 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:13.805801 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:13.805801 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:13.805801 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:13.805801 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:13.805801 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:13.805801 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:13.807084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:13.807084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:13.807084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:13.807084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:13.807084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:13.807084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:13.807084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:13.807084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:13.807084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:13.807084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:13.807084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:13.807084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:13.807468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:13.807468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:13.807468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:13.807468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:13.807468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:13.807468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:13.807468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:13.807468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:13.807468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:13.807468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:13.807468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:13.807468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:13.807468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:13.807864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:13.807864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:13.808682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:13.808682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:13.808682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:13.808682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:13.808682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:13.808682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:13.808682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:13.808682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:13.808682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:13.808682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:13.808682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:13.808682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:13.808682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:13.808682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:13.808682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:13.808682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:13.809358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:13.810311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:13.810311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:13.810311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:14.226856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:14.227241 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:14.227544 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:14.228777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:14.229089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:14.229471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.230192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:14.230192 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:14.230192 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:14.230192 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:14.230192 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:14.230192 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:14.230192 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.230192 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:14.231828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.231828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:14.231828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:14.231828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:14.231828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.231828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:14.231828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:14.231828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.231828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:14.231828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:14.231828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:14.231828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.232361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:14.232361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:14.232361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:14.232361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:14.232361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:14.232361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:14.232361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:14.232361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:14.232361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:14.232361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:14.232361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:14.232361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:14.232361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:14.232946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.232946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:14.233678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.233678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:14.233678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:14.233678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:14.233678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:14.233678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:14.233678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.233678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:14.233678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:14.233678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.233678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:14.233678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:14.233678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.233678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:14.233678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:14.233678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:14.235169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:14.236550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:14.236550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.236550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:14.236550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:14.236550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:14.236550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:14.236550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:27:14.236550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:14.236809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.236809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:14.236809 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:14.236809 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:14.236809 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:14.236809 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:14.236809 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:14.236809 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.236809 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:14.237848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.237848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:14.237848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:14.237848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:14.237848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.237848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:14.237848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:14.237848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:14.237848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.237848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:14.237848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:14.237848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:14.237848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:14.237848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:14.237848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:14.238356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:14.238356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:14.238356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:14.238356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:14.238356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:14.238356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:14.238356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:14.238356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.238356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:14.239168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.239168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:14.239168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:14.239168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:14.239168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.239168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:14.239168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:14.239168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:27:14.239168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:14.239168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:14.239168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.239168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:14.239569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:14.239569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:14.239569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.239569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:14.239569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:14.239569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:14.239569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:14.239569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:14.239569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:14.239569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:14.239569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:14.239569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:14.239569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:14.239569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:14.239971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:14.239971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:14.239971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.239971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:14.240286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.240286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:14.240286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:14.240286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:14.240286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:14.240286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:14.240286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.240286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:14.240286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:14.240286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.240286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:14.240286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:14.240286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.240286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:14.240286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:14.240286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:14.240745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:14.241225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:14.241225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:14.241225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:14.241225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:14.241225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:14.241225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.241225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:14.245720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:14.245911 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:14.246020 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:14.246131 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:14.246516 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:14.246907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.247776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:14.247776 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:14.247776 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:14.247776 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:14.247776 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:14.247776 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:14.247776 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.247776 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:14.248565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.248565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:14.248565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:14.248565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:14.248565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.248565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:14.248565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:14.248565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:14.248565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.248565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:14.248565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:14.248565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:14.248565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:14.248565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:14.248565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:14.249212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:14.249212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:14.249212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:14.249212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:14.249212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:14.249212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:14.249212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:14.249212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.249212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:14.250236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.250236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:14.250236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:14.250236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:14.250236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.250236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:14.250236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:14.250236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:14.250236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:14.250236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.250236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:14.251205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:14.251205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:14.251205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.251205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:14.251205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:14.251205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:14.251205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:14.251205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:14.251205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:14.251205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:14.251205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:14.251205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:14.251205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:14.251205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:14.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:14.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:14.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.253148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:14.254257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:14.254777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:14.254777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:14.254777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.254777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:14.254777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:14.254777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:14.254777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:14.254777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:14.255038 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:14.255516 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:14.255825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.256473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:14.256473 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:14.256473 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:14.256473 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:14.256473 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:14.256473 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:14.256473 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.256473 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:14.257283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.257283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:14.257283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:14.257283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:14.257283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.257283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:14.257283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:14.257283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.257283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:14.257283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:14.257283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:14.257283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.258268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:14.258268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:14.258268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:14.258268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:14.258268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:14.258268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:14.258268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:14.258268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:14.258268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:14.258268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:14.258268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:14.258268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:14.258268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:14.259127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.259127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:14.259127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.259127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:14.259127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:14.259127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:14.259127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:14.259127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:14.259127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.259127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:14.259127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:14.259127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.259127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:14.259127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:14.259127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:14.259769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:14.260250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:14.260250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:14.260250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:14.260250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:14.260250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:14.260250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:18.762810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:18.763434 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:18.763434 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:18.764865 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:18.799600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:18.800115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:18.801157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:18.801157 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:18.801157 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:18.801157 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:18.801157 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:18.801157 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:18.801157 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:18.801157 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:18.802440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:18.802440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:18.802440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:18.802440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:18.802440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:18.802440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:18.802440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:18.802440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:18.802440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:18.802440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:18.802440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:18.802440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:18.803200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:18.803200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:18.803200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:18.803200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:18.803200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:18.803200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:18.803200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:18.803200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:18.803200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:18.803200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:18.803200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:18.803200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:18.803200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:18.803926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:18.803926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:18.803926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:18.803926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:18.803926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:18.803926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:18.803926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:18.803926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:18.803926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:18.803926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:18.803926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:18.803926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:18.803926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:18.803926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:18.803926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:18.804860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:18.806055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:18.806055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:18.806055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:18.806055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:18.806055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:18.806055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:19.227442 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:19.228104 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:19.228258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:19.228998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:19.229259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:19.229497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.230126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:19.230126 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:19.230126 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:19.230126 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:19.230126 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:19.230126 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:19.230126 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.230126 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:19.231274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.231274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:19.231274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:19.231274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:19.231274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.231274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:19.231274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:19.231274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.231274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:19.231274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:19.231274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:19.231274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.231689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:19.231689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:19.231689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:19.231689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:19.231689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:19.231689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:19.231689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:19.231689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:19.231689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:19.231689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:19.231689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:19.231689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:19.231689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:19.232043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.232043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:19.232350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.232350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:19.232350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:19.232350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:19.232350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:19.232350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:19.232350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.232350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:19.232350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:19.232350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.232350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:19.232350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:19.232350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.232350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:19.232350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:19.232350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:19.233012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:19.236026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:19.236026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.236026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:19.236026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:19.236263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:19.236326 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:19.236431 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:27:19.237126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:19.237580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.238488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:19.238488 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:19.238488 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:19.238488 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:19.238488 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:19.238488 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:19.238488 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.238488 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:19.239286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.239286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:19.239286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:19.239286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:19.239286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.239286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:19.239286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:19.239286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:19.239286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.239286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:19.239286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:19.239286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:19.239286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:19.239286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:19.239286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:19.239983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:19.239983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:19.239983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:19.239983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:19.239983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:19.239983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:19.239983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:19.239983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.239983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:19.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:19.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:19.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:19.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:19.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:19.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:27:19.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:19.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:19.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:19.240889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:19.240889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:19.240889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.240889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:19.240889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:19.240889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:19.240889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:19.240889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:19.240889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:19.240889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:19.240889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:19.240889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:19.240889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:19.240889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:19.241596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:19.241596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:19.241596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.241596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:19.241596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.241596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:19.241596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:19.241596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:19.241596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:19.241596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:19.241596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.241596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:19.241596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:19.241596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:19.242294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:19.243666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:19.243666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:19.243666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:19.243666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:19.243666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:19.243666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:19.243666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:19.243666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:19.243666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:19.243666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:19.243666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.243666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:19.245999 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:19.246255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:19.246384 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:19.246542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:19.246852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:19.247080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.247645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:19.247645 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:19.247645 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:19.247645 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:19.247645 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:19.247645 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:19.247645 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.247645 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:19.248418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.248418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:19.248418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:19.248418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:19.248418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.248418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:19.248418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:19.248418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:19.248418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.248418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:19.248418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:19.248418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:19.248418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:19.248418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:19.248418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:19.248737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:19.248737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:19.248737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:19.248737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:19.248737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:19.248737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:19.248737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:19.248737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.248737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:19.249256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.249256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:19.249256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:19.249256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:19.249256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.249256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:19.249256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:19.249256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:19.249256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:19.249256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.249256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:19.249627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:19.249627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:19.249627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.249627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:19.249627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:19.249627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:19.249627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:19.249627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:19.249627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:19.249627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:19.249627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:19.249627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:19.249627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:19.249627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:19.249929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:19.249929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:19.249929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.249929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.250296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:19.250645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:19.251084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:19.251084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:19.251084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.251084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:19.254148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:19.254495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:19.254624 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:19.254788 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:19.255129 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:19.255449 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:19.255626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:19.256194 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:19.256194 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:19.256194 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:19.256194 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:19.256194 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:19.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.256194 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:19.257091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.257091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:19.257091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:19.257091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:19.257091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.257091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:19.257091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:19.257091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.257091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:19.257091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:19.257091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:19.257091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.257547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:19.257547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:19.257547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:19.257547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:19.257547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:19.257547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:19.257547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:19.257547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:19.257547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:19.257547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:19.257547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:19.257547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:19.257547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:19.257942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.257942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:19.258212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.258212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:19.258212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:19.258212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:19.258212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:19.258212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:19.258212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.258212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:19.258212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:19.258212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.258212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:19.258212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:19.258212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.258212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:19.258212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:19.258212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:19.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:19.259351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:19.259351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:19.259351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:23.763414 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:23.764507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:23.764707 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:23.766257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:23.804123 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:23.804705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:23.805655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:23.805655 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:23.805655 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:23.805655 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:23.805655 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:23.805655 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:23.805655 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:23.805655 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:23.806400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:23.806400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:23.806400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:23.806400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:23.806400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:23.806400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:23.806400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:23.806400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:23.806400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:23.806400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:23.806400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:23.806400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:23.807034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:23.807034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:23.807034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:23.807034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:23.807034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:23.807034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:23.807034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:23.807034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:23.807034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:23.807034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:23.807034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:23.807034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:23.807034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:23.807742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:23.807742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:23.807742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:23.807742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:23.807742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:23.807742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:23.807742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:23.807742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:23.807742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:23.807742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:23.807742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:23.807742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:23.807742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:23.807742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:23.807742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:23.808696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:23.810081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:23.810081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:23.810081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:23.810081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:23.810081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:23.810081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:24.228543 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:24.229114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:24.229242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:24.230241 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:24.230636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:24.230820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.231682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:24.231682 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:24.231682 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:24.231682 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:24.231682 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:24.231682 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:24.231682 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.231682 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:24.233016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.233016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:24.233016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:24.233016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:24.233016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.233016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:24.233016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:24.233016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.233016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:24.233016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:24.233016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:24.233016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.234000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:24.234000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:24.234000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:24.234000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:24.234000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:24.234000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:24.234000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:24.234000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:24.234000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:24.234000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:24.234000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:24.234000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:24.234000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:24.234537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.234537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:24.234537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.234537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:24.234537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:24.234537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:24.234537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:24.234537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:24.234537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.234537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:24.234537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:24.234537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.234537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:24.234537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:24.234537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:24.235298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:24.236257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:24.236257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:24.236257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:24.236257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:24.236257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.236257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:24.236257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:24.236661 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:24.236725 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:24.236930 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:27:24.237342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:24.237632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.238179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:24.238179 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:24.238179 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:24.238179 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:24.238179 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:24.238179 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:24.238179 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.238179 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:24.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:24.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:24.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:24.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:24.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:24.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:24.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:24.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:24.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:24.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:24.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:24.239059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:24.239537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:24.239537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:24.239537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:24.239537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:24.239537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:24.239537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:24.239537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:24.239537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.239537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:24.240040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.240040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:24.240040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:24.240040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:24.240040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.240040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:24.240040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:24.240040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:27:24.240040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:24.240040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:24.240040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.240040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:24.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:24.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:24.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:24.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:24.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:24.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:24.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:24.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:24.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:24.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:24.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:24.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:24.240390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:24.240736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:24.240736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:24.240736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.240736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:24.241127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.241127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:24.241127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:24.241127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:24.241127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:24.241127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:24.241127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.241127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:24.241127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:24.241127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.241127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:24.241127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:24.241127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.241127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:24.241127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:24.241127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:24.241594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:24.242088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:24.242088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:24.242088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:24.242088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:24.242088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:24.242088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.242088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:24.246494 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:24.246846 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:24.247018 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:24.247018 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:24.247660 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:24.248014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.248838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:24.248838 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:24.248838 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:24.248838 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:24.248838 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:24.248838 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:24.248838 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.248838 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:24.249724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.249724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:24.249724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:24.249724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:24.249724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.249724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:24.249724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:24.249724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:24.249724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.249724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:24.249724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:24.249724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:24.249724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:24.249724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:24.249724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:24.250526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:24.250526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:24.250526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:24.250526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:24.250526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:24.250526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:24.250526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:24.250526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.250526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:24.250976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.250976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:24.250976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:24.250976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:24.250976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.250976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:24.250976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:24.250976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:24.250976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:24.250976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.250976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:24.251637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:24.251637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:24.251637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.251637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:24.251637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:24.251637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:24.251637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:24.251637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:24.251637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:24.251637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:24.251637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:24.251637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:24.251637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:24.251637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:24.252299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:24.252299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:24.252299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.252299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:24.252299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.252299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:24.252299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:24.252299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:24.252299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:24.252299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:24.252299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.252299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:24.252299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:24.252299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:24.253028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:24.254078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:24.254078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:24.254078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:24.254078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:24.254078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:24.254078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:24.254078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:24.254078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:24.254078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:24.254078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.254078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:24.254608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:24.254982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:24.255058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:24.255243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:24.255842 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:24.256264 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:24.256586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.257356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:24.257356 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:24.257356 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:24.257356 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:24.257356 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:24.257356 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:24.257356 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.257356 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:24.258444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.258444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:24.258444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:24.258444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:24.258444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.258444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:24.258444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:24.258444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.258444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:24.258444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:24.258444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:24.258444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.259081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:24.259081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:24.259081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:24.259081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:24.259081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:24.259081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:24.259081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:24.259081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:24.259081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:24.259081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:24.259081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:24.259081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:24.259081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:24.259757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.259757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:24.259757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.259757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:24.259757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:24.259757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:24.259757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:24.259757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:24.259757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.259757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:24.259757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:24.259757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.259757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:24.259757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:24.259757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:24.260489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:24.261346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:24.261346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:24.261346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:24.261346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:24.261346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:24.261346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:28.764175 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:28.765055 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:28.765154 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:28.766686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:28.806036 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:28.806493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:28.807391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:28.807391 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:28.807391 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:28.807391 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:28.807391 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:28.807391 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:28.807391 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:28.807391 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:28.808416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:28.808416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:28.808416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:28.808416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:28.808416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:28.808416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:28.808416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:28.808416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:28.808416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:28.808416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:28.808416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:28.808416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:28.808817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:28.808817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:28.808817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:28.808817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:28.808817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:28.808817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:28.808817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:28.808817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:28.808817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:28.808817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:28.808817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:28.808817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:28.808817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:28.809130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:28.809130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:28.809607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:28.809607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:28.809607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:28.809607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:28.809607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:28.809607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:28.809607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:28.809607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:28.809607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:28.809607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:28.809607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:28.809607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:28.809607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:28.809607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:28.809607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:28.809607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:28.810017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:28.810540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:28.810540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:28.810540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:29.229148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:29.229775 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:29.230008 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:29.231199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:29.231676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:29.231969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.233068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:29.233068 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:29.233068 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:29.233068 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:29.233068 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:29.233068 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:29.233068 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.233068 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:29.234850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.234850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:29.234850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:29.234850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:29.234850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.234850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:29.234850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:29.234850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.234850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:29.234850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:29.234850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:29.234850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.235478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:29.235478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:29.235478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:29.235478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:29.235478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:29.235478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:29.235478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:29.235478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:29.235478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:29.235478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:29.235478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:29.235478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:29.235478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:29.236038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.236038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:29.237025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.237025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:29.237025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:29.237025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:29.237025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:29.237025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:29.237025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.237025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:29.237025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:29.237025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.237025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:29.237025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:29.237025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.237025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:29.237025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:29.237025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:29.237721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:29.238543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:29.238543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.238543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:29.238543 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:29.238543 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:29.238543 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:29.238543 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:27:29.238897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:29.239306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.240264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:29.240264 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:29.240264 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:29.240264 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:29.240264 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:29.240264 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:29.240264 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.240264 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:29.241314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.241314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:29.241314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:29.241314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:29.241314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.241314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:29.241314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:29.241314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:29.241314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.241314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:29.241314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:29.241314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:29.241314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:29.241314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:29.241314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:29.241970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:29.241970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:29.241970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:29.241970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:29.241970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:29.241970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:29.241970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:29.241970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.241970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:29.242392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.242392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:29.242392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:29.242392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:29.242392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.242392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:29.242392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:29.242392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:27:29.242392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:29.242392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:29.242392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.242392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:29.242916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:29.242916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:29.242916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.242916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:29.242916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:29.242916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:29.242916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:29.242916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:29.242916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:29.242916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:29.242916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:29.242916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:29.242916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:29.242916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:29.243526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:29.243526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:29.243526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.243526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:29.243792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.243792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:29.243792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:29.243792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:29.243792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:29.243792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:29.243792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.243792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:29.243792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:29.243792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.243792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:29.243792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:29.243792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.243792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:29.243792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:29.243792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:29.244480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:29.245187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:29.245187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:29.245187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:29.245187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:29.245187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:29.245187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.245187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:29.246863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:29.247164 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:29.247324 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:29.247485 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:29.247976 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:29.248520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.249294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:29.249294 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:29.249294 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:29.249294 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:29.249294 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:29.249294 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:29.249294 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.249294 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:29.250189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.250189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:29.250189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:29.250189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:29.250189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.250189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:29.250189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:29.250189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:29.250189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.250189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:29.250189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:29.250189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:29.250189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:29.250189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:29.250189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:29.250702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:29.250702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:29.250702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:29.250702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:29.250702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:29.250702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:29.250702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:29.250702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.250702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:29.251241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.251241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:29.251241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:29.251241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:29.251241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.251241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:29.251241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:29.251241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:29.251241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:29.251241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.251241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:29.251534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:29.251534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:29.251534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.251534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:29.251534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:29.251534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:29.251534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:29.251534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:29.251534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:29.251534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:29.251534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:29.251534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:29.251534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:29.251534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:29.251881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:29.251881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:29.251881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.251881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.252345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:29.252798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:29.253438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:29.253438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:29.253438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.253438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:29.255094 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:29.255390 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:29.255516 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:29.255688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:29.256126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:29.256485 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:29.256652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.257262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:29.257262 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:29.257262 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:29.257262 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:29.257262 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:29.257262 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:29.257262 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.257262 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:29.258081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.258081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:29.258081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:29.258081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:29.258081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.258081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:29.258081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:29.258081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.258081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:29.258081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:29.258081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:29.258081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.258460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:29.258460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:29.258460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:29.258460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:29.258460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:29.258460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:29.258460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:29.258460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:29.258460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:29.258460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:29.258460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:29.258460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:29.258460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:29.258828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.258828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:29.259037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.259037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:29.259037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:29.259037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:29.259037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:29.259037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:29.259037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.259037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:29.259037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:29.259037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.259037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:29.259037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:29.259037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.259037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:29.259037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:29.259037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:29.259510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:29.260034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:29.260034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:29.260034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:33.764766 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:33.765570 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:33.765777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:33.767545 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:33.805632 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:33.805905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:33.806633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:33.806633 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:33.806633 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:33.806633 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:33.806633 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:33.806633 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:33.806633 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:33.806633 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:33.807702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:33.807702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:33.807702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:33.807702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:33.807702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:33.807702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:33.807702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:33.807702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:33.807702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:33.807702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:33.807702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:33.807702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:33.808524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:33.808524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:33.808524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:33.808524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:33.808524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:33.808524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:33.808524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:33.808524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:33.808524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:33.808524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:33.808524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:33.808524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:33.808524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:33.809457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:33.809457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:33.809457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:33.809457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:33.809457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:33.809457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:33.809457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:33.809457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:33.809457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:33.809457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:33.809457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:33.809457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:33.809457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:33.809457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:33.809457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:33.810811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:33.812074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:33.812074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:33.812074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:33.812074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:33.812074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:33.812074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:34.229653 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:34.230182 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:34.230306 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:34.231288 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:34.231717 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:34.231990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.232857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:34.232857 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:34.232857 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:34.232857 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:34.232857 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:34.232857 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:34.232857 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.232857 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:34.233945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.233945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:34.233945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:34.233945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:34.233945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.233945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:34.233945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:34.233945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.233945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:34.233945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:34.233945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:34.233945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.234791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:34.234791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:34.234791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:34.234791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:34.234791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:34.234791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:34.234791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:34.234791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:34.234791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:34.234791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:34.234791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:34.234791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:34.234791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:34.235585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.235585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:34.235585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.235585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:34.235585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:34.235585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:34.235585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:34.235585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:34.235585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.235585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:34.235585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:34.235585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.235585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:34.235585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:34.235585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:34.236523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:34.237709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:34.237709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:34.237709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:34.237709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:34.237709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.237709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:34.238014 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:34.238079 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:34.238191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:34.238318 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:27:34.238888 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:34.239246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.240047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:34.240047 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:34.240047 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:34.240047 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:34.240047 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:34.240047 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:34.240047 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.240047 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:34.240905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.240905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:34.240905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:34.240905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:34.240905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.240905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:34.240905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:34.240905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:34.240905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.240905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:34.240905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:34.240905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:34.240905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:34.240905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:34.240905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:34.241538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:34.241538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:34.241538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:34.241538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:34.241538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:34.241538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:34.241538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:34.241538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.241538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:34.242585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.242585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:34.242585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:34.242585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:34.242585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.242585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:34.242585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:34.242585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:27:34.242585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:34.242585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:34.242585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.242585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:34.242936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:34.242936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:34.242936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.242936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:34.242936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:34.242936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:34.242936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:34.242936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:34.242936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:34.242936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:34.242936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:34.242936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:34.242936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:34.242936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:34.243289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:34.243289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:34.243289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.243289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:34.243289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.243289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:34.243289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:34.243289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:34.243289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:34.243289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:34.243289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.243289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:34.243289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:34.243289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:34.243754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:34.244242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:34.244242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:34.244242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:34.244242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:34.244242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:34.244242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:34.244242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:34.244242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:34.244242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:34.244242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:34.244242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.244242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:34.247387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:34.247863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:34.248058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:34.248263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:34.248846 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:34.249330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.250258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:34.250258 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:34.250258 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:34.250258 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:34.250258 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:34.250258 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:34.250258 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.250258 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:34.251679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.251679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:34.251679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:34.251679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:34.251679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.251679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:34.251679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:34.251679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:34.251679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.251679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:34.251679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:34.251679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:34.251679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:34.251679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:34.251679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:34.252115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:34.252115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:34.252115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:34.252115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:34.252115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:34.252115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:34.252115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:34.252115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.252115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:34.253168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.253168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:34.253168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:34.253168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:34.253168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.253168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:34.253168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:34.253168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:34.253168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:34.253168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.253168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:34.253742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:34.253742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:34.253742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.253742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:34.253742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:34.253742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:34.253742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:34.253742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:34.253742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:34.253742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:34.253742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:34.253742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:34.253742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:34.253742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:34.254279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:34.254279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:34.254279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.254279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.255084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:34.255820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:34.256558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:34.256558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:34.256558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.256558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:34.256558 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:34.256558 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:34.256558 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:34.256558 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:34.256935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:34.256992 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:34.257262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.258060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:34.258060 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:34.258060 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:34.258060 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:34.258060 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:34.258060 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:34.258060 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.258060 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:34.258969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.258969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:34.258969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:34.258969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:34.258969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.258969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:34.258969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:34.258969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.258969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:34.258969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:34.258969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:34.258969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.259512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:34.259512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:34.259512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:34.259512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:34.259512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:34.259512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:34.259512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:34.259512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:34.259512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:34.259512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:34.259512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:34.259512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:34.259512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:34.260001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.260001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:34.260001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.260001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:34.260001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:34.260001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:34.260001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:34.260001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:34.260001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.260001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:34.260001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:34.260001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.260001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:34.260001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:34.260001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:34.260636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:34.261422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:34.261422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:34.261422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:34.261422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:34.261422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:34.261422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:38.766815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:38.767480 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:38.767774 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:38.768990 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:38.804642 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:38.805002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:38.805866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:38.805866 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:38.805866 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:38.805866 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:38.805866 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:38.805866 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:38.805866 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:38.805866 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:38.807798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:38.807798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:38.807798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:38.807798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:38.807798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:38.807798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:38.807798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:38.807798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:38.807798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:38.807798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:38.807798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:38.807798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:38.808227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:38.808227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:38.808227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:38.808227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:38.808227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:38.808227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:38.808227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:38.808227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:38.808227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:38.808227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:38.808227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:38.808227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:38.808227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:38.808639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:38.808639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:38.808639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:38.808639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:38.808639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:38.808639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:38.808639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:38.808639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:38.808639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:38.808639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:38.808639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:38.808639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:38.808639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:38.808639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:38.808639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:38.809050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:38.809721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:38.809721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:38.809721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:38.809721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:38.809721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:38.809721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:39.231711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:39.232351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:39.232665 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:39.238073 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:39.247692 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:39.255690 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:39.280573 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:39.280883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:39.281139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.282718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:39.282718 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:39.282718 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:39.282718 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:39.282718 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:39.282718 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:39.282718 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.282718 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:39.284111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.050 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.284111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:39.284111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:39.284111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:39.284111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.284111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:39.284111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:39.284111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.284111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:39.284111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:39.284111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:39.284111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.284435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:39.284435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:39.284435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:39.284435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:39.284435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:39.284435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:39.284435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:39.284435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:39.284435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:39.284435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:39.284435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:39.284435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:39.284435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:39.284732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.284732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:39.284990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.284990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:39.284990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:39.284990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:39.284990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:39.284990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:39.284990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.284990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:39.284990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:39.284990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.284990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:39.284990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:39.284990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.284990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:39.284990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:39.284990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:39.285433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:39.285860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:39.285860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.285860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:39.285860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:39.285860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:39.287979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:27:39.289378 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:39.289745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.290962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:39.290962 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:39.290962 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:39.290962 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:39.290962 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:39.290962 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:39.290962 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.290962 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:39.292894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.292894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:39.292894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:39.292894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:39.292894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.292894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:39.292894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:39.292894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:39.292894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.292894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:39.292894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:39.292894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:39.292894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:39.292894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:39.292894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:39.293311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:39.293311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:39.293311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:39.293311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:39.293311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:39.293311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:39.293311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:39.293311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.293311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:39.295751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.008 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.295751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:39.295751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:39.295751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:39.295751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.295751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:39.295751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:39.295751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:27:39.295751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:39.295751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:39.295751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.295751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:39.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:39.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:39.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:39.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:39.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:39.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:39.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:39.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:39.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:39.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:39.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:39.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:39.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:39.296623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:39.296623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:39.296623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.296623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:39.297693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.297693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:39.297693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:39.297693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:39.297693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:39.297693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:39.297693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.297693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:39.297693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:39.297693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.297693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:39.297693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:39.297693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.297693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:39.297693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:39.297693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:39.298253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:39.298851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:39.298851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:39.298851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:39.298851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:39.298851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:39.298851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.298851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:39.298851 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:39.298851 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:39.298851 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:39.299275 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:39.299833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.300641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:39.300641 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:39.300641 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:39.300641 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:39.300641 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:39.300641 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:39.300641 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.300641 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:39.301952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.301952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:39.301952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:39.301952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:39.301952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.301952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:39.301952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:39.301952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:39.301952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.301952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:39.301952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:39.301952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:39.301952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:39.301952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:39.301952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:39.302501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:39.302501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:39.302501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:39.302501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:39.302501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:39.302501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:39.302501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:39.302501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.302501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:39.303723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.303723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:39.303723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:39.303723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:39.303723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.303723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:39.303723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:39.303723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:39.303723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:39.303723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.303723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:39.304063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:39.304063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:39.304063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.304063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:39.304063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:39.304063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:39.304063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:39.304063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:39.304063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:39.304063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:39.304063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:39.304063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:39.304063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:39.304063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:39.304508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:39.304508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:39.304508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.304508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.304638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:39.305148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:39.305710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:39.305710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:39.305710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.305710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:39.305710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:39.305710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:39.305710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:39.305710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:39.306006 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:39.306006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.306266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:39.306266 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:39.306266 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:39.306266 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:39.306266 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:39.306266 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:39.306266 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.306266 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:39.307347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.307347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:39.307347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:39.307347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:39.307347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.307347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:39.307347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:39.307347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.307347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:39.307347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:39.307347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:39.307347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.308092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:39.308092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:39.308092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:39.308092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:39.308092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:39.308092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:39.308092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:39.308092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:39.308092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:39.308092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:39.308092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:39.308092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:39.308092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:39.308595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.308595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:39.308595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.308595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:39.308595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:39.308595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:39.308595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:39.308595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:39.308595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.308595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:39.308595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:39.308595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.308595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:39.308595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:39.308595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:39.309145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:39.309852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:39.309852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:39.309852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:39.309852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:39.309852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:39.309852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:43.767500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:43.768261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:43.768261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:43.769672 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:43.803475 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:43.803475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:43.804246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:43.804246 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:43.804246 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:43.804246 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:43.804246 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:43.804246 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:43.804246 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:43.804246 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:43.804895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:43.804895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:43.804895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:43.804895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:43.804895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:43.804895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:43.804895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:43.804895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:43.804895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:43.804895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:43.804895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:43.804895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:43.805815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:43.805815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:43.805815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:43.805815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:43.805815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:43.805815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:43.805815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:43.805815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:43.805815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:43.805815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:43.805815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:43.805815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:43.805815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:43.806943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:43.806943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:43.806943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:43.806943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:43.806943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:43.806943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:43.806943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:43.806943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:43.806943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:43.806943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:43.806943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:43.806943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:43.806943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:43.806943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:43.806943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:43.807711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:43.808801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:43.808801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:43.808801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:43.808801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:43.808801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:43.808801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:44.232666 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:44.233287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:44.233852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:44.235000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:44.235000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:44.235388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.236395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:44.236395 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:44.236395 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:44.236395 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:44.236395 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:44.236395 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:44.236395 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.236395 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:44.238050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.238050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:44.238050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:44.238050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:44.238050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.238050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:44.238050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:44.238050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.238050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:44.238050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:44.238050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:44.238050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.238455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:44.238455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:44.238455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:44.238455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:44.238455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:44.238455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:44.238455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:44.238455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:44.238455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:44.238455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:44.238455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:44.238455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:44.238455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:44.238821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.238821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:44.239760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.239760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:44.239760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:44.239760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:44.239760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:44.239760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:44.239760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.239760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:44.239760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:44.239760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.239760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:44.239760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:44.239760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.239760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:44.239760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:44.239760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:44.240274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:44.240823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:44.240823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.240823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:44.342152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:44.342152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:44.342152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:44.342152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:27:44.342152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:44.342152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.342950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:44.343841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:44.343841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:44.343841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:44.343841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:44.343841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:44.343841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:44.343841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:44.343841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:44.343841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:44.343841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:44.343841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:44.343841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:44.343841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.343841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:44.343841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.344436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:44.344436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:44.344436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:44.344436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.344436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:44.344436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:44.344436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:27:44.344436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:44.344436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:44.344436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.344436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:44.344436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:44.344436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:44.344837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.344837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:44.344837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:44.344837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:44.344837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:44.344837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:44.344837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:44.344837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:44.344837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:44.344837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:44.344837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:44.344837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:44.344837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:44.344837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:44.345404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.345404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:44.345404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.345404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:44.345404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:44.345404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:44.345404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:44.345404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:44.345404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.345404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:44.345404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:44.345404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.345404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:44.345404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:44.345404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:44.345941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:44.346633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:44.346633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:44.346633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:44.346633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:44.346633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:44.346633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:44.346633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:44.346633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.346633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:44.346633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:44.346633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:44.346633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:44.347112 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:44.347112 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:44.347112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.347112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:44.347112 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:44.347112 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:44.347112 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:44.347112 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:44.347112 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:44.347112 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.347112 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:44.347112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:44.347640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:44.348186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:44.348186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:44.348186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:44.348186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:44.348186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.348186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:44.348186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.348186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:44.348186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:44.348186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:44.348186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.348186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:44.348186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:44.348585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:44.348585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:44.348585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.348585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:44.348585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:44.348585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:44.348585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.348585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:44.348585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:44.348585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:44.348585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:44.348585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:44.348585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:44.348927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:44.348927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:44.348927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:44.348927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:44.348927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:44.348927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:44.348927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:44.348927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.348927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:44.348927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.348927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:44.348927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.349292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.349879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:44.350561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:44.350561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:44.350561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:44.350561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:44.350561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:44.350561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:44.350895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.350895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:44.350895 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:44.350895 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:44.350895 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:44.350895 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:44.350895 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:44.350895 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.350895 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:44.350895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.350895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:44.350895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:44.350895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:44.350895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.350895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:44.351570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:44.351570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.351570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:44.351570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:44.351570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:44.351570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.351570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:44.351570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:44.351570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:44.351570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:44.351570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:44.351570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:44.351570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:44.351570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:44.352047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:44.352047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:44.352047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:44.352047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:44.352047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:44.352047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.352047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:44.352047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.352047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:44.352047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:44.352047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:44.352047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:44.352047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:44.352485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:44.352971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:44.352971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:44.352971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:44.352971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:44.352971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:44.352971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:44.352971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:44.352971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:44.352971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:44.352971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:44.352971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:44.352971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:48.768048 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:48.768967 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:48.769257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:48.771421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:48.806636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:48.806994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:48.807908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:48.807908 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:48.807908 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:48.807908 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:48.807908 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:48.807908 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:48.807908 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:48.807908 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:48.809615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:48.809615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:48.809615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:48.809615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:48.809615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:48.809615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:48.809615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:48.809615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:48.809615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:48.809615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:48.809615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:48.809615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:48.810242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:48.810242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:48.810242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:48.810242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:48.810242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:48.810242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:48.810242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:48.810242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:48.810242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:48.810242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:48.810242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:48.810242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:48.810242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:48.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:48.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:48.811560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:48.811560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:48.811560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:48.811560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:48.811560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:48.811560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:48.811560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:48.811560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:48.811560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:48.811560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:48.811560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:48.811560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:48.811560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:48.811560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:48.811560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:48.811560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:48.812277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:48.813234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:48.813234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:48.813234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:49.233281 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:49.233699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:49.233937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:49.235248 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:49.235651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:49.235988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.237060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:49.237060 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:49.237060 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:49.237060 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:49.237060 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:49.237060 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:49.237060 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.237060 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:49.238924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.238924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:49.238924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:49.238924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:49.238924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.238924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:49.238924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:49.238924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.238924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:49.238924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:49.238924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:49.238924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.239255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:49.239255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:49.239255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:49.239255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:49.239255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:49.239255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:49.239255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:49.239255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:49.239255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:49.239255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:49.239255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:49.239255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:49.239255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:49.239634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.239634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:49.240803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.240803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:49.240803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:49.240803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:49.240803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:49.240803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:49.240803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.240803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:49.240803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:49.240803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.240803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:49.240803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:49.240803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.240803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:49.240803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:49.240803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:49.241541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:49.242314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:49.242314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.242314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:49.286144 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:49.287266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:49.287266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:49.287266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:27:49.287951 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:49.288259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.289128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:49.289128 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:49.289128 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:49.289128 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:49.289128 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:49.289128 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:49.289128 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.289128 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:49.290390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.290390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:49.290390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:49.290390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:49.290390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.290390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:49.290390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:49.290390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:49.290390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.290390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:49.290390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:49.290390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:49.290390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:49.290390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:49.290390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:49.291068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:49.291068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:49.291068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:49.291068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:49.291068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:49.291068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:49.291068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:49.291068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.291068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:49.292040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.292040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:49.292040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:49.292040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:49.292040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.292040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:49.292040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:49.292040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:27:49.292040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:49.292040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:49.292040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.292040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:49.292595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:49.292595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:49.292595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.292595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:49.292595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:49.292595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:49.292595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:49.292595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:49.292595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:49.292595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:49.292595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:49.292595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:49.292595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:49.292595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:49.293196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:49.293196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:49.293196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.293196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:49.293695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.293695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:49.293695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:49.293695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:49.293695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:49.293695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:49.293695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.293695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:49.293695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:49.293695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.293695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:49.293695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:49.293695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.293695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:49.293695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:49.293695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:49.294357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:49.295260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:49.295260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:49.295260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:49.295260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:49.295260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:49.295260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.295260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:49.298730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:49.299004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:49.299099 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:49.299222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:49.299594 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:49.299849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.300355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:49.300355 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:49.300355 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:49.300355 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:49.300355 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:49.300355 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:49.300355 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.300355 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:49.301095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.301095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:49.301095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:49.301095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:49.301095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.301095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:49.301095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:49.301095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:49.301095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.301095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:49.301095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:49.301095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:49.301095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:49.301095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:49.301095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:49.301496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:49.301496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:49.301496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:49.301496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:49.301496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:49.301496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:49.301496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:49.301496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.301496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:49.301941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.301941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:49.301941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:49.301941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:49.301941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.301941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:49.301941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:49.301941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:49.301941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:49.301941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.301941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:49.302248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:49.302248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:49.302248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.302248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:49.302248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:49.302248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:49.302248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:49.302248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:49.302248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:49.302248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:49.302248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:49.302248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:49.302248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:49.302248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:49.302627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:49.302627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:49.302627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.302627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.303015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:49.303693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:49.304411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:49.304411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:49.304411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.304411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:49.306459 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:49.306729 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:49.306917 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:49.307062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:49.307430 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:49.307666 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:49.307817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.308378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:49.308378 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:49.308378 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:49.308378 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:49.308378 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:49.308378 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:49.308378 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.308378 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:49.309200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.309200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:49.309200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:49.309200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:49.309200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.309200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:49.309200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:49.309200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.309200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:49.309200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:49.309200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:49.309200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.309545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:49.309545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:49.309545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:49.309545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:49.309545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:49.309545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:49.309545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:49.309545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:49.309545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:49.309545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:49.309545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:49.309545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:49.309545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:49.309843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.309843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:49.310154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.310154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:49.310154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:49.310154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:49.310154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:49.310154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:49.310154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.310154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:49.310154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:49.310154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.310154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:49.310154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:49.310154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.310154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:49.310154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:49.310154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:49.310480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:49.310875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:49.310875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:49.310875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:53.768682 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:53.772658 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:53.772658 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:53.772658 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:53.779229 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=238 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:27:53.803032 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:53.803584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:53.805493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:53.805493 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:53.805493 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:53.805493 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:53.805493 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:53.805493 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:53.805493 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:53.805493 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:53.805493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:53.805493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:53.805493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:53.805493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:53.805493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:53.805493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:53.805493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:53.806040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:53.806040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:53.806040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:53.806040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:53.806040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:53.806040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:53.806040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:53.806040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:53.806040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:53.806040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:53.806040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:53.806040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:53.806040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:53.806040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:53.806499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:53.806499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:53.806499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:53.806499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:53.806499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:53.806499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:53.806712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:53.806712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:53.806712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:53.806712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:53.806712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:53.806712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:53.806712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:53.806712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:53.806712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:53.806712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:53.806712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:53.806712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:53.806712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:53.806712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:53.806712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:53.806712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:53.807215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:53.807945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:53.807945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:53.807945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:54.234206 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:54.234524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:54.234688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:54.235614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:54.235950 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:54.236363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.237179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:54.237179 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:54.237179 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:54.237179 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:54.237179 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:54.237179 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:54.237179 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.237179 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:54.238263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.238263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:54.238263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:54.238263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:54.238263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.238263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:54.238263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:54.238263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.238263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:54.238263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:54.238263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:54.238263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.238717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:54.238717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:54.238717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:54.238717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:54.238717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:54.238717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:54.238717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:54.238717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:54.238717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:54.238717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:54.238717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:54.238717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:54.238717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:54.239169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.239169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:54.239611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.239611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:54.239611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:54.239611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:54.239611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:54.239611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:54.239611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.239611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:54.239611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:54.239611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.239611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:54.239611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:54.239611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.239611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:54.239611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:54.239611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:54.240108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:54.240793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:54.240793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.240793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:54.286709 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:54.287563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:54.287813 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:54.287960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:27:54.288820 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:54.289158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.290156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:54.290156 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:54.290156 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:54.290156 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:54.290156 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:54.290156 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:54.290156 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.290156 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:54.291630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.291630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:54.291630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:54.291630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:54.291630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.291630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:54.291630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:54.291630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:54.291630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.291630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:54.291630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:54.291630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:54.291630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:54.291630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:54.291630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:54.292423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:54.292423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:54.292423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:54.292423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:54.292423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:54.292423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:54.292423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:54.292423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.292423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:54.293183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.293183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:54.293183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:54.293183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:54.293183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.293183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:54.293183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:54.293183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:27:54.293183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:54.293183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:54.293183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.293183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:54.294103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:54.294103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:54.294103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.294103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:54.294103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:54.294103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:54.294103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:54.294103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:54.294103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:54.294103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:54.294103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:54.294103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:54.294103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:54.294103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:54.294855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:54.294855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:54.294855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.294855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:54.294855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.294855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:54.294855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:54.294855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:54.294855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:54.294855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:54.294855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.294855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:54.294855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:54.294855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:54.295527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:54.296573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:54.296573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:54.296573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:54.296573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:54.296573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:54.296573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:54.296573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:54.296573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:54.296573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:54.296573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:54.296573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.296573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:54.299091 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:54.299316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:54.299469 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:54.299604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:54.300143 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:54.300625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.301394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:54.301394 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:54.301394 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:54.301394 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:54.301394 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:54.301394 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:54.301394 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.301394 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:54.302232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.302232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:54.302232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:54.302232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:54.302232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.302232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:54.302232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:54.302232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:54.302232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.302232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:54.302232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:54.302232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:54.302232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:54.302232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:54.302232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:54.302689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:54.302689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:54.302689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:54.302689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:54.302689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:54.302689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:54.302689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:54.302689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.302689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:54.303209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.303209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:54.303209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:54.303209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:54.303209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.303209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:54.303209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:54.303209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:54.303209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:54.303209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.303209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:54.303612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:54.303612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:54.303612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.303612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:54.303612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:54.303612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:54.303612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:54.303612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:54.303612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:54.303612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:54.303612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:54.303612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:54.303612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:54.303612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:54.303974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:54.303974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:54.303974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.303974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.304584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:54.305108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:54.305589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:54.305589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:54.305589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.305589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:54.306801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:54.306979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:54.307119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:54.307339 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:54.307853 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:54.308210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:54.308574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.309680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:54.309680 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:54.309680 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:54.309680 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:54.309680 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:54.309680 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:54.309680 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.309680 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:54.310299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.310299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:54.310299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:54.310299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:54.310299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.310299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:54.310299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:54.310299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.310299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:54.310299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:54.310299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:54.310299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.310645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:54.310645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:54.310645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:54.310645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:54.310645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:54.310645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:54.310645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:54.310645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:54.310645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:54.310645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:54.310645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:54.310645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:54.310645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:54.310970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.310970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:54.311381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.311381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:54.311381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:54.311381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:54.311381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:54.311381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:54.311381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.311381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:54.311381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:54.311381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.311381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:54.311381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:54.311381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.311381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:54.311381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:54.311381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:54.311864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:54.312395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:54.312395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:54.312395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:58.770246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:58.771090 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:58.771329 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:58.772827 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:58.805507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:58.805946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:58.806884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:58.806884 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:58.806884 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:58.806884 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:58.806884 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:58.806884 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:58.806884 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:58.806884 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:58.808206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:58.808206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:58.808206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:58.808206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:58.808206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:58.808206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:58.808206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:58.808206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:58.808206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:58.808206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:58.808206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:58.808206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:58.808842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:58.808842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:58.808842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:58.808842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:58.808842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:58.808842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:58.808842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:58.808842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:58.808842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:58.808842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:58.808842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:58.808842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:58.808842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:58.809417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:58.809417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:58.809417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:58.809417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:58.809417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:58.809417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:58.809417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:58.809417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:58.809417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:58.809417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:58.809417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:58.809417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:58.809417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:58.809417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:58.809417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:58.810088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:58.810957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:58.810957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:58.810957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:58.810957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:58.810957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:58.810957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:59.234582 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:59.235067 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:59.235180 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:59.236284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:59.236756 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:59.237050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.238038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:59.238038 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:59.238038 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:59.238038 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:59.238038 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:59.238038 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:59.238038 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.238038 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:59.239214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.239214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:59.239214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:59.239214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:59.239214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.239214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:59.239214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:59.239214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.239214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:59.239214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:59.239214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:59.239214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.239844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:59.239844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:59.239844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:59.239844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:59.239844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:59.239844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:59.239844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:59.239844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:59.239844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:59.239844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:59.239844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:59.239844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:59.239844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:59.240481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.240481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:59.240481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.240481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:59.240481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:59.240481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:59.240481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:59.240481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:59.240481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.240481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:59.240481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:59.240481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.240481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:59.240481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:59.240481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:59.241171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:59.241997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:59.241997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:59.241997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:59.241997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:59.241997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.241997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:59.287205 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:59.287897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:59.288124 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:59.288504 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:27:59.289414 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:59.289650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.290397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:59.290397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:59.290397 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:59.290397 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:59.290397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:59.290397 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:59.290397 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.290397 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:59.292063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.292063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:59.292063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:59.292063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:59.292063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.292063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:59.292063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:59.292063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:59.292063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.292063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:59.292063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:59.292063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:59.292063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:59.292063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:59.292063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:59.292910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:59.292910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:59.292910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:59.292910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:59.292910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:59.292910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:59.292910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:59.292910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.292910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:59.293465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.293465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:59.293465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:59.293465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:59.293465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.293465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:59.293465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:59.293465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:27:59.293465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:59.293465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:59.293465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.293465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:59.294026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:59.294026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:59.294026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.294026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:59.294026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:59.294026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:59.294026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:59.294026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:59.294026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:59.294026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:59.294026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:59.294026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:59.294026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:59.294026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:59.294644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:59.294644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:59.294644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.294644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:59.294644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.294644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:59.294644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:59.294644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:59.294644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:59.294644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:59.294644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.294644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:59.294644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:59.294644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:59.295320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:59.296243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:59.296243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:59.296243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:59.296243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:59.296243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:59.296243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:59.296243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:59.296243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:59.296243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:59.296243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:59.296243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.296243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:59.299517 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:59.299811 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:59.299935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:59.300074 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:59.300503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:59.300733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.301228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:59.301228 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:59.301228 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:59.301228 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:59.301228 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:59.301228 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:59.301228 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.301228 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:59.302040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.302040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:27:59.302040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:59.302040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:59.302040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.302040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:59.302040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:59.302040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:59.302040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.302040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:27:59.302040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:59.302040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:27:59.302040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:59.302040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:27:59.302040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:27:59.302587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:59.302587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:27:59.302587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:59.302587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:27:59.302587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:27:59.302587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:59.302587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:27:59.302587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.302587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:27:59.302967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.302967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:59.302967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:59.302967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:59.302967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.302967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:59.302967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:59.302967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:59.302967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:59.302967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.302967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:59.303345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:59.303345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:59.303345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.303345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:59.303345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:59.303345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:59.303345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:59.303345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:59.303345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:59.303345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:59.303345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:59.303345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:59.303345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:59.303345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:59.303764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:59.303764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:59.303764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.303764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.304199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:59.304729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:59.305242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:59.305242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:59.305242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.305242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:27:59.307097 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:27:59.307390 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:27:59.307531 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:27:59.307686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:27:59.308152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:59.308604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:27:59.308855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.309663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:27:59.309663 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:59.309663 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:27:59.309663 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:27:59.309663 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:59.309663 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:27:59.309663 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.309663 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:27:59.310698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.310698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:27:59.310698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:59.310698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:27:59.310698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.310698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:59.310698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:59.310698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.310698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:59.310698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:59.310698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:59.310698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.311063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:27:59.311063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:59.311063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:27:59.311063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:59.311063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:27:59.311063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:27:59.311063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:59.311063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:27:59.311063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:59.311063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:27:59.311063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:27:59.311063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:59.311063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:27:59.311442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.311442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:27:59.311938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.311938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:27:59.311938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:27:59.311938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:27:59.311938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:27:59.311938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:27:59.311938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.311938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:27:59.311938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:27:59.311938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.311938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:27:59.311938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:27:59.311938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.311938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:27:59.311938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:27:59.311938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:27:59.312683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:27:59.313224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:27:59.313224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:27:59.313224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:03.771086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:03.772239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:03.772469 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:03.774026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:03.816542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:03.816877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:03.817750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:03.817750 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:03.817750 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:03.817750 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:03.817750 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:03.817750 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:03.817750 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:03.817750 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:03.819159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.045 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:03.819159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:03.819159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:03.819159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:03.819159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:03.819159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:03.819159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:03.819159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:03.819159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:03.819159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:03.819159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:03.819159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:03.820043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:03.820043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:03.820043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:03.820043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:03.820043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:03.820043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:03.820043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:03.820043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:03.820043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:03.820043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:03.820043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:03.820043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:03.820043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:03.821169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:03.821169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:03.821169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:03.821169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:03.821169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:03.821169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:03.821169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:03.821169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:03.821169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:03.821169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:03.821169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:03.821169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:03.821169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:03.821169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:03.821169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:03.821642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:03.822150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:03.822150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:03.822150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:03.822150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:03.822150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:03.822150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:04.235187 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:04.235850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:04.236057 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:04.237113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:04.237563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:04.237972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.238891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:04.238891 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:04.238891 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:04.238891 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:04.238891 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:04.238891 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:04.238891 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.238891 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:04.240522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.240522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:04.240522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:04.240522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:04.240522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.240522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:04.240522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:04.240522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.240522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:04.240522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:04.240522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:04.240522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.240900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:04.240900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:04.240900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:04.240900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:04.240900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:04.240900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:04.240900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:04.240900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:04.240900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:04.240900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:04.240900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:04.240900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:04.240900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:04.241249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.241249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:04.242333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.242333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:04.242333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:04.242333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:04.242333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:04.242333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:04.242333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.242333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:04.242333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:04.242333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.242333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:04.242333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:04.242333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.242333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:04.242333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:04.242333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:04.242785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:04.243259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:04.243259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.243259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:04.287811 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:04.288240 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:04.288488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:04.288685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:28:04.289446 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:04.289790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.290731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:04.290731 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:04.290731 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:04.290731 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:04.290731 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:04.290731 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:04.290731 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.290731 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:04.291991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.291991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:04.291991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:04.291991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:04.291991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.291991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:04.291991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:04.291991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:04.291991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.291991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:04.291991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:04.291991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:04.291991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:04.291991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:04.291991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:04.292793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:04.292793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:04.292793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:04.292793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:04.292793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:04.292793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:04.292793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:04.292793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.292793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:04.293705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.293705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:04.293705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:04.293705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:04.293705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.293705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:04.293705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:04.293705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:28:04.293705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:04.293705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:04.293705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.293705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:04.294974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:04.294974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:04.294974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.294974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:04.294974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:04.294974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:04.294974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:04.294974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:04.294974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:04.294974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:04.294974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:04.294974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:04.294974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:04.294974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:04.296440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:04.296440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:04.296440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.296440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:04.296440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.296440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:04.296440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:04.296440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:04.296440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:04.296440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:04.296440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.296440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:04.296440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:04.296440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:04.297048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:04.298852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:04.298852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:04.298852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:04.298852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:04.298852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:04.298852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:04.298852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:04.298852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:04.298852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:04.298852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:04.298852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.298852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:04.299977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:04.300260 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:04.300427 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:04.300566 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:04.301064 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:04.301504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.302333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:04.302333 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:04.302333 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:04.302333 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:04.302333 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:04.302333 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:04.302333 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.302333 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:04.303108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.303108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:04.303108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:04.303108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:04.303108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.303108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:04.303108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:04.303108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:04.303108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.303108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:04.303108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:04.303108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:04.303108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:04.303108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:04.303108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:04.305091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:04.305091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:04.305091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:04.305091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:04.305091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:04.305091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:04.305091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:04.305091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.305091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:04.305091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.305091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:04.305091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:04.305091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:04.305091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.305928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:04.305928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:04.305928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:04.305928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:04.305928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.305928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:04.305928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:04.305928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:04.305928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.305928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:04.305928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:04.305928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:04.305928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:04.306704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:04.306704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:04.306704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:04.306704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:04.306704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:04.306704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:04.306704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:04.306704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:04.306704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:04.306704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.306704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:04.306704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:04.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.308214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:04.309258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:04.309258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:04.309258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:04.309258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:04.309258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:04.309258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:04.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:04.309653 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:04.309653 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:04.309653 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:04.309653 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:04.309653 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:04.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:04.310426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.310426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:04.310426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:04.310426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:04.310426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.310426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:04.310426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:04.310426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.310426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:04.310426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:04.310426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:04.310426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.310843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:04.310843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:04.310843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:04.310843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:04.310843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:04.310843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:04.310843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:04.310843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:04.310843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:04.310843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:04.310843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:04.310843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:04.310843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:04.311233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.311233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:04.311410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.311410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:04.311410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:04.311410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:04.311410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:04.311410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:04.311410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.311410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:04.311410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:04.311410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.311410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:04.311410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:04.311410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.311410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:04.311410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:04.311410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:04.311852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:04.312385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:04.312385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:04.312385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:08.772086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:08.775994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:08.775994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:08.775994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:08.805394 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:08.805809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:08.806722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:08.806722 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:08.806722 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:08.806722 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:08.806722 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:08.806722 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:08.806722 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:08.806722 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:08.809070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:08.809070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:08.809070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:08.809070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:08.809070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:08.809070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:08.809070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:08.809070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:08.809070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:08.809070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:08.809070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:08.809070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:08.809656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:08.809656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:08.809656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:08.809656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:08.809656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:08.809656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:08.809656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:08.809656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:08.809656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:08.809656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:08.809656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:08.809656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:08.809656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:08.810246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:08.810246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:08.810246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:08.810246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:08.810246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:08.810246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:08.810246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:08.810246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:08.810246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:08.810246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:08.810246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:08.810246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:08.810246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:08.810246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:08.810246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:08.810955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:08.811758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:08.811758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:08.811758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:08.811758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:08.811758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:08.811758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:09.235896 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:09.237658 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:09.237658 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:09.237991 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:09.238288 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:09.238544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.241426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:09.241426 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:09.241426 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:09.241426 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:09.241426 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:09.241426 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:09.241426 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.241426 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:09.241426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.241426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:09.241426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:09.241426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:09.241426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.241426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:09.241426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:09.242007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.242007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:09.242007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:09.242007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:09.242007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.242007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:09.242007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:09.242007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:09.242007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:09.242007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:09.242007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:09.242007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:09.242007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:09.242007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:09.242342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:09.242342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:09.242342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:09.242342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:09.242342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.242342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:09.242342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.242342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:09.242342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:09.242342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:09.242342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:09.242342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:09.242342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.242342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:09.242754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:09.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:09.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:09.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:09.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:09.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:09.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:09.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:09.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:09.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.243265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:09.288611 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:09.289345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:09.289972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:09.290501 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:28:09.291243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:09.291612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.295405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:09.296089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:09.296089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:09.296089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:09.296089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:09.296089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:09.296089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:09.296089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:09.296089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:09.296089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:09.296089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:09.296089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:09.296089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:09.296089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.296089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:09.296089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.296738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:09.296738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:09.296738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:09.296738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.296738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:09.296738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:09.296738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:28:09.296738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:09.296738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:09.296738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.296738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:09.296738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:09.296738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:09.297147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.297147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:09.297147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:09.297147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:09.297147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:09.297147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:09.297147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:09.297147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:09.297147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:09.297147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:09.297147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:09.297147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:09.297147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:09.297147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:09.297620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.297620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:09.297620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.297620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:09.297620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:09.297620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:09.297620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:09.297620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:09.297620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.297620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:09.297620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:09.297620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.297620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:09.297620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:09.297620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:09.298116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:09.298729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:09.298729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:09.298729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:09.298729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:09.298729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:09.298729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:09.298729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:09.298729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.298729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:09.300691 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:09.301262 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:09.301500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:09.302035 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:09.302587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:09.303136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.304286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:09.304286 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:09.304286 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:09.304286 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:09.304286 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:09.304286 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:09.304286 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.304286 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:09.305704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.305704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:09.305704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:09.305704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:09.305704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.305704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:09.305704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:09.305704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:09.305704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.305704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:09.305704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:09.305704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:09.305704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:09.305704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:09.305704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:09.306085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:09.306085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:09.306085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:09.306085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:09.306085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:09.306085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:09.306085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:09.306085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.306085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:09.307352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.307352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:09.307352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:09.307352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:09.307352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.307352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:09.307352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:09.307352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:09.307352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:09.307352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.307352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:09.307662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:09.307662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:09.307662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.307662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:09.307662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:09.307662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:09.307662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:09.307662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:09.307662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:09.307662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:09.307662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:09.307662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:09.307662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:09.307662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:09.307972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:09.307972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:09.307972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.307972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.309572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:09.310234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:09.310817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:09.310817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:09.310817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.310817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:09.310817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:09.310817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:09.310817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:09.310817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:09.311279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:09.311802 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:09.312168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.313056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:09.313056 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:09.313056 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:09.313056 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:09.313056 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:09.313056 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:09.313056 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.313056 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:09.313908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.313908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:09.313908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:09.313908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:09.313908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.313908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:09.313908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:09.313908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.313908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:09.313908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:09.313908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:09.313908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.314579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:09.314579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:09.314579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:09.314579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:09.314579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:09.314579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:09.314579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:09.314579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:09.314579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:09.314579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:09.314579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:09.314579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:09.314579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:09.315159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.315159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:09.315159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.315159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:09.315159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:09.315159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:09.315159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:09.315159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:09.315159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.315159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:09.315159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:09.315159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.315159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:09.315159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:09.315159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:09.315811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:09.316400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:09.316400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:09.316400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:09.316400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:09.316400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:09.316400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:13.773645 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:13.774194 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:13.774457 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:13.775845 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:13.814165 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:13.814728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:13.815697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:13.815697 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:13.815697 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:13.815697 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:13.815697 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:13.815697 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:13.815697 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:13.815697 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:13.816651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:13.816651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:13.816651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:13.816651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:13.816651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:13.816651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:13.816651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:13.816651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:13.816651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:13.816651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:13.816651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:13.816651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:13.817283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:13.817283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:13.817283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:13.817283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:13.817283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:13.817283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:13.817283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:13.817283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:13.817283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:13.817283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:13.817283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:13.817283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:13.817283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:13.818039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:13.818039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:13.818039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:13.818039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:13.818039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:13.818039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:13.818039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:13.818039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:13.818039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:13.818039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:13.818039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:13.818039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:13.818039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:13.818039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:13.818039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:13.818846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:13.819837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:13.819837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:13.819837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:13.819837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:13.819837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:13.819837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:14.236720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:14.237454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:14.237767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:14.239087 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:14.239432 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:14.239688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.240626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:14.240626 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:14.240626 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:14.240626 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:14.240626 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:14.240626 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:14.240626 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.240626 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:14.242119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.242119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:14.242119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:14.242119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:14.242119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.242119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:14.242119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:14.242119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.242119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:14.242119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:14.242119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:14.242119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.242631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:14.242631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:14.242631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:14.242631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:14.242631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:14.242631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:14.242631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:14.242631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:14.242631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:14.242631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:14.242631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:14.242631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:14.242631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:14.243067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.243067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:14.243864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.243864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:14.243864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:14.243864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:14.243864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:14.243864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:14.243864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.243864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:14.243864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:14.243864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.243864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:14.243864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:14.243864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.243864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:14.243864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:14.243864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:14.244402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:14.244907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:14.244907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.244907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:14.289856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:14.290564 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:14.290767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:14.291085 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:28:14.291748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:14.291966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.292765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:14.292765 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:14.292765 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:14.292765 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:14.292765 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:14.292765 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:14.292765 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.292765 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:14.294461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.294461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:14.294461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:14.294461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:14.294461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.294461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:14.294461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:14.294461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:14.294461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.294461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:14.294461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:14.294461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:14.294461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:14.294461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:14.294461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:14.294982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:14.294982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:14.294982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:14.294982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:14.294982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:14.294982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:14.294982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:14.294982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.294982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:14.296265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.296265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:14.296265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:14.296265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:14.296265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.296265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:14.296265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:14.296265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:28:14.296265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:14.296265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:14.296265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.296265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:14.296797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:14.296797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:14.296797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.296797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:14.296797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:14.296797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:14.296797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:14.296797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:14.296797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:14.296797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:14.296797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:14.296797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:14.296797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:14.296797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:14.297228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:14.297228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:14.297228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.297228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:14.298740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.298740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:14.298740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:14.298740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:14.298740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:14.298740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:14.298740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.298740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:14.298740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:14.298740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.298740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:14.298740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:14.298740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.298740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:14.298740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:14.298740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:14.299211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:14.299736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:14.299736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:14.299736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:14.299736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:14.299736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:14.299736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.299736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:14.301384 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:14.301768 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:14.301768 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:14.301879 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:14.302713 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:14.302943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.303669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:14.303669 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:14.303669 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:14.303669 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:14.303669 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:14.303669 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:14.303669 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.303669 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:14.304160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.304160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:14.304160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:14.304160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:14.304160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.304160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:14.304160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:14.304160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:14.304160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.304160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:14.304160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:14.304160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:14.304160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:14.304160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:14.304160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:14.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:14.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:14.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:14.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:14.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:14.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:14.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:14.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:14.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:14.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:14.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:14.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.305844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:14.305844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:14.305844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:14.305844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:14.305844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.305844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:14.305844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:14.305844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:14.305844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.305844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:14.305844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:14.305844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:14.305844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:14.306768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:14.306768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:14.306768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:14.306768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:14.306768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:14.306768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:14.306768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:14.306768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:14.306768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:14.306768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.306768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:14.306768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:14.307350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.308263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:14.310041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:14.310444 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:14.310622 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:14.310854 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:14.311451 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:14.311853 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:14.312121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.313028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:14.313028 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:14.313028 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:14.313028 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:14.313028 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:14.313028 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:14.313028 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.313028 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:14.314114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.314114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:14.314114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:14.314114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:14.314114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.314114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:14.314114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:14.314114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.314114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:14.314114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:14.314114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:14.314114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.314401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:14.314401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:14.314401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:14.314401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:14.314401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:14.314401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:14.314401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:14.314401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:14.314401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:14.314401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:14.314401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:14.314401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:14.314401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:14.314629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.314629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:14.315471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.315471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:14.315471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:14.315471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:14.315471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:14.315471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:14.315471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.315471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:14.315471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:14.315471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.315471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:14.315471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:14.315471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.315471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:14.315471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:14.315471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:14.315782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:14.316133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:14.316133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:14.316133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:18.774510 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:18.775825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:18.775825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:18.776483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:18.810401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:18.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:18.811816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:18.811816 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:18.811816 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:18.811816 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:18.811816 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:18.811816 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:18.811816 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:18.811816 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:18.812630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:18.812630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:18.812630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:18.812630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:18.812630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:18.812630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:18.812630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:18.812630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:18.812630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:18.812630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:18.812630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:18.812630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:18.813258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:18.813258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:18.813258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:18.813258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:18.813258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:18.813258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:18.813258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:18.813258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:18.813258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:18.813258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:18.813258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:18.813258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:18.813258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:18.813916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:18.813916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:18.813916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:18.813916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:18.813916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:18.813916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:18.813916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:18.813916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:18.813916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:18.813916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:18.813916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:18.813916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:18.813916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:18.813916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:18.813916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:18.814609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:18.815533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:18.815533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:18.815533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:18.815533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:18.815533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:18.815533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:19.237525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:19.238324 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:19.238614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:19.239823 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:19.240053 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:19.240358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.241143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:19.241143 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:19.241143 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:19.241143 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:19.241143 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:19.241143 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:19.241143 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.241143 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:19.242667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.242667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:19.242667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:19.242667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:19.242667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.242667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:19.242667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:19.242667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.242667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:19.242667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:19.242667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:19.242667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.243054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:19.243054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:19.243054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:19.243054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:19.243054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:19.243054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:19.243054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:19.243054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:19.243054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:19.243054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:19.243054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:19.243054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:19.243054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:19.243424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.243424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:19.244614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.244614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:19.244614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:19.244614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:19.244614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:19.244614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:19.244614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.244614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:19.244614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:19.244614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.244614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:19.244614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:19.244614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.244614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:19.244614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:19.244614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:19.245114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:19.245820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:19.245820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.245820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:19.290589 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:19.291257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:19.291649 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:19.291956 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:28:19.292749 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:19.293054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.293998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:19.293998 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:19.293998 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:19.293998 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:19.293998 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:19.293998 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:19.293998 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.293998 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:19.294790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.294790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:19.294790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:19.294790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:19.294790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.294790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:19.294790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:19.294790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:19.294790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.294790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:19.294790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:19.294790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:19.294790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:19.294790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:19.294790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:19.295345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:19.295345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:19.295345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:19.295345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:19.295345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:19.295345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:19.295345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:19.295345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.295345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:19.295817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.295817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:19.295817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:19.295817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:19.295817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.295817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:19.295817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:19.295817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:28:19.295817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:19.295817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:19.295817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.295817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:19.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:19.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:19.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:19.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:19.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:19.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:19.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:19.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:19.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:19.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:19.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:19.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:19.296221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:19.296757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:19.296757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:19.296757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.296757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:19.296940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.296940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:19.296940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:19.296940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:19.296940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:19.296940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:19.296940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.296940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:19.296940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:19.296940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.296940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:19.296940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:19.296940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.296940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:19.296940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:19.296940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:19.297471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:19.298520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:19.298520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:19.298520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:19.298520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:19.298520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:19.298520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.298520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:19.301862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:19.302149 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:19.302261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:19.302431 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:19.302990 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:19.303381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.304115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:19.304115 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:19.304115 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:19.304115 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:19.304115 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:19.304115 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:19.304115 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.304115 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:19.304913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.304913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:19.304913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:19.304913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:19.304913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.304913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:19.304913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:19.304913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:19.304913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.304913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:19.304913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:19.304913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:19.304913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:19.304913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:19.304913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:19.305495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:19.305495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:19.305495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:19.305495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:19.305495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:19.305495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:19.305495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:19.305495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.305495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:19.305903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.305903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:19.305903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:19.305903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:19.305903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.305903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:19.305903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:19.305903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:19.305903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:19.305903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.305903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:19.306223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:19.306223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:19.306223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.306223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:19.306223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:19.306223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:19.306223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:19.306223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:19.306223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:19.306223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:19.306223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:19.306223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:19.306223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:19.306223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:19.306689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:19.306689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:19.306689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.306689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.306945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:19.307426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:19.307984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:19.307984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:19.307984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.307984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:19.310511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:19.310779 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:19.310888 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:19.311037 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:19.311599 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:19.311955 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:19.312214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.313095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:19.313095 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:19.313095 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:19.313095 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:19.313095 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:19.313095 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:19.313095 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.313095 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:19.313963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.313963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:19.313963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:19.313963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:19.313963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.313963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:19.313963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:19.313963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.313963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:19.313963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:19.313963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:19.313963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.314310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:19.314310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:19.314310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:19.314310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:19.314310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:19.314310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:19.314310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:19.314310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:19.314310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:19.314310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:19.314310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:19.314310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:19.314310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:19.314855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.314855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:19.314982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.314982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:19.314982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:19.314982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:19.314982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:19.314982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:19.314982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.314982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:19.314982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:19.314982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.314982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:19.314982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:19.314982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.314982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:19.314982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:19.314982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:19.315425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:19.315924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:19.315924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:19.315924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:23.775040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:23.776132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:23.776230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:23.776956 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:23.816595 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:23.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:23.817552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:23.817552 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:23.817552 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:23.817552 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:23.817552 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:23.817552 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:23.817552 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:23.817552 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:23.819178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:23.819178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:23.819178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:23.819178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:23.819178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:23.819178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:23.819178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:23.819178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:23.819178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:23.819178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:23.819178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:23.819178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:23.819878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:23.819878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:23.819878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:23.819878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:23.819878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:23.819878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:23.819878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:23.819878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:23.819878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:23.819878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:23.819878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:23.819878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:23.819878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:23.820487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:23.820487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:23.820487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:23.820487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:23.820487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:23.820487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:23.820487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:23.820487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:23.820487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:23.820487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:23.820487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:23.820487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:23.820487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:23.820487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:23.820487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:23.821140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:23.822037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:23.822037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:23.822037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:23.822037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:23.822037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:23.822037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:24.238347 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:24.238953 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:24.239168 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:24.240480 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:24.240861 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:24.241135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.242139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:24.242139 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:24.242139 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:24.242139 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:24.242139 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:24.242139 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:24.242139 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.242139 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:24.243929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.243929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:24.243929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:24.243929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:24.243929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.243929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:24.243929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:24.243929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.243929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:24.243929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:24.243929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:24.243929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.244319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:24.244319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:24.244319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:24.244319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:24.244319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:24.244319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:24.244319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:24.244319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:24.244319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:24.244319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:24.244319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:24.244319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:24.244319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:24.244667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.244667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:24.245793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:24.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:24.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:24.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.246750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:24.291215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:24.291869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:24.292071 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:24.292271 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:28:24.293112 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:24.293511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.294493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:24.294493 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:24.294493 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:24.294493 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:24.294493 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:24.294493 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:24.294493 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.294493 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:24.296032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.296032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:24.296032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:24.296032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:24.296032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.296032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:24.296032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:24.296032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:24.296032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.296032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:24.296032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:24.296032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:24.296032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:24.296032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:24.296032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:24.296496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:24.296496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:24.296496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:24.296496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:24.296496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:24.296496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:24.296496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:24.296496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.296496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:24.297491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.297491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:24.297491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:24.297491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:24.297491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.297491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:24.297491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:24.297491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:28:24.297491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:24.297491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:24.297491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.297491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:24.297823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:24.297823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:24.297823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.297823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:24.297823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:24.297823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:24.297823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:24.297823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:24.297823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:24.297823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:24.297823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:24.297823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:24.297823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:24.297823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:24.298190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:24.298190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:24.298190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.298190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:24.299247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.299247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:24.299247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:24.299247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:24.299247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:24.299247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:24.299247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.299247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:24.299247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:24.299247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.299247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:24.299247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:24.299247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.299247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:24.299247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:24.299247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:24.299718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:24.300183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:24.300183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:24.300183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:24.300183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:24.300183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:24.300183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.300183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:24.302309 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:24.302621 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:24.302741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:24.302862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:24.303429 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:24.304077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.304720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:24.304720 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:24.304720 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:24.304720 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:24.304720 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:24.304720 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:24.304720 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.304720 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:24.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:24.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:24.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:24.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:24.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:24.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:24.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:24.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:24.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:24.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:24.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:24.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:24.305942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:24.305942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:24.305942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:24.305942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:24.305942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:24.305942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:24.305942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:24.305942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.305942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:24.306571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.306571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:24.306571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:24.306571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:24.306571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.306571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:24.306571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:24.306571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:24.306571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:24.306571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.306571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:24.306880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:24.306880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:24.306880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.306880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:24.306880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:24.306880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:24.306880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:24.306880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:24.306880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:24.306880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:24.306880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:24.306880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:24.306880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:24.306880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:24.307270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:24.307270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:24.307270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.307270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.307726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:24.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:24.308755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:24.308755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:24.308755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.308755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:24.310895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:24.311132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:24.311259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:24.311451 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:24.311845 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:24.312082 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:24.312232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.312906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:24.312906 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:24.312906 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:24.312906 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:24.312906 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:24.312906 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:24.312906 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.312906 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:24.313759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.313759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:24.313759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:24.313759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:24.313759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.313759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:24.313759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:24.313759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.313759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:24.313759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:24.313759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:24.313759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.314126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:24.314126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:24.314126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:24.314126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:24.314126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:24.314126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:24.314126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:24.314126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:24.314126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:24.314126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:24.314126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:24.314126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:24.314126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:24.314486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.314486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:24.314805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.314805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:24.314805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:24.314805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:24.314805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:24.314805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:24.314805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.314805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:24.314805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:24.314805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.314805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:24.314805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:24.314805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.314805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:24.314805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:24.314805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:24.315274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:24.315799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:24.315799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:24.315799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:28.776224 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:28.777139 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:28.777139 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:28.778313 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:28.808600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:28.808834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:28.809441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:28.809441 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:28.809441 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:28.809441 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:28.809441 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:28.809441 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:28.809441 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:28.809441 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:28.810176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.032 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:28.810176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:28.810176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:28.810176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:28.810176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:28.810176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:28.810176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:28.810176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:28.810176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:28.810176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:28.810176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:28.810176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:28.810822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:28.810822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:28.810822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:28.810822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:28.810822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:28.810822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:28.810822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:28.810822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:28.810822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:28.810822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:28.810822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:28.810822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:28.810822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:28.811472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:28.811472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:28.811472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:28.811472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:28.811472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:28.811472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:28.811472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:28.811472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:28.811472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:28.811472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:28.811472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:28.811472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:28.811472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:28.811472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:28.811472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:28.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:28.813085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:28.813085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:28.813085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:28.813085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:28.813085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:28.813085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:29.239667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:29.239667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:29.239667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:29.241386 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:29.241790 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:29.242057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.243529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:29.243529 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:29.243529 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:29.243529 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:29.243529 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:29.243529 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:29.243529 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.243529 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:29.244289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.244289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:29.244289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:29.244289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:29.244289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.244289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:29.244289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:29.244289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.244289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:29.244289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:29.244289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:29.244289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.244617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:29.244617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:29.244617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:29.244617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:29.244617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:29.244617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:29.244617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:29.244617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:29.244617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:29.244617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:29.244617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:29.244617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:29.244617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:29.244874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.244874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:29.245517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.245517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:29.245517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:29.245517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:29.245517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:29.245517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:29.245517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.245517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:29.245517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:29.245517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.245517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:29.245517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:29.245517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.245517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:29.245517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:29.245517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:29.245860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:29.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:29.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.246243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:29.291804 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:29.292317 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:29.292644 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:29.292836 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:28:29.294037 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:29.294470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.295429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:29.295429 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:29.295429 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:29.295429 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:29.295429 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:29.295429 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:29.295429 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.295429 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:29.296775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.296775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:29.296775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:29.296775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:29.296775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.296775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:29.296775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:29.296775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:29.296775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.296775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:29.296775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:29.296775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:29.296775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:29.296775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:29.296775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:29.297708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:29.297708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:29.297708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:29.297708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:29.297708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:29.297708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:29.297708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:29.297708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.297708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:29.298150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.298150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:29.298150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:29.298150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:29.298150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.298150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:29.298150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:29.298150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:28:29.298150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:29.298150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:29.298150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.298150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:29.298788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:29.298788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:29.298788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.298788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:29.298788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:29.298788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:29.298788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:29.298788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:29.298788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:29.298788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:29.298788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:29.298788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:29.298788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:29.298788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:29.299843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:29.299843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:29.299843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.299843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:29.299843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.299843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:29.299843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:29.299843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:29.299843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:29.299843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:29.299843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.299843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:29.299843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:29.299843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:29.301021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:29.301616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:29.301616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:29.301616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:29.301616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:29.301616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:29.301616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:29.301616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:29.301616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:29.301616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:29.301616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:29.301616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.301616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:29.302667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:29.302932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:29.303058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:29.303211 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:29.303764 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:29.304156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.304918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:29.304918 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:29.304918 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:29.304918 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:29.304918 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:29.304918 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:29.304918 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.304918 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:29.305717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.305717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:29.305717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:29.305717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:29.305717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.305717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:29.305717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:29.305717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:29.305717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.305717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:29.305717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:29.305717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:29.305717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:29.305717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:29.305717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:29.306098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:29.306098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:29.306098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:29.306098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:29.306098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:29.306098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:29.306098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:29.306098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.306098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:29.306638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.306638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:29.306638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:29.306638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:29.306638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.306638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:29.306638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:29.306638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:29.306638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:29.306638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.306638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:29.306951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:29.306951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:29.306951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.306951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:29.306951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:29.306951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:29.306951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:29.306951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:29.306951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:29.306951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:29.306951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:29.306951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:29.306951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:29.306951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:29.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:29.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:29.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.307301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.307963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:29.308465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:29.308988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:29.308988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:29.308988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.308988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:29.311294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:29.311595 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:29.311707 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:29.311859 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:29.312646 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:29.313134 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:29.313388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.314297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:29.314297 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:29.314297 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:29.314297 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:29.314297 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:29.314297 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:29.314297 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.314297 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:29.315821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.315821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:29.315821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:29.315821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:29.315821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.315821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:29.315821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:29.315821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.315821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:29.315821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:29.315821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:29.315821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.316330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:29.316330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:29.316330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:29.316330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:29.316330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:29.316330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:29.316330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:29.316330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:29.316330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:29.316330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:29.316330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:29.316330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:29.316330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:29.316808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.316808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:29.318780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.318780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:29.318780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:29.318780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:29.318780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:29.318780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:29.318780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.318780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:29.318780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:29.318780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.318780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:29.318780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:29.318780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.318780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:29.318780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:29.318780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:29.319426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:29.320417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:29.320417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:29.320417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:33.776944 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:33.777440 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:33.777570 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:33.778377 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:33.813715 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:33.814207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:33.815080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:33.815080 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:33.815080 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:33.815080 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:33.815080 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:33.815080 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:33.815080 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:33.815080 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:33.815982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:33.815982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:33.815982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:33.815982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:33.815982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:33.815982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:33.815982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:33.815982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:33.815982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:33.815982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:33.815982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:33.815982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:33.816401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:33.816401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:33.816401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:33.816401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:33.816401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:33.816401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:33.816401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:33.816401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:33.816401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:33.816401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:33.816401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:33.816401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:33.816401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:33.816753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:33.816753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:33.816839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:33.816839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:33.816839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:33.816839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:33.816839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:33.816839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:33.816839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:33.816839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:33.816839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:33.816839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:33.816839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:33.816839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:33.816839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:33.816839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:33.816839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:33.816839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:33.817272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:33.817794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:33.817794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:33.817794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:34.239559 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:34.240220 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:34.240342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:34.241062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:34.241280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:34.241485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.243593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:34.243593 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:34.243593 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:34.243593 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:34.243593 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:34.243593 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:34.243593 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.243593 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:34.245961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.245961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:34.245961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:34.245961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:34.245961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.245961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:34.245961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:34.245961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.245961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:34.245961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:34.245961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:34.245961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.246641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:34.246641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:34.246641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:34.246641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:34.246641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:34.246641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:34.246641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:34.246641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:34.246641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:34.246641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:34.246641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:34.246641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:34.246641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:34.247243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.247243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:34.250336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.250336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:34.250336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:34.250336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:34.250336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:34.250336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:34.250336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.250336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:34.250336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:34.250336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.250336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:34.250336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:34.250336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.250336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:34.250336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:34.250336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:34.251244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:34.251846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:34.251846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.251846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:34.292616 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:34.293020 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:34.293297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:34.293479 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:28:34.294397 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:34.294785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.295558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:34.295558 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:34.295558 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:34.295558 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:34.295558 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:34.295558 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:34.295558 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.295558 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:34.296382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.296382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:34.296382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:34.296382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:34.296382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.296382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:34.296382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:34.296382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:34.296382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.296382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:34.296382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:34.296382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:34.296382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:34.296382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:34.296382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:34.296857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:34.296857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:34.296857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:34.296857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:34.296857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:34.296857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:34.296857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:34.296857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.296857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:34.297287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.297287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:34.297287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:34.297287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:34.297287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.297287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:34.297287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:34.297287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:28:34.297287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:34.297287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:34.297287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.297287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:34.297657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:34.297657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:34.297657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.297657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:34.297657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:34.297657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:34.297657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:34.297657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:34.297657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:34.297657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:34.297657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:34.297657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:34.297657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:34.297657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:34.298006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:34.298006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:34.298006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.298006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:34.298592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.298592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:34.298592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:34.298592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:34.298592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:34.298592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:34.298592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.298592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:34.298592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:34.298592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.298592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:34.298592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:34.298592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.298592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:34.298592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:34.298592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:34.299009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:34.299473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:34.299473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:34.299473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:34.299473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:34.299473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:34.299473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.299473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:34.305151 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:34.305483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:34.305628 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:34.305774 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:34.306142 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:34.306384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.306888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:34.306888 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:34.306888 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:34.306888 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:34.306888 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:34.306888 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:34.306888 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.306888 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:34.307698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.307698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:34.307698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:34.307698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:34.307698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.307698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:34.307698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:34.307698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:34.307698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.307698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:34.307698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:34.307698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:34.307698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:34.307698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:34.307698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:34.308069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:34.308069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:34.308069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:34.308069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:34.308069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:34.308069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:34.308069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:34.308069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.308069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:34.308659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.308659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:34.308659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:34.308659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:34.308659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.308659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:34.308659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:34.308659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:34.308659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:34.308659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.308659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:34.308984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:34.308984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:34.308984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.308984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:34.308984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:34.308984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:34.308984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:34.308984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:34.308984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:34.308984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:34.308984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:34.308984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:34.308984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:34.308984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:34.309320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:34.309320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:34.309320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.309320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:34.310293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:34.310786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:34.310786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:34.310786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.310786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:34.311678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:34.311971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:34.312128 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:34.312297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:34.312644 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:34.312858 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:34.313828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.314330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:34.314330 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:34.314330 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:34.314330 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:34.314330 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:34.314330 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:34.314330 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.314330 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:34.315240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.315240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:34.315240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:34.315240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:34.315240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.315240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:34.315240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:34.315240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.315240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:34.315240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:34.315240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:34.315240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.315595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:34.315595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:34.315595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:34.315595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:34.315595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:34.315595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:34.315595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:34.315595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:34.315595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:34.315595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:34.315595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:34.315595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:34.315595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:34.315943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.315943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:34.316853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.316853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:34.316853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:34.316853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:34.316853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:34.316853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:34.316853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.316853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:34.316853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:34.316853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.316853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:34.316853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:34.316853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.316853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:34.316853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:34.316853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:34.317265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:34.317775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:34.317775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:34.317775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:38.777916 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:38.778934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:38.778934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:38.781287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:38.828535 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:38.828833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:38.829672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:38.829672 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:38.829672 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:38.829672 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:38.829672 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:38.829672 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:38.829672 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:38.829672 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:38.830669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.051 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:38.830669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:38.830669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:38.830669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:38.830669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:38.830669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:38.830669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:38.830669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:38.830669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:38.830669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:38.830669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:38.830669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:38.831529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:38.831529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:38.831529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:38.831529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:38.831529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:38.831529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:38.831529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:38.831529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:38.831529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:38.831529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:38.831529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:38.831529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:38.831529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:38.832239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:38.832239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:38.832239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:38.832239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:38.832239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:38.832239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:38.832239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:38.832239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:38.832239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:38.832239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:38.832239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:38.832239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:38.832239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:38.832239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:38.832239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:38.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:38.834293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:38.834293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:38.834293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:38.834293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:38.834293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:38.834293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:39.240418 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:39.240752 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:39.240868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:39.241785 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:39.242090 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:39.242358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.243189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:39.243189 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:39.243189 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:39.243189 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:39.243189 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:39.243189 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:39.243189 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.243189 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:39.244153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.244153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:39.244153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:39.244153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:39.244153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.244153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:39.244153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:39.244153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.244153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:39.244153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:39.244153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:39.244153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.244975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:39.244975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:39.244975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:39.244975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:39.244975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:39.244975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:39.244975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:39.244975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:39.244975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:39.244975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:39.244975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:39.244975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:39.244975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:39.245824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.245824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:39.245824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.245824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:39.245824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:39.245824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:39.245824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:39.245824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:39.245824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.245824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:39.245824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:39.245824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.245824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:39.245824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:39.245824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:39.246743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:39.247901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:39.247901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:39.247901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:39.247901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:39.247901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.247901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:39.293097 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:39.293412 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:39.293555 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:39.293815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:28:39.294615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:39.294896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.295786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:39.295786 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:39.295786 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:39.295786 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:39.295786 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:39.295786 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:39.295786 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.295786 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:39.296682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.296682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:39.296682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:39.296682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:39.296682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.296682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:39.296682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:39.296682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:39.296682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.296682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:39.296682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:39.296682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:39.296682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:39.296682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:39.296682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:39.297948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:39.297948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:39.297948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:39.297948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:39.297948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:39.297948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:39.297948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:39.297948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.297948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:39.297948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.297948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:39.297948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:39.297948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:39.297948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.298566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:39.298566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:39.298566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:28:39.298566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:39.298566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:39.298566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.298566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:39.298566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:39.298566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:39.298566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.298566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:39.298566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:39.298566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:39.298992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:39.298992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:39.298992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:39.298992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:39.298992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:39.298992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:39.298992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:39.298992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:39.298992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:39.298992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:39.298992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.298992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:39.299609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.299609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:39.299609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:39.299609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:39.299609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:39.299609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:39.299609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.299609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:39.299609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:39.299609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.299609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:39.299609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:39.299609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.299609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:39.299609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:39.299609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:39.300189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:39.300830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:39.300830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:39.300830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:39.300830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:39.300830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:39.300830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.300830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:39.305669 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:39.305942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:39.306085 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:39.306235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:39.306722 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:39.307056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.307700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:39.307700 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:39.307700 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:39.307700 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:39.307700 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:39.307700 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:39.307700 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.307700 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:39.308550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.308550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:39.308550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:39.308550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:39.308550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.308550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:39.308550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:39.308550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:39.308550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.308550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:39.308550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:39.308550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:39.308550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:39.308550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:39.308550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:39.309100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:39.309100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:39.309100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:39.309100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:39.309100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:39.309100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:39.309100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:39.309100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.309100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:39.309540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.309540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:39.309540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:39.309540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:39.309540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.309540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:39.309540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:39.309540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:39.309540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:39.309540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.309540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:39.310065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:39.310065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:39.310065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.310065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:39.310065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:39.310065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:39.310065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:39.310065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:39.310065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:39.310065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:39.310065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:39.310065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:39.310065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:39.310065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:39.310629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:39.310629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:39.310629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.310629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.310783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:39.311457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:39.312170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:39.312170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:39.312170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.312170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:39.312170 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:39.312440 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:39.312572 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:39.312750 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:39.313184 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:39.313510 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:39.313764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.314383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:39.314383 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:39.314383 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:39.314383 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:39.314383 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:39.314383 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:39.314383 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.314383 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:39.315387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.315387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:39.315387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:39.315387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:39.315387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.315387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:39.315387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:39.315387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.315387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:39.315387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:39.315387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:39.315387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.315781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:39.315781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:39.315781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:39.315781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:39.315781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:39.315781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:39.315781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:39.315781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:39.315781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:39.315781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:39.315781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:39.315781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:39.315781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:39.316210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.316210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:39.316526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.316526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:39.316526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:39.316526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:39.316526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:39.316526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:39.316526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.316526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:39.316526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:39.316526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.316526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:39.316526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:39.316526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.316526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:39.316526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:39.316526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:39.317174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:39.317849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:39.317849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:39.317849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:43.778621 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:43.779228 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:43.779455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:43.780665 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:43.820804 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:43.821010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:43.821687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:43.821687 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:43.821687 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:43.821687 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:43.821687 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:43.821687 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:43.821687 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:43.821687 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:43.822708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:43.822708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:43.822708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:43.822708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:43.822708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:43.822708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:43.822708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:43.822708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:43.822708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:43.822708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:43.822708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:43.822708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:43.823028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:43.823028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:43.823028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:43.823028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:43.823028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:43.823028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:43.823028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:43.823028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:43.823028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:43.823028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:43.823028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:43.823028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:43.823028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:43.823334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:43.823334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:43.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:43.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:43.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:43.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:43.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:43.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:43.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:43.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:43.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:43.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:43.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:43.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:43.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:43.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:43.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:43.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:43.824222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:43.824605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:43.824605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:43.824605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:44.241338 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:44.241751 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:44.241952 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:44.242933 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:44.243210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:44.243486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.247404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:44.247404 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:44.247404 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:44.247404 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:44.247404 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:44.247404 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:44.247404 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.247404 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:44.247404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.247404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:44.247404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:44.247404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:44.247404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.247404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:44.247404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:44.247860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.247860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:44.247860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:44.247860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:44.247860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.247860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:44.247860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:44.247860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:44.247860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:44.247860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:44.247860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:44.247860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:44.247860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:44.247860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:44.248250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:44.248250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:44.248250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:44.248250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:44.248250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.248250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:44.248250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.248250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:44.248250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:44.248250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:44.248250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:44.248250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:44.248250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.248250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:44.248621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:44.249175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:44.249175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:44.249175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:44.249175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:44.249175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:44.249175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:44.249175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:44.249175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:44.249175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.249175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:44.293757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:44.294410 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:44.294725 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:44.295064 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:28:44.295610 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:44.295827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.296613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:44.296613 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:44.296613 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:44.296613 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:44.296613 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:44.296613 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:44.296613 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.296613 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:44.298151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.298151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:44.298151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:44.298151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:44.298151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.298151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:44.298151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:44.298151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:44.298151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.298151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:44.298151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:44.298151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:44.298151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:44.298151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:44.298151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:44.298857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:44.298857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:44.298857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:44.298857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:44.298857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:44.298857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:44.298857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:44.298857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.298857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:44.299671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.299671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:44.299671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:44.299671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:44.299671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.299671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:44.299671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:44.299671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:28:44.299671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:44.299671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:44.299671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.299671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:44.300030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:44.300030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:44.300030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.300030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:44.300030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:44.300030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:44.300030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:44.300030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:44.300030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:44.300030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:44.300030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:44.300030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:44.300030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:44.300030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:44.300453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:44.300453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:44.300453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.300453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:44.301386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.301386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:44.301386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:44.301386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:44.301386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:44.301386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:44.301386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.301386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:44.301386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:44.301386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.301386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:44.301386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:44.301386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.301386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:44.301386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:44.301386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:44.301881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:44.302433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:44.302433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:44.302433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:44.302433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:44.302433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:44.302433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.302433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:44.306212 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:44.306645 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:44.306742 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:44.306956 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:44.307386 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:44.307677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:44.308219 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:44.308219 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:44.308219 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:44.308219 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:44.308219 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:44.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.308219 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:44.309035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.309035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:44.309035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:44.309035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:44.309035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.309035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:44.309035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:44.309035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:44.309035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.309035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:44.309035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:44.309035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:44.309035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:44.309035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:44.309035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:44.309889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:44.309889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:44.309889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:44.309889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:44.309889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:44.309889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:44.309889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:44.309889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.309889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:44.310394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.310394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:44.310394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:44.310394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:44.310394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.310394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:44.310394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:44.310394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:44.310394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:44.310394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.310394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:44.311059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:44.311059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:44.311059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.311059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:44.311059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:44.311059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:44.311059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:44.311059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:44.311059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:44.311059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:44.311059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:44.311059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:44.311059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:44.311059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:44.311600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:44.311600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:44.311600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.311600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:44.311600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.311600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:44.311600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:44.311600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:44.311600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:44.311600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:44.311600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.311600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:44.311600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:44.311600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:44.311993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:44.312520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:44.312520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:44.312520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:44.312520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:44.312520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:44.312520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:44.312520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:44.312520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:44.312520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:44.312520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.312520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:44.312815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:44.312868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:44.312994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:44.313154 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:44.313535 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:44.313796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:44.313984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.314616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:44.314616 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:44.314616 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:44.314616 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:44.314616 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:44.314616 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:44.314616 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.314616 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:44.315609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.315609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:44.315609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:44.315609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:44.315609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.315609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:44.315609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:44.315609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.315609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:44.315609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:44.315609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:44.315609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.315967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:44.315967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:44.315967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:44.315967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:44.315967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:44.315967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:44.315967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:44.315967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:44.315967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:44.315967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:44.315967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:44.315967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:44.315967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:44.316434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.316434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:44.316637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.316637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:44.316637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:44.316637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:44.316637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:44.316637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:44.316637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.316637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:44.316637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:44.316637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.316637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:44.316637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:44.316637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.316637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:44.316637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:44.316637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:44.317074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:44.317597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:44.317597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:44.317597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:48.779324 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:48.780102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:48.780102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:48.780676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:48.818582 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:48.818582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:48.818582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:48.818582 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:48.818582 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:48.818582 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:48.818582 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:48.818582 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:48.818582 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:48.818582 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:48.819590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:48.819590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:48.819590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:48.819590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:48.819590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:48.819590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:48.819590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:48.819590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:48.819590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:48.819590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:48.819590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:48.819590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:48.820709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:48.820709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:48.820709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:48.820709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:48.820709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:48.820709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:48.820709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:48.820709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:48.820709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:48.820709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:48.820709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:48.820709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:48.820709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:48.822698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:48.822698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:48.822698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:48.822698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:48.822698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:48.822698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:48.822698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:48.822698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:48.822698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:48.822698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:48.822698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:48.822698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:48.822698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:48.822698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:48.822698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:48.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:48.825323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:48.825323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:48.825323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:48.825323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:48.825323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:48.825323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:49.242697 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:49.244287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:49.244287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:49.244481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:49.244779 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:49.244953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.245795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:49.245795 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:49.245795 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:49.245795 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:49.245795 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:49.245795 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:49.245795 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.245795 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:49.247945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.247945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:49.247945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:49.247945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:49.247945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.247945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:49.247945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:49.247945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.247945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:49.247945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:49.247945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:49.247945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.248354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:49.248354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:49.248354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:49.248354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:49.248354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:49.248354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:49.248354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:49.248354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:49.248354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:49.248354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:49.248354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:49.248354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:49.248354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:49.248824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.248824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:49.250188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.250188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:49.250188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:49.250188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:49.250188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:49.250188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:49.250188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.250188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:49.250188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:49.250188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.250188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:49.250188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:49.250188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.250188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:49.250188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:49.250188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:49.250754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:49.251828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:49.251828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.251828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:49.294606 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:49.295768 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:49.295970 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:49.296157 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:28:49.299831 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:49.300163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.301018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:49.301018 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:49.301018 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:49.301018 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:49.301018 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:49.301018 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:49.301018 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.301018 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:49.301935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.301935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:49.301935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:49.301935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:49.301935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.301935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:49.301935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:49.301935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:49.301935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.301935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:49.301935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:49.301935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:49.301935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:49.301935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:49.301935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:49.302485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:49.302485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:49.302485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:49.302485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:49.302485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:49.302485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:49.302485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:49.302485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.302485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:49.302833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.006 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.302833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:49.302833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:49.302833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:49.302833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.302833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:49.302833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:49.302833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:28:49.302833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:49.302833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:49.302833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.302833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:49.303160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:49.303160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:49.303160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.303160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:49.303160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:49.303160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:49.303160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:49.303160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:49.303160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:49.303160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:49.303160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:49.303160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:49.303160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:49.303160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:49.303578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:49.303578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:49.303578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.303578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:49.303948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.303948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:49.303948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:49.303948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:49.303948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:49.303948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:49.303948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.303948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:49.303948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:49.303948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.303948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:49.303948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:49.303948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.303948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:49.303948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:49.303948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:49.304402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:49.304917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:49.304917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:49.304917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:49.304917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:49.304917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:49.304917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.304917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:49.306821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:49.307271 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:49.307425 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:49.307575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:49.307923 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:49.308154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.308725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:49.308725 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:49.308725 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:49.308725 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:49.308725 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:49.308725 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:49.308725 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.308725 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:49.309656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.309656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:49.309656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:49.309656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:49.309656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.309656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:49.309656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:49.309656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:49.309656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.309656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:49.309656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:49.309656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:49.309656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:49.309656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:49.309656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:49.310327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:49.310327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:49.310327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:49.310327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:49.310327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:49.310327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:49.310327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:49.310327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.310327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:49.310748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.310748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:49.310748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:49.310748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:49.310748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.310748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:49.310748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:49.310748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:49.310748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:49.310748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.310748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:49.311238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:49.311238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:49.311238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.311238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:49.311238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:49.311238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:49.311238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:49.311238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:49.311238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:49.311238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:49.311238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:49.311238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:49.311238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:49.311238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:49.311867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:49.311867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:49.311867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.311867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.312120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:49.312877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:49.313722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:49.313722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:49.313722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.313722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:49.313722 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:49.313722 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:49.313722 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:49.313722 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:49.314475 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:49.314657 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:49.314932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.315733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:49.315733 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:49.315733 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:49.315733 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:49.315733 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:49.315733 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:49.315733 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.315733 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:49.316946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.316946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:49.316946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:49.316946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:49.316946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.316946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:49.316946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:49.316946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.316946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:49.316946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:49.316946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:49.316946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.317646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:49.317646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:49.317646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:49.317646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:49.317646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:49.317646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:49.317646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:49.317646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:49.317646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:49.317646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:49.317646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:49.317646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:49.317646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:49.318193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.318193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:49.318300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.318300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:49.318300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:49.318300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:49.318300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:49.318300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:49.318300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.318300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:49.318300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:49.318300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.318300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:49.318300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:49.318300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.318300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:49.318300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:49.318300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:49.318946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:49.319893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:49.319893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:49.319893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:53.779802 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:53.780412 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:53.780412 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:53.781465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:53.796458 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=244 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:28:53.815799 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:53.816215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:53.817108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:53.817108 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:53.817108 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:53.817108 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:53.817108 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:53.817108 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:53.817108 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:53.817108 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:53.818088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:53.818088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:53.818088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:53.818088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:53.818088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:53.818088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:53.818088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:53.818088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:53.818088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:53.818088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:53.818088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:53.818088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:53.818489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:53.818489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:53.818489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:53.818489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:53.818489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:53.818489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:53.818489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:53.818489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:53.818489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:53.818489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:53.818489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:53.818489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:53.818489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:53.818853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:53.818853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:53.818853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:53.818853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:53.818853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:53.818853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:53.818853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:53.818853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:53.818853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:53.818853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:53.818853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:53.818853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:53.818853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:53.818853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:53.818853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:53.819243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:53.819660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:53.819660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:53.819660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:53.819660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:53.819660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:53.819660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:54.243162 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:54.243699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:54.243904 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:54.245315 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:54.245778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:54.246048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.247333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:54.247333 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:54.247333 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:54.247333 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:54.247333 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:54.247333 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:54.247333 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.247333 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:54.249101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.249101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:54.249101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:54.249101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:54.249101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.249101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:54.249101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:54.249101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.249101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:54.249101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:54.249101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:54.249101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.249842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:54.249842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:54.249842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:54.249842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:54.249842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:54.249842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:54.249842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:54.249842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:54.249842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:54.249842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:54.249842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:54.249842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:54.249842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:54.250480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.250480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:54.251610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.251610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:54.251610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:54.251610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:54.251610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:54.251610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:54.251610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.251610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:54.251610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:54.251610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.251610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:54.251610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:54.251610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.251610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:54.251610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:54.251610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:54.252328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:54.253214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:54.253214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.253214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:54.295421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:54.295903 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:54.295991 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:54.296098 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:28:54.297351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:54.297790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.298859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:54.298859 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:54.298859 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:54.298859 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:54.298859 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:54.298859 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:54.298859 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.298859 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:54.300098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.300098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:54.300098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:54.300098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:54.300098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.300098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:54.300098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:54.300098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:54.300098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.300098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:54.300098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:54.300098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:54.300098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:54.300098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:54.300098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:54.300680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:54.300680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:54.300680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:54.300680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:54.300680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:54.300680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:54.300680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:54.300680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.300680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:54.302010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.302010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:54.302010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:54.302010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:54.302010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.302010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:54.302010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:54.302010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:28:54.302010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:54.302010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:54.302010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.302010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:54.302479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:54.302479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:54.302479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.302479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:54.302479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:54.302479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:54.302479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:54.302479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:54.302479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:54.302479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:54.302479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:54.302479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:54.302479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:54.302479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:54.302894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:54.302894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:54.302894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.302894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:54.304167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.304167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:54.304167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:54.304167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:54.304167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:54.304167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:54.304167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.304167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:54.304167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:54.304167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.304167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:54.304167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:54.304167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.304167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:54.304167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:54.304167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:54.304654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:54.305298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:54.305298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:54.305298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:54.305298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:54.305298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:54.305298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.305298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:54.307250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:54.307613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:54.307754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:54.308025 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:54.308809 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:54.309175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.310001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:54.310001 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:54.310001 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:54.310001 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:54.310001 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:54.310001 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:54.310001 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.310001 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:54.310986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.310986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:54.310986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:54.310986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:54.310986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.310986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:54.310986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:54.310986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:54.310986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.310986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:54.310986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:54.310986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:54.310986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:54.310986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:54.310986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:54.311459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:54.311459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:54.311459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:54.311459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:54.311459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:54.311459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:54.311459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:54.311459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.311459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:54.311891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.311891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:54.311891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:54.311891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:54.311891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.311891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:54.311891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:54.311891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:54.311891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:54.311891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.311891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:54.312235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:54.312235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:54.312235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.312235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:54.312235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:54.312235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:54.312235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:54.312235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:54.312235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:54.312235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:54.312235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:54.312235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:54.312235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:54.312235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:54.312744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:54.312744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:54.312744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.312744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.312970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:54.313512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:54.314074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:54.314074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:54.314074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.314074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:54.314074 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:54.314074 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:54.314074 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:54.314074 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:54.314640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:54.314925 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:54.315131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.315830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:54.315830 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:54.315830 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:54.315830 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:54.315830 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:54.315830 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:54.315830 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.315830 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:54.316713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.316713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:54.316713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:54.316713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:54.316713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.316713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:54.316713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:54.316713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.316713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:54.316713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:54.316713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:54.316713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.317090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:54.317090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:54.317090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:54.317090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:54.317090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:54.317090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:54.317090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:54.317090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:54.317090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:54.317090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:54.317090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:54.317090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:54.317090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:54.317618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.317618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:54.317695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.317695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:54.317695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:54.317695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:54.317695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:54.317695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:54.317695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.317695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:54.317695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:54.317695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.317695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:54.317695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:54.317695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.317695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:54.317695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:54.317695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:54.318260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:54.318894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:54.318894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:54.318894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:58.780680 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:58.781779 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:58.781779 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:58.782530 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:58.820764 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:58.821056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:58.821860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:58.821860 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:58.821860 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:58.821860 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:58.821860 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:58.821860 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:58.821860 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:58.821860 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:58.822785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:58.822785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:58.822785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:58.822785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:58.822785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:58.822785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:58.822785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:58.822785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:58.822785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:58.822785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:58.822785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:58.822785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:58.823493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:58.823493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:58.823493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:58.823493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:58.823493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:58.823493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:58.823493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:58.823493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:58.823493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:58.823493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:58.823493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:58.823493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:58.823493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:58.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:58.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:58.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:58.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:58.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:58.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:58.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:58.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:58.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:58.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:58.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:58.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:58.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:58.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:58.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:58.825229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:58.826066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:58.826066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:58.826066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:58.826066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:58.826066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:58.826066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:59.243852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:59.244556 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:59.244699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:59.245978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:59.246974 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:59.248170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.248269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:59.248269 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:59.248269 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:59.248269 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:59.248269 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:59.248269 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:59.248269 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.248269 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:59.249927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.249927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:59.249927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:59.249927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:59.249927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.249927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:59.249927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:59.249927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.249927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:59.249927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:59.249927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:59.249927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.250971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:59.250971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:59.250971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:59.250971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:59.250971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:59.250971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:59.250971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:59.250971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:59.250971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:59.250971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:59.250971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:59.250971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:59.250971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:59.251484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.251484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:59.251886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.251886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:59.251886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:59.251886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:59.251886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:59.251886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:59.251886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.251886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:59.251886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:59.251886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.251886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:59.251886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:59.251886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.251886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:59.251886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:59.251886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:59.252469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:59.253058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:59.253058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.253058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:59.296174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:59.296971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:59.297092 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:59.297244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:28:59.297979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:59.298225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.299019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:59.299019 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:59.299019 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:59.299019 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:59.299019 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:59.299019 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:59.299019 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.299019 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:59.299898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.299898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:59.299898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:59.299898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:59.299898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.299898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:59.299898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:59.299898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:59.299898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.299898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:59.299898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:59.299898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:59.299898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:59.299898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:59.299898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:59.300653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:59.300653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:59.300653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:59.300653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:59.300653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:59.300653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:59.300653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:59.300653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.300653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:59.301288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.301288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:59.301288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:59.301288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:59.301288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.301288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:59.301288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:59.301288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:28:59.301288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:59.301288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:59.301288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.301288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:59.301880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:59.301880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:59.301880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.301880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:59.301880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:59.301880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:59.301880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:59.301880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:59.301880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:59.301880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:59.301880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:59.301880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:59.301880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:59.301880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:59.302545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:59.302545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:59.302545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.302545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:59.303351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.303351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:59.303351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:59.303351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:59.303351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:59.303351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:59.303351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.303351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:59.303351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:59.303351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.303351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:59.303351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:59.303351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.303351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:59.303351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:59.303351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:59.304530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:59.305116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:59.305116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:59.305116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:59.305116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:59.305116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:59.305116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.305116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:59.307780 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:59.308428 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:59.308569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:59.308738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:59.309419 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:59.309740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.310605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:59.310605 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:59.310605 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:59.310605 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:59.310605 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:59.310605 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:59.310605 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.310605 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:59.311831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.311831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:28:59.311831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:59.311831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:59.311831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.311831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:59.311831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:59.311831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:59.311831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.311831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:28:59.311831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:59.311831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:28:59.311831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:59.311831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:28:59.311831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:28:59.312310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:59.312310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:28:59.312310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:59.312310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:28:59.312310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:28:59.312310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:59.312310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:28:59.312310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.312310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:28:59.313115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.313115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:59.313115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:59.313115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:59.313115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.313115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:59.313115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:59.313115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:59.313115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:59.313115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.313115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:59.313464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:59.313464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:59.313464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.313464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:59.313464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:59.313464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:59.313464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:59.313464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:59.313464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:59.313464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:59.313464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:59.313464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:59.313464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:59.313464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:59.313840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:59.313840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:59.313840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.313840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.314357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:59.315189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:59.316016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:59.316016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:59.316016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.316016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:28:59.316016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:28:59.316016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:28:59.316016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:28:59.316016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:28:59.316437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:59.316935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:28:59.317099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.317802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:28:59.317802 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:59.317802 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:28:59.317802 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:28:59.317802 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:59.317802 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:28:59.317802 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.317802 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:28:59.318798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.318798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:28:59.318798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:59.318798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:28:59.318798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.318798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:59.318798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:59.318798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.318798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:59.318798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:59.318798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:59.318798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.319244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:28:59.319244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:59.319244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:28:59.319244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:59.319244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:28:59.319244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:28:59.319244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:59.319244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:28:59.319244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:59.319244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:28:59.319244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:28:59.319244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:59.319244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:28:59.320038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.320038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:28:59.320038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.320038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:28:59.320038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:28:59.320038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:28:59.320038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:28:59.320038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:28:59.320038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.320038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:28:59.320038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:28:59.320038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.320038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:28:59.320038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:28:59.320038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:28:59.320676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:28:59.321353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:28:59.321353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:28:59.321353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:28:59.321353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:28:59.321353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:28:59.321353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:03.781301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:03.782062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:03.782318 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:03.784031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:03.818935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:03.819904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:03.819904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:03.819904 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:03.819904 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:03.819904 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:03.819904 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:03.819904 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:03.819904 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:03.819904 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:03.820682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:03.820682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:03.820682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:03.820682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:03.820682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:03.820682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:03.820682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:03.820682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:03.820682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:03.820682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:03.820682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:03.820682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:03.821094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:03.821094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:03.821094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:03.821094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:03.821094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:03.821094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:03.821094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:03.821094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:03.821094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:03.821094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:03.821094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:03.821094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:03.821094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:03.821545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:03.821545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:03.821545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:03.821545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:03.821545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:03.821545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:03.821545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:03.821545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:03.821545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:03.821545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:03.821545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:03.821545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:03.821545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:03.821545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:03.821545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:03.822167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:03.822760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:03.822760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:03.822760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:03.822760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:03.822760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:03.822760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:04.247874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:04.247874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:04.247874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:04.247874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:04.248275 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:04.248530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.249342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:04.249342 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:04.249342 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:04.249342 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:04.249342 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:04.249342 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:04.249342 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.249342 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:04.250909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.250909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:04.250909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:04.250909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:04.250909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.250909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:04.250909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:04.250909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.250909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:04.250909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:04.250909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:04.250909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.251223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:04.251223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:04.251223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:04.251223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:04.251223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:04.251223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:04.251223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:04.251223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:04.251223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:04.251223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:04.251223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:04.251223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:04.251223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:04.251494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.251494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:04.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:04.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:04.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:04.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:04.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:04.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:04.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:04.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:04.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:04.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:04.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:04.252620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:04.252988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:04.253360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:04.253360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.253360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:04.296732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:04.297269 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:04.297462 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:04.297630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:29:04.298082 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:04.298275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.298768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:04.298768 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:04.298768 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:04.298768 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:04.298768 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:04.298768 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:04.298768 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.298768 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:04.299652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.299652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:04.299652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:04.299652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:04.299652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.299652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:04.299652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:04.299652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:04.299652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.299652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:04.299652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:04.299652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:04.299652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:04.299652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:04.299652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:04.300159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:04.300159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:04.300159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:04.300159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:04.300159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:04.300159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:04.300159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:04.300159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.300159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:04.300812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.300812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:04.300812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:04.300812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:04.300812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.300812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:04.300812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:04.300812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:29:04.300812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:04.300812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:04.300812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.300812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:04.301205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:04.301205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:04.301205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.301205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:04.301205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:04.301205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:04.301205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:04.301205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:04.301205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:04.301205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:04.301205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:04.301205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:04.301205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:04.301205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:04.301623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:04.301623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:04.301623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.301623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:04.302301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.302301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:04.302301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:04.302301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:04.302301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:04.302301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:04.302301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.302301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:04.302301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:04.302301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.302301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:04.302301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:04.302301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.302301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:04.302301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:04.302301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:04.302776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:04.303230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:04.303230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:04.303230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:04.303230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:04.303230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:04.303230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.303230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:04.308352 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:04.308815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:04.309056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:04.309272 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:04.309861 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:04.310129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.310921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:04.310921 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:04.310921 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:04.310921 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:04.310921 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:04.310921 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:04.310921 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.310921 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:04.312535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.312535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:04.312535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:04.312535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:04.312535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.312535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:04.312535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:04.312535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:04.312535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.312535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:04.312535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:04.312535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:04.312535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:04.312535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:04.312535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:04.313234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:04.313234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:04.313234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:04.313234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:04.313234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:04.313234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:04.313234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:04.313234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.313234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:04.314651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.314651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:04.314651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:04.314651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:04.314651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.314651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:04.314651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:04.314651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:04.314651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:04.314651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.314651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:04.315197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:04.315197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:04.315197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.315197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:04.315197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:04.315197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:04.315197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:04.315197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:04.315197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:04.315197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:04.315197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:04.315197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:04.315197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:04.315197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:04.315788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:04.315788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:04.315788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.315788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:04.315788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.315788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:04.315788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:04.315788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:04.315788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:04.315788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:04.315788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.315788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:04.315788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:04.315788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:04.316422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:04.317221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:04.317221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:04.317221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:04.317221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:04.317221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:04.317221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:04.317221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:04.317221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:04.317221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:04.317221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.317221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:04.317221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:04.317221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:04.317780 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:04.317780 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:04.317780 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:04.317780 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:04.317780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.318127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:04.318127 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:04.318127 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:04.318127 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:04.318127 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:04.318127 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:04.318127 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.318127 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:04.318765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.318765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:04.318765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:04.318765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:04.318765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.318765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:04.318765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:04.318765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.318765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:04.318765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:04.318765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:04.318765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.319119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:04.319119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:04.319119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:04.319119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:04.319119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:04.319119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:04.319119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:04.319119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:04.319119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:04.319119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:04.319119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:04.319119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:04.319119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:04.319458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.319458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:04.319837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.319837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:04.319837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:04.319837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:04.319837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:04.319837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:04.319837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.319837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:04.319837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:04.319837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.319837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:04.319837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:04.319837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.319837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:04.319837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:04.319837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:04.320264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:04.320792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:04.320792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:04.320792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:08.782079 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:08.782688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:08.782688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:08.783197 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:08.820631 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:08.820631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:08.821508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:08.821508 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:08.821508 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:08.821508 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:08.821508 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:08.821508 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:08.821508 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:08.821508 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:08.822260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:08.822260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:08.822260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:08.822260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:08.822260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:08.822260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:08.822260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:08.822260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:08.822260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:08.822260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:08.822260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:08.822260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:08.822710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:08.822710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:08.822710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:08.822710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:08.822710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:08.822710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:08.822710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:08.822710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:08.822710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:08.822710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:08.822710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:08.822710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:08.822710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:08.823102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:08.823102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:08.823389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:08.823389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:08.823389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:08.823389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:08.823389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:08.823389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:08.823389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:08.823389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:08.823389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:08.823389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:08.823389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:08.823389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:08.823389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:08.823389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:08.823389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:08.823389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:08.823909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:08.824466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:08.824466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:08.824466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:09.246239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:09.246817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:09.247016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:09.248307 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:09.248640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:09.248964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.249819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:09.249819 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:09.249819 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:09.249819 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:09.249819 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:09.249819 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:09.249819 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.249819 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:09.250977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.250977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:09.250977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:09.250977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:09.250977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.250977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:09.250977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:09.250977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.250977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:09.250977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:09.250977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:09.250977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.251957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:09.251957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:09.251957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:09.251957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:09.251957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:09.251957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:09.251957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:09.251957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:09.251957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:09.251957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:09.251957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:09.251957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:09.251957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:09.252824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.252824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:09.252824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.252824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:09.252824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:09.252824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:09.252824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:09.252824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:09.252824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.252824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:09.252824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:09.252824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.252824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:09.252824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:09.252824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:09.253435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:09.254182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:09.254182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:09.254182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:09.254182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:09.254182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.254182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:09.297230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:09.297824 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:09.298196 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:09.298392 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:29:09.299201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:09.299540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.300476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:09.300476 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:09.300476 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:09.300476 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:09.300476 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:09.300476 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:09.300476 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.300476 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:09.301564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.301564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:09.301564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:09.301564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:09.301564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.301564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:09.301564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:09.301564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:09.301564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.301564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:09.301564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:09.301564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:09.301564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:09.301564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:09.301564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:09.302043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:09.302043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:09.302043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:09.302043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:09.302043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:09.302043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:09.302043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:09.302043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.302043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:09.302524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.302524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:09.302524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:09.302524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:09.302524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.302524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:09.302524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:09.302524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:29:09.302524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:09.302524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:09.302524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.302524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:09.302916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:09.302916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:09.302916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.302916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:09.302916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:09.302916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:09.302916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:09.302916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:09.302916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:09.302916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:09.302916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:09.302916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:09.302916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:09.302916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:09.303327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:09.303327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:09.303327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.303327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:09.303910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.303910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:09.303910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:09.303910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:09.303910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:09.303910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:09.303910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.303910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:09.303910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:09.303910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.303910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:09.303910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:09.303910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.303910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:09.303910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:09.303910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:09.304423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:09.304966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:09.304966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:09.304966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:09.304966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:09.304966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:09.304966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.304966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:09.311536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:09.311536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:09.311536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:09.311536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:09.311536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:09.311536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.311881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:09.312406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:09.312406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:09.312406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:09.312406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:09.312406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:09.312406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:09.312406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:09.312406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:09.312406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:09.312406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:09.312406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:09.312406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:09.312406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.312406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:09.312759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.312759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:09.312759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:09.312759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:09.312759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.312759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:09.312759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:09.312759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:09.312759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:09.312759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.312759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:09.313084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:09.313084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:09.313084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.313084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:09.313084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:09.313084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:09.313084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:09.313084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:09.313084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:09.313084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:09.313084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:09.313084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:09.313084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:09.313084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:09.313482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:09.313482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:09.313482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.313482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.313754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:09.314216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:09.314768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:09.314768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:09.314768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.314768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:09.316603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:09.316904 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:09.317086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:09.317238 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:09.317639 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:09.317826 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:09.318035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.318616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:09.318616 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:09.318616 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:09.318616 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:09.318616 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:09.318616 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:09.318616 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.318616 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:09.319559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.319559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:09.319559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:09.319559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:09.319559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.319559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:09.319559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:09.319559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.319559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:09.319559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:09.319559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:09.319559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.320108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:09.320108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:09.320108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:09.320108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:09.320108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:09.320108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:09.320108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:09.320108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:09.320108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:09.320108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:09.320108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:09.320108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:09.320108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:09.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:09.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:09.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:09.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:09.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:09.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:09.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:09.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:09.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:09.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:09.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:09.321809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:09.322778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:09.322778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:09.322778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:09.322778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:09.322778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:09.322778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:13.782585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:13.783503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:13.783768 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:13.785128 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:13.819783 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:13.820139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:13.820992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:13.820992 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:13.820992 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:13.820992 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:13.820992 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:13.820992 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:13.820992 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:13.820992 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:13.822203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:13.822203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:13.822203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:13.822203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:13.822203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:13.822203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:13.822203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:13.822203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:13.822203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:13.822203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:13.822203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:13.822203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:13.823027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:13.823027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:13.823027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:13.823027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:13.823027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:13.823027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:13.823027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:13.823027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:13.823027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:13.823027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:13.823027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:13.823027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:13.823027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:13.823846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:13.823846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:13.823846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:13.823846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:13.823846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:13.823846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:13.823846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:13.823846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:13.823846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:13.823846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:13.823846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:13.823846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:13.823846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:13.823846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:13.823846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:13.824457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:13.825026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:13.825026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:13.825026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:13.825026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:13.825026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:13.825026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:14.246740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:14.247568 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:14.247871 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:14.249137 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:14.249451 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:14.249644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.250519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:14.250519 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:14.250519 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:14.250519 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:14.250519 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:14.250519 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:14.250519 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.250519 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:14.252673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.252673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:14.252673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:14.252673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:14.252673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.252673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:14.252673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:14.252673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.252673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:14.252673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:14.252673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:14.252673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.253274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:14.253274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:14.253274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:14.253274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:14.253274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:14.253274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:14.253274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:14.253274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:14.253274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:14.253274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:14.253274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:14.253274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:14.253274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:14.253975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.253975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:14.254188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.254188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:14.254188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:14.254188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:14.254188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:14.254188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:14.254188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.254188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:14.254188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:14.254188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.254188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:14.254188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:14.254188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.254188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:14.254188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:14.254188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:14.255000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:14.255966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:14.255966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.255966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:14.297870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:14.298384 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:14.298490 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:14.298637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:29:14.300316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:14.300626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.301322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:14.301322 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:14.301322 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:14.301322 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:14.301322 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:14.301322 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:14.301322 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.301322 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:14.302303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.302303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:14.302303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:14.302303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:14.302303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.302303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:14.302303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:14.302303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:14.302303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.302303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:14.302303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:14.302303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:14.302303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:14.302303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:14.302303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:14.303062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:14.303062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:14.303062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:14.303062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:14.303062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:14.303062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:14.303062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:14.303062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.303062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:14.303528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.303528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:14.303528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:14.303528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:14.303528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.303528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:14.303528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:14.303528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:29:14.303528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:14.303528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:14.303528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.303528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:14.304153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:14.304153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:14.304153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.304153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:14.304153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:14.304153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:14.304153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:14.304153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:14.304153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:14.304153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:14.304153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:14.304153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:14.304153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:14.304153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:14.304835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:14.304835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:14.304835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.304835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:14.304835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.304835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:14.304835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:14.304835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:14.304835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:14.304835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:14.304835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.304835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:14.304835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:14.304835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:14.306027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:14.307040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:14.307040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:14.307040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:14.307040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:14.307040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:14.307040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:14.307040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:14.307040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:14.307040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:14.307040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:14.307040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.307040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:14.309307 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:14.309607 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:14.309721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:14.309852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:14.310285 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:14.310582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.311144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:14.311144 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:14.311144 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:14.311144 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:14.311144 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:14.311144 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:14.311144 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.311144 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:14.312029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.312029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:14.312029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:14.312029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:14.312029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.312029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:14.312029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:14.312029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:14.312029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.312029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:14.312029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:14.312029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:14.312029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:14.312029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:14.312029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:14.312446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:14.312446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:14.312446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:14.312446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:14.312446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:14.312446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:14.312446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:14.312446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.312446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:14.313070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.313070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:14.313070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:14.313070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:14.313070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.313070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:14.313070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:14.313070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:14.313070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:14.313070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.313070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:14.313393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:14.313393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:14.313393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.313393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:14.313393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:14.313393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:14.313393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:14.313393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:14.313393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:14.313393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:14.313393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:14.313393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:14.313393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:14.313393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:14.313806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:14.313806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:14.313806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.313806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.314185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:14.314698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:14.315217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:14.315217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:14.315217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.315217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:14.316928 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:14.317185 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:14.317297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:14.317511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:14.317928 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:14.318224 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:14.318446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.319039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:14.319039 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:14.319039 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:14.319039 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:14.319039 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:14.319039 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:14.319039 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.319039 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:14.319912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.319912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:14.319912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:14.319912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:14.319912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.319912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:14.319912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:14.319912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.319912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:14.319912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:14.319912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:14.319912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.320236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:14.320236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:14.320236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:14.320236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:14.320236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:14.320236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:14.320236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:14.320236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:14.320236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:14.320236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:14.320236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:14.320236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:14.320236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:14.320619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.320619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:14.320922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.320922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:14.320922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:14.320922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:14.320922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:14.320922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:14.320922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.320922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:14.320922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:14.320922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.320922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:14.320922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:14.320922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.320922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:14.320922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:14.320922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:14.321344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:14.321880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:14.321880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:14.321880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:18.783631 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:18.784693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:18.784693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:18.786145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:18.827165 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:18.827477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:18.828188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:18.828188 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:18.828188 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:18.828188 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:18.828188 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:18.828188 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:18.828188 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:18.828188 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:18.828998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.044 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:18.828998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:18.828998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:18.828998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:18.828998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:18.828998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:18.828998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:18.828998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:18.828998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:18.828998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:18.828998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:18.828998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:18.829766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:18.829766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:18.829766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:18.829766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:18.829766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:18.829766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:18.829766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:18.829766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:18.829766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:18.829766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:18.829766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:18.829766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:18.829766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:18.830541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:18.830541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:18.830541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:18.830541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:18.830541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:18.830541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:18.830541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:18.830541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:18.830541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:18.830541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:18.830541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:18.830541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:18.830541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:18.830541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:18.830541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:18.831334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:18.832361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:18.832361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:18.832361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:18.832361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:18.832361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:18.832361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:19.249987 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:19.250579 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:19.250579 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:19.251276 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:19.251433 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:19.251581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.252232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:19.252232 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:19.252232 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:19.252232 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:19.252232 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:19.252232 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:19.252232 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.252232 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:19.253543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.253543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:19.253543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:19.253543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:19.253543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.253543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:19.253543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:19.253543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.253543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:19.253543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:19.253543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:19.253543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.253983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:19.253983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:19.253983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:19.253983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:19.253983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:19.253983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:19.253983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:19.253983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:19.253983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:19.253983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:19.253983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:19.253983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:19.253983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:19.254412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.254412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:19.255266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.255266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:19.255266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:19.255266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:19.255266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:19.255266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:19.255266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.255266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:19.255266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:19.255266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.255266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:19.255266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:19.255266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.255266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:19.255266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:19.255266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:19.256014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:19.257161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:19.257161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.257161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:19.298700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:19.299239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:19.299457 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:19.299868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:29:19.300428 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:19.300794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.301723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:19.301723 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:19.301723 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:19.301723 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:19.301723 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:19.301723 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:19.301723 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.301723 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:19.303054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.303054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:19.303054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:19.303054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:19.303054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.303054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:19.303054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:19.303054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:19.303054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.303054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:19.303054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:19.303054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:19.303054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:19.303054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:19.303054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:19.303643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:19.303643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:19.303643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:19.303643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:19.303643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:19.303643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:19.303643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:19.303643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.303643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:19.304502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.304502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:19.304502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:19.304502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:19.304502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.304502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:19.304502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:19.304502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:29:19.304502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:19.304502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:19.304502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.304502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:19.304885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:19.304885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:19.304885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.304885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:19.304885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:19.304885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:19.304885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:19.304885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:19.304885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:19.304885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:19.304885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:19.304885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:19.304885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:19.304885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:19.305260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:19.305260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:19.305260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.305260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:19.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:19.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:19.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:19.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:19.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:19.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:19.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:19.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:19.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:19.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:19.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:19.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:19.306778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:19.307404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:19.307404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:19.307404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:19.307404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:19.307404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:19.307404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.307404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:19.309873 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:19.310317 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:19.310565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:19.311204 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:19.313036 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:19.313315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.313971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:19.313971 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:19.313971 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:19.313971 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:19.313971 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:19.313971 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:19.313971 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.313971 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:19.315533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.315533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:19.315533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:19.315533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:19.315533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.315533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:19.315533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:19.315533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:19.315533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.315533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:19.315533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:19.315533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:19.315533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:19.315533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:19.315533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:19.316534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:19.316534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:19.316534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:19.316534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:19.316534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:19.316534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:19.316534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:19.316534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.316534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:19.316534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.316534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:19.316534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:19.316534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:19.316534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.317525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:19.317525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:19.317525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:19.317525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:19.317525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.317525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:19.317525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:19.317525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:19.317525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.317525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:19.317525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:19.317525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:19.317525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:19.318273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:19.318273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:19.318273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:19.318273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:19.318273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:19.318273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:19.318273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:19.318273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:19.318273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:19.318273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.318273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:19.318273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:19.319125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.320132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:19.321023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:19.321023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:19.321023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:19.321023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:19.321023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:19.321023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:19.321275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.321275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:19.321275 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:19.321275 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:19.321275 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:19.321275 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:19.321275 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:19.321275 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.321275 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:19.321275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.321275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:19.321275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:19.321275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:19.321275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.321275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:19.321845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:19.321845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.321845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:19.321845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:19.321845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:19.321845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.321845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:19.321845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:19.321845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:19.321845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:19.321845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:19.321845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:19.321845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:19.321845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:19.322279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:19.322279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:19.322279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:19.322279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:19.322279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:19.322279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.322279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:19.322279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.322279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:19.322279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:19.322279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:19.322279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:19.322279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:19.322756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:19.323133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:19.323133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:19.323133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:19.323133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:19.323133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:19.323133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:19.323133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:19.323133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:19.323133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:19.323133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:19.323133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:19.323133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:23.785418 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:23.785951 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:23.785951 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:23.786477 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:23.817466 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:23.817978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:23.818756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:23.818756 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:23.818756 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:23.818756 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:23.818756 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:23.818756 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:23.818756 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:23.818756 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:23.819812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:23.819812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:23.819812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:23.819812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:23.819812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:23.819812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:23.819812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:23.819812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:23.819812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:23.819812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:23.819812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:23.819812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:23.820102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:23.820102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:23.820102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:23.820102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:23.820102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:23.820102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:23.820102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:23.820102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:23.820102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:23.820102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:23.820102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:23.820102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:23.820102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:23.820409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:23.820409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:23.821467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:23.821467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:23.821467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:23.821467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:23.821467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:23.821467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:23.821467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:23.821467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:23.821467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:23.821467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:23.821467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:23.821467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:23.821467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:23.821467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:23.821467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:23.821467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:23.822228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:23.822879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:23.822879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:23.822879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:24.250567 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:24.251031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:24.251235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:24.252310 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:24.252581 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:24.252724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.253343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:24.253343 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:24.253343 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:24.253343 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:24.253343 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:24.253343 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:24.253343 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.253343 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:24.254355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.254355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:24.254355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:24.254355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:24.254355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.254355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:24.254355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:24.254355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.254355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:24.254355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:24.254355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:24.254355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.254753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:24.254753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:24.254753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:24.254753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:24.254753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:24.254753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:24.254753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:24.254753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:24.254753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:24.254753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:24.254753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:24.254753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:24.254753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:24.255134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.255134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:24.255609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.255609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:24.255609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:24.255609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:24.255609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:24.255609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:24.255609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.255609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:24.255609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:24.255609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.255609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:24.255609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:24.255609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.255609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:24.255609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:24.255609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:24.256123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:24.256611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:24.256611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.256611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:24.299357 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:24.299915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:24.300079 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:24.300146 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:29:24.300815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:24.301029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.301791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:24.301791 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:24.301791 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:24.301791 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:24.301791 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:24.301791 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:24.301791 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.301791 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:24.303171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.303171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:24.303171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:24.303171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:24.303171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.303171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:24.303171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:24.303171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:24.303171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.303171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:24.303171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:24.303171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:24.303171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:24.303171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:24.303171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:24.303765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:24.303765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:24.303765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:24.303765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:24.303765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:24.303765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:24.303765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:24.303765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.303765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:24.304155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.304155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:24.304155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:24.304155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:24.304155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.304155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:24.304155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:24.304155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:29:24.304155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:24.304155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:24.304155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.304155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:24.304630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:24.304630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:24.304630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.304630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:24.304630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:24.304630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:24.304630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:24.304630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:24.304630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:24.304630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:24.304630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:24.304630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:24.304630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:24.304630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:24.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:24.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:24.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.305208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:24.305462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.305462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:24.305462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:24.305462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:24.305462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:24.305462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:24.305462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.305462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:24.305462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:24.305462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.305462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:24.305462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:24.305462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.305462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:24.305462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:24.305462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:24.306036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:24.306551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:24.306551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:24.306551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:24.306551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:24.306551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:24.306551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.306551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:24.310851 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:24.311166 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:24.311291 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:24.311446 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:24.312079 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:24.312484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.313201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:24.313201 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:24.313201 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:24.313201 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:24.313201 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:24.313201 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:24.313201 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.313201 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:24.314322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.314322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:24.314322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:24.314322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:24.314322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.314322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:24.314322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:24.314322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:24.314322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.314322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:24.314322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:24.314322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:24.314322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:24.314322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:24.314322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:24.314695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:24.314695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:24.314695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:24.314695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:24.314695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:24.314695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:24.314695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:24.314695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.314695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:24.315357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.315357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:24.315357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:24.315357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:24.315357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.315357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:24.315357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:24.315357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:24.315357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:24.315357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.315357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:24.315618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:24.315618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:24.315618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.315618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:24.315618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:24.315618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:24.315618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:24.315618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:24.315618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:24.315618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:24.315618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:24.315618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:24.315618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:24.315618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:24.316020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:24.316020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:24.316020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.316020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.316628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:24.316963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:24.317340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:24.317340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:24.317340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.317340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:24.318890 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:24.319188 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:24.319311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:24.319513 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:24.319888 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:24.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:24.320192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.321550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:24.321550 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:24.321550 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:24.321550 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:24.321550 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:24.321550 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:24.321550 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.321550 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:24.321550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.321550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:24.321550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:24.321550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:24.321550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.321550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:24.321550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:24.322264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.322264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:24.322264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:24.322264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:24.322264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.322264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:24.322264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:24.322264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:24.322264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:24.322264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:24.322264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:24.322264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:24.322264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:24.322264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:24.322910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:24.322910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:24.322910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:24.322910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:24.322910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.322910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:24.323182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.323182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:24.323182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:24.323182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:24.323182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:24.323182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:24.323182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.323182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:24.323182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:24.323182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.323182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:24.323182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:24.323182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.323182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:24.323182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:24.323182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:24.323649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:24.324141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:24.324141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:24.324141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:28.787807 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:28.788331 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:28.788492 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:28.789534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:28.833414 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:28.833711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:28.837216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:28.837216 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:28.837216 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:28.837216 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:28.837216 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:28.837216 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:28.837216 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:28.837216 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:28.838208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.049 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:28.838208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:28.838208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:28.838208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:28.838208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:28.838208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:28.838208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:28.838208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:28.838208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:28.838208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:28.838208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:28.838208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:28.838504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:28.838504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:28.838504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:28.838504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:28.838504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:28.838504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:28.838504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:28.838504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:28.838504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:28.838504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:28.838504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:28.838504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:28.838504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:28.838817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:28.838817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:28.839700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:28.839700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:28.839700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:28.839700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:28.839700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:28.839700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:28.839700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:28.839700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:28.839700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:28.839700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:28.839700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:28.839700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:28.839700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:28.839700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:28.839700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:28.839700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:28.840184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:28.840615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:28.840615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:28.840615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:29.251199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:29.251889 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:29.252181 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:29.253117 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:29.253419 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:29.253651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.254470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:29.254470 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:29.254470 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:29.254470 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:29.254470 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:29.254470 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:29.254470 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.254470 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:29.257051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.257051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:29.257051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:29.257051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:29.257051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.257051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:29.257051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:29.257051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.257051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:29.257051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:29.257051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:29.257051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.257779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:29.257779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:29.257779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:29.257779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:29.257779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:29.257779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:29.257779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:29.257779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:29.257779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:29.257779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:29.257779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:29.257779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:29.257779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:29.258425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.258425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:29.258809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.258809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:29.258809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:29.258809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:29.258809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:29.258809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:29.258809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.258809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:29.258809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:29.258809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.258809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:29.258809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:29.258809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.258809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:29.258809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:29.258809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:29.259525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:29.260507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:29.260507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.260507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:29.299946 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:29.300761 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:29.300761 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:29.301053 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:29:29.301942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:29.302310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.303227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:29.303227 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:29.303227 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:29.303227 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:29.303227 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:29.303227 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:29.303227 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.303227 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:29.304653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.304653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:29.304653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:29.304653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:29.304653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.304653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:29.304653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:29.304653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:29.304653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.304653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:29.304653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:29.304653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:29.304653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:29.304653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:29.304653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:29.305500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:29.305500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:29.305500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:29.305500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:29.305500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:29.305500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:29.305500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:29.305500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.305500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:29.306016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.306016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:29.306016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:29.306016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:29.306016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.306016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:29.306016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:29.306016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:29:29.306016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:29.306016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:29.306016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.306016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:29.306452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:29.306452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:29.306452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.306452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:29.306452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:29.306452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:29.306452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:29.306452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:29.306452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:29.306452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:29.306452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:29.306452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:29.306452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:29.306452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:29.308308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:29.308308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:29.308308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.308308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:29.308308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.308308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:29.308308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:29.308308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:29.308308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:29.308308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:29.308308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.308308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:29.308308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:29.308308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:29.308766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:29.309345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:29.309345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:29.309345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:29.309345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:29.309345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:29.309345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:29.309345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:29.309345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:29.309345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:29.309345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:29.309345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.309345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:29.311275 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:29.311605 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:29.311863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:29.311951 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:29.312419 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:29.312681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.315793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:29.315793 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:29.315793 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:29.315793 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:29.315793 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:29.315793 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:29.315793 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.315793 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:29.316790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.316790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:29.316790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:29.316790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:29.316790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.316790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:29.316790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:29.316790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:29.316790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.316790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:29.316790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:29.316790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:29.316790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:29.316790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:29.316790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:29.317260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:29.317260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:29.317260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:29.317260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:29.317260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:29.317260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:29.317260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:29.317260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.317260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:29.318027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.318027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:29.318027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:29.318027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:29.318027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.318027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:29.318027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:29.318027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:29.318027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:29.318027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.318027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:29.318397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:29.318397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:29.318397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.318397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:29.318397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:29.318397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:29.318397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:29.318397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:29.318397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:29.318397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:29.318397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:29.318397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:29.318397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:29.318397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:29.318798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:29.318798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:29.318798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.318798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.319572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:29.320121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:29.320748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:29.320748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:29.320748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.320748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:29.320748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:29.320748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:29.320748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:29.320748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:29.321257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:29.321573 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:29.321807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.322583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:29.322583 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:29.322583 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:29.322583 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:29.322583 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:29.322583 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:29.322583 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.322583 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:29.323682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.323682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:29.323682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:29.323682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:29.323682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.323682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:29.323682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:29.323682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.323682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:29.323682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:29.323682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:29.323682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.324111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:29.324111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:29.324111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:29.324111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:29.324111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:29.324111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:29.324111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:29.324111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:29.324111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:29.324111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:29.324111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:29.324111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:29.324111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:29.324694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.324694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:29.325096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.325096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:29.325096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:29.325096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:29.325096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:29.325096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:29.325096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.325096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:29.325096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:29.325096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.325096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:29.325096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:29.325096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.325096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:29.325096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:29.325096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:29.325705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:29.326263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:29.326263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:29.326263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:33.788701 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:33.789674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:33.789674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:33.790517 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:33.831868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:33.832359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:33.833285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:33.833285 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:33.833285 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:33.833285 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:33.833285 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:33.833285 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:33.833285 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:33.833285 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:33.834043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.044 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:33.834043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:33.834043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:33.834043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:33.834043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:33.834043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:33.834043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:33.834043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:33.834043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:33.834043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:33.834043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:33.834043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:33.834714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:33.834714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:33.834714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:33.834714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:33.834714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:33.834714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:33.834714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:33.834714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:33.834714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:33.834714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:33.834714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:33.834714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:33.834714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:33.835459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:33.835459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:33.835459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:33.835459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:33.835459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:33.835459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:33.835459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:33.835459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:33.835459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:33.835459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:33.835459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:33.835459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:33.835459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:33.835459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:33.835459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:33.836275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:33.837327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:33.837327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:33.837327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:33.837327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:33.837327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:33.837327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:34.252042 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:34.252735 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:34.252735 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:34.253745 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:34.254040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:34.254271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.255395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:34.255395 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:34.255395 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:34.255395 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:34.255395 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:34.255395 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:34.255395 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.255395 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:34.256389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.256389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:34.256389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:34.256389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:34.256389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.256389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:34.256389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:34.256389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.256389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:34.256389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:34.256389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:34.256389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.256773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:34.256773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:34.256773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:34.256773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:34.256773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:34.256773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:34.256773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:34.256773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:34.256773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:34.256773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:34.256773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:34.256773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:34.256773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:34.257131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.257131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:34.257513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.257513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:34.257513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:34.257513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:34.257513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:34.257513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:34.257513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.257513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:34.257513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:34.257513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.257513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:34.257513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:34.257513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.257513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:34.257513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:34.257513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:34.258036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:34.258758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:34.258758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.258758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:34.300700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:34.301179 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:34.301471 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:34.301665 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:29:34.302511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:34.303013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.304389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:34.304389 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:34.304389 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:34.304389 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:34.304389 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:34.304389 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:34.304389 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.304389 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:34.305406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.305406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:34.305406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:34.305406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:34.305406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.305406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:34.305406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:34.305406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:34.305406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.305406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:34.305406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:34.305406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:34.305406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:34.305406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:34.305406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:34.306184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:34.306184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:34.306184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:34.306184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:34.306184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:34.306184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:34.306184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:34.306184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.306184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:34.306801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.306801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:34.306801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:34.306801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:34.306801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.306801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:34.306801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:34.306801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:29:34.306801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:34.306801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:34.306801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.306801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:34.307323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:34.307323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:34.307323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.307323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:34.307323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:34.307323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:34.307323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:34.307323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:34.307323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:34.307323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:34.307323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:34.307323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:34.307323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:34.307323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:34.307735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:34.307735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:34.307735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.307735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:34.308570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.308570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:34.308570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:34.308570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:34.308570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:34.308570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:34.308570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.308570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:34.308570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:34.308570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.308570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:34.308570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:34.308570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.308570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:34.308570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:34.308570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:34.309064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:34.309623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:34.309623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:34.309623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:34.309623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:34.309623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:34.309623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.309623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:34.311754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:34.312091 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:34.312221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:34.312442 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:34.312757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:34.312988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.313574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:34.313574 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:34.313574 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:34.313574 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:34.313574 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:34.313574 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:34.313574 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.313574 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:34.314379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.314379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:34.314379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:34.314379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:34.314379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.314379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:34.314379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:34.314379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:34.314379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.314379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:34.314379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:34.314379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:34.314379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:34.314379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:34.314379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:34.314924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:34.314924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:34.314924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:34.314924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:34.314924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:34.314924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:34.314924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:34.314924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.314924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:34.315229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.315229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:34.315229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:34.315229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:34.315229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.315229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:34.315229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:34.315229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:34.315229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:34.315229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.315229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:34.315658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:34.315658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:34.315658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.315658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:34.315658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:34.315658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:34.315658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:34.315658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:34.315658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:34.315658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:34.315658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:34.315658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:34.315658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:34.315658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:34.316053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:34.316053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:34.316053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.316053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.316357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:34.317062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:34.318069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:34.318069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:34.318069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.318069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:34.320355 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:34.320620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:34.320718 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:34.320920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:34.321592 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:34.322091 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:34.322310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.322870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:34.322870 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:34.322870 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:34.322870 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:34.322870 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:34.322870 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:34.322870 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.322870 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:34.323910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.323910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:34.323910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:34.323910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:34.323910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.323910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:34.323910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:34.323910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.323910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:34.323910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:34.323910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:34.323910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.324328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:34.324328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:34.324328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:34.324328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:34.324328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:34.324328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:34.324328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:34.324328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:34.324328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:34.324328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:34.324328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:34.324328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:34.324328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:34.324896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.324896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:34.325137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.325137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:34.325137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:34.325137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:34.325137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:34.325137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:34.325137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.325137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:34.325137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:34.325137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.325137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:34.325137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:34.325137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.325137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:34.325137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:34.325137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:34.325658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:34.326285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:34.326285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:34.326285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:38.789324 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:38.790183 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:38.790504 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:38.791787 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:38.831657 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:38.831657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:38.831657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:38.831657 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:38.831657 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:38.831657 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:38.831657 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:38.831657 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:38.831657 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:38.831657 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:38.831657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:38.831657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:38.831657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:38.832545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:38.832545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:38.832545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:38.832545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:38.832545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:38.832545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:38.832545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:38.832545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:38.832545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:38.832545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:38.832545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:38.832545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:38.832545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:38.832545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:38.833208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:38.833208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:38.833208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:38.833208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:38.833208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:38.833208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:38.833208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:38.833208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:38.833208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:38.833208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:38.833208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:38.833208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:38.833940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:38.836500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:39.252858 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:39.253341 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:39.253550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:39.254550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:39.254997 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:39.255311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.256476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:39.256476 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:39.256476 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:39.256476 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:39.256476 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:39.256476 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:39.256476 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.256476 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:39.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:39.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:39.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:39.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:39.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:39.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:39.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:39.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:39.257854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.258333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:39.258333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:39.258333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:39.258333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:39.258333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:39.258333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:39.258333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:39.258333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:39.258333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:39.258333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:39.258333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:39.258333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:39.258333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:39.258885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.258885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:39.259623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.259623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:39.259623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:39.259623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:39.259623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:39.259623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:39.259623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.259623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:39.259623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:39.259623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.259623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:39.259623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:39.259623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.259623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:39.259623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:39.259623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:39.260730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:39.262132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:39.262132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.262132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:39.301188 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:39.301744 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:39.302039 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:39.302278 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:29:39.302784 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:39.303002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.303680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:39.303680 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:39.303680 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:39.303680 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:39.303680 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:39.303680 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:39.303680 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.303680 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:39.305200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.305200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:39.305200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:39.305200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:39.305200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.305200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:39.305200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:39.305200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:39.305200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.305200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:39.305200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:39.305200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:39.305200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:39.305200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:39.305200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:39.306280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:39.306280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:39.306280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:39.306280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:39.306280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:39.306280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:39.306280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:39.306280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.306280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:39.307308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.307308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:39.307308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:39.307308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:39.307308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.307308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:39.307308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:39.307308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:29:39.307308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:39.307308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:39.307308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.307308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:39.309230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:39.309230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:39.309230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.309230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:39.309230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:39.309230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:39.309230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:39.309230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:39.309230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:39.309230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:39.309230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:39.309230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:39.309230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:39.309230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:39.311253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:39.311253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:39.311253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.311253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:39.311950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.311950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:39.311950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:39.311950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:39.311950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:39.311950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:39.311950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.311950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:39.311950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:39.311950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.311950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:39.311950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:39.311950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.311950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:39.311950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:39.311950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:39.312512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:39.312996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:39.312996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:39.312996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:39.312996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:39.312996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:39.312996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.312996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:39.312996 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:39.312996 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:39.312996 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:39.313270 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:39.313270 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:39.313916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.314500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:39.314500 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:39.314500 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:39.314500 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:39.314500 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:39.314500 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:39.314500 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.314500 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:39.315271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.315271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:39.315271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:39.315271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:39.315271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.315271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:39.315271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:39.315271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:39.315271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.315271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:39.315271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:39.315271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:39.315271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:39.315271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:39.315271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:39.315834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:39.315834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:39.315834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:39.315834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:39.315834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:39.315834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:39.315834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:39.315834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.315834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:39.319874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.319874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:39.319874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:39.319874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:39.319874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.319874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:39.319874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:39.319874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:39.319874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:39.319874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.319874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:39.320432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:39.320432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:39.320432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.320432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:39.320432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:39.320432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:39.320432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:39.320432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:39.320432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:39.320432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:39.320432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:39.320432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:39.320432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:39.320432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:39.320696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:39.320696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:39.320696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.320696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.325596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:39.326108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:39.326528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:39.326528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:39.326528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.326528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:39.326528 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:39.326528 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:39.326528 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:39.326725 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:39.327570 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:39.327570 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:39.327570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.328282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:39.328282 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:39.328282 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:39.328282 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:39.328282 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:39.328282 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:39.328282 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.328282 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:39.329431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.329431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:39.329431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:39.329431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:39.329431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.329431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:39.329431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:39.329431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.329431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:39.329431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:39.329431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:39.329431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.329895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:39.329895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:39.329895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:39.329895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:39.329895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:39.329895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:39.329895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:39.329895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:39.329895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:39.329895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:39.329895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:39.329895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:39.329895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:39.330220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.330220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:39.330220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.330220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:39.330220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:39.330220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:39.330220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:39.330220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:39.330220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.330220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:39.330220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:39.330220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.330220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:39.330220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:39.330220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:39.333783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:39.334649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:39.334649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:39.334649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:39.334649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:39.334649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:39.334649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:43.790221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:43.791084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:43.791084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:43.792599 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:43.827881 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:43.828290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:43.829254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:43.829254 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:43.829254 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:43.829254 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:43.829254 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:43.829254 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:43.829254 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:43.829254 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:43.830333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:43.830333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:43.830333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:43.830333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:43.830333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:43.830333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:43.830333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:43.830333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:43.830333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:43.830333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:43.830333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:43.830333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:43.830770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:43.830770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:43.830770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:43.830770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:43.830770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:43.830770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:43.830770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:43.830770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:43.830770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:43.830770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:43.830770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:43.830770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:43.830770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:43.831126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:43.831126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:43.831458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:43.831458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:43.831458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:43.831458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:43.831458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:43.831458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:43.831458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:43.831458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:43.831458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:43.831458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:43.831458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:43.831458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:43.831458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:43.831458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:43.831458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:43.831458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:43.831988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:43.832551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:43.832551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:43.832551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:44.254229 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:44.254983 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:44.255184 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:44.256185 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:44.256352 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:44.256500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.257161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:44.257161 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:44.257161 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:44.257161 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:44.257161 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:44.257161 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:44.257161 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.257161 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:44.258814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.258814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:44.258814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:44.258814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:44.258814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.258814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:44.258814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:44.258814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.258814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:44.258814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:44.258814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:44.258814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.259459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:44.259459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:44.259459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:44.259459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:44.259459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:44.259459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:44.259459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:44.259459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:44.259459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:44.259459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:44.259459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:44.259459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:44.259459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:44.260081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.260081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:44.260081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.260081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:44.260081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:44.260081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:44.260081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:44.260081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:44.260081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.260081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:44.260081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:44.260081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.260081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:44.260081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:44.260081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:44.260841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:44.261769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:44.261769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:44.261769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:44.261769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:44.261769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.261769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:44.302087 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:44.302770 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:44.302937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:44.303149 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:29:44.304040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:44.304468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:44.305494 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:44.305494 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:44.305494 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:44.305494 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:44.305494 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:44.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.305494 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:44.306909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.306909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:44.306909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:44.306909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:44.306909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.306909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:44.306909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:44.306909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:44.306909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.306909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:44.306909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:44.306909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:44.306909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:44.306909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:44.306909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:44.307974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:44.307974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:44.307974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:44.307974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:44.307974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:44.307974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:44.307974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:44.307974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.307974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:44.308758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.308758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:44.308758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:44.308758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:44.308758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.308758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:44.308758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:44.308758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:29:44.308758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:44.308758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:44.308758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.308758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:44.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:44.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:44.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:44.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:44.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:44.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:44.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:44.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:44.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:44.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:44.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:44.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:44.309653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:44.311145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:44.311145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:44.311145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.311145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:44.311145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.311145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:44.311145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:44.311145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:44.311145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:44.311145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:44.311145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.311145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:44.311145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:44.311145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:44.311726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:44.312532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:44.312532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:44.312532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:44.312532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:44.312532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:44.312532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:44.312532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:44.312532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:44.312532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:44.312532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:44.312532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.312532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:44.313041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:44.313194 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:44.313390 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:44.313680 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:44.314180 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:44.314507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.315111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:44.315111 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:44.315111 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:44.315111 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:44.315111 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:44.315111 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:44.315111 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.315111 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:44.315857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.315857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:44.315857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:44.315857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:44.315857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.315857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:44.315857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:44.315857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:44.315857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.315857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:44.315857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:44.315857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:44.315857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:44.315857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:44.315857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:44.316298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:44.316298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:44.316298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:44.316298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:44.316298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:44.316298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:44.316298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:44.316298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.316298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:44.316711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.316711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:44.316711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:44.316711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:44.316711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.316711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:44.316711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:44.316711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:44.316711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:44.316711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.316711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:44.317086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:44.317086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:44.317086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.317086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:44.317086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:44.317086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:44.317086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:44.317086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:44.317086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:44.317086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:44.317086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:44.317086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:44.317086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:44.317086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:44.317544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:44.317544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:44.317544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.317544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.319057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:44.319715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:44.320062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:44.320062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:44.320062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.320062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:44.326819 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:44.326957 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:44.327009 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:44.327199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:44.327858 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:44.328302 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:44.328618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.329506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:44.329506 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:44.329506 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:44.329506 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:44.329506 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:44.329506 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:44.329506 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.329506 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:44.330773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.330773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:44.330773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:44.330773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:44.330773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.330773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:44.330773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:44.330773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.330773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:44.330773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:44.330773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:44.330773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.331143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:44.331143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:44.331143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:44.331143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:44.331143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:44.331143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:44.331143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:44.331143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:44.331143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:44.331143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:44.331143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:44.331143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:44.331143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:44.331558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.331558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:44.333082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.333082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:44.333082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:44.333082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:44.333082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:44.333082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:44.333082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.333082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:44.333082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:44.333082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.333082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:44.333082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:44.333082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.333082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:44.333082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:44.333082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:44.333611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:44.334246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:44.334246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:44.334246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:48.790921 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:48.791820 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:48.791933 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:48.793059 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:48.835923 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:48.836387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:48.840401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:48.840401 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:48.840401 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:48.840401 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:48.840401 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:48.840401 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:48.840401 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:48.840401 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:48.840401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.045 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:48.840401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:48.840401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:48.840401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:48.840401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:48.840401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:48.840401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:48.840843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:48.840843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:48.840843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:48.840843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:48.840843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:48.840843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:48.840843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:48.840843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:48.840843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:48.840843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:48.840843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:48.840843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:48.840843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:48.840843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:48.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:48.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:48.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:48.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:48.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:48.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:48.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:48.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:48.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:48.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:48.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:48.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:48.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:48.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:48.841486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:48.841895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:48.841895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:48.841895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:48.841895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:48.841895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:48.841895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:48.841895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:48.841895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:48.841895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:49.255179 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:49.256118 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:49.256520 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:49.258002 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:49.258293 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:49.258523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.259355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:49.259355 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:49.259355 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:49.259355 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:49.259355 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:49.259355 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:49.259355 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.259355 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:49.260398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.260398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:49.260398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:49.260398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:49.260398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.260398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:49.260398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:49.260398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.260398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:49.260398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:49.260398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:49.260398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.261189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:49.261189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:49.261189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:49.261189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:49.261189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:49.261189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:49.261189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:49.261189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:49.261189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:49.261189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:49.261189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:49.261189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:49.261189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:49.261813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.261813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:49.261933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.261933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:49.261933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:49.261933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:49.261933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:49.261933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:49.261933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.261933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:49.261933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:49.261933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.261933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:49.261933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:49.261933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.261933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:49.261933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:49.261933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:49.262743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:49.263925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:49.263925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.263925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:49.302836 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:49.303385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:49.303616 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:49.303724 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:29:49.304518 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:49.304875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.305770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:49.305770 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:49.305770 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:49.305770 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:49.305770 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:49.305770 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:49.305770 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.305770 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:49.306673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.306673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:49.306673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:49.306673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:49.306673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.306673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:49.306673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:49.306673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:49.306673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.306673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:49.306673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:49.306673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:49.306673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:49.306673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:49.306673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:49.307570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:49.307570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:49.307570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:49.307570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:49.307570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:49.307570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:49.307570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:49.307570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.307570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:49.307570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.307570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:49.307570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:49.307570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:49.307570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.308425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:49.308425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:49.308425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:29:49.308425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:49.308425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:49.308425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.308425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:49.308425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:49.308425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:49.308425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.308425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:49.308425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:49.308425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:49.309084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:49.309084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:49.309084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:49.309084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:49.309084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:49.309084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:49.309084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:49.309084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:49.309084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:49.309084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:49.309084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.309084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:49.309691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.309691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:49.309691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:49.309691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:49.309691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:49.309691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:49.309691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.309691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:49.309691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:49.309691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.309691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:49.309691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:49.309691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.309691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:49.309691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:49.309691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:49.310593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:49.311440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:49.311440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:49.311440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:49.311440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:49.311440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:49.311440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.311440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:49.313586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:49.314053 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:49.314306 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:49.314306 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:49.315032 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:49.315343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.315930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:49.315930 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:49.315930 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:49.315930 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:49.315930 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:49.315930 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:49.315930 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.315930 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:49.316788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.316788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:49.316788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:49.316788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:49.316788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.316788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:49.316788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:49.316788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:49.316788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.316788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:49.316788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:49.316788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:49.316788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:49.316788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:49.316788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:49.317323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:49.317323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:49.317323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:49.317323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:49.317323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:49.317323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:49.317323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:49.317323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.317323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:49.317671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.317671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:49.317671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:49.317671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:49.317671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.317671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:49.317671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:49.317671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:49.317671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:49.317671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.317671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:49.318308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:49.318308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:49.318308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.318308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:49.318308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:49.318308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:49.318308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:49.318308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:49.318308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:49.318308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:49.318308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:49.318308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:49.318308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:49.318308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:49.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:49.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:49.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:49.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:49.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:49.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:49.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:49.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:49.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:49.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:49.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:49.319293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:49.319903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:49.319903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:49.319903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:49.319903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:49.319903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:49.319903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:49.319903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:49.319903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:49.319903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:49.319903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.319903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:49.327122 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:49.327729 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:49.327839 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:49.328030 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:49.328602 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:49.329007 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:49.329237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.330176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:49.330176 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:49.330176 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:49.330176 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:49.330176 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:49.330176 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:49.330176 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.330176 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:49.331228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.331228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:49.331228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:49.331228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:49.331228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.331228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:49.331228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:49.331228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.331228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:49.331228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:49.331228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:49.331228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.331755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:49.331755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:49.331755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:49.331755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:49.331755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:49.331755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:49.331755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:49.331755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:49.331755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:49.331755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:49.331755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:49.331755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:49.331755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:49.332208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.332208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:49.332208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.332208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:49.332208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:49.332208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:49.332208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:49.332208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:49.332208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.332208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:49.332208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:49.332208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.332208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:49.332208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:49.332208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:49.332690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:49.333176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:49.333176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:49.333176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:49.333176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:49.333176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:49.333176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:53.791710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:53.792262 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:53.794389 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:53.794389 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:53.804759 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=236 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:29:53.846042 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:53.846445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:53.847322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:53.847322 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:53.847322 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:53.847322 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:53.847322 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:53.847322 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:53.847322 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:53.847322 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:53.848285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.055 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:53.848285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:53.848285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:53.848285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:53.848285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:53.848285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:53.848285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:53.848285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:53.848285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:53.848285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:53.848285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:53.848285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:53.848651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:53.848651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:53.848651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:53.848651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:53.848651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:53.848651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:53.848651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:53.848651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:53.848651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:53.848651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:53.848651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:53.848651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:53.848651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:53.848903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:53.848903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:53.849345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:53.849345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:53.849345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:53.849345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:53.849345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:53.849345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:53.849345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:53.849345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:53.849345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:53.849345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:53.849345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:53.849345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:53.849345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:53.849345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:53.849345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:53.849345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:53.849707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:53.850091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:53.850091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:53.850091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:54.255988 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:54.256700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:54.256844 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:54.257859 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:54.258110 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:54.258263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.259406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:54.259406 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:54.259406 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:54.259406 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:54.259406 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:54.259406 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:54.259406 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.259406 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:54.264675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.264675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:54.264675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:54.264675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:54.264675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.264675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:54.264675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:54.264675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.264675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:54.264675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:54.264675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:54.264675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.265198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:54.265198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:54.265198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:54.265198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:54.265198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:54.265198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:54.265198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:54.265198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:54.265198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:54.265198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:54.265198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:54.265198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:54.265198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:54.265526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.265526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:54.265526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.265526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:54.265526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:54.265526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:54.265526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:54.265526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:54.265526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.265526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:54.265526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:54.265526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.265526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:54.265526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:54.265526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:54.265840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:54.266280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:54.266280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:54.266280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:54.266280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:54.266280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.266280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:54.308497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:54.308497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:54.308497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:54.308497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:29:54.308497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:54.308497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.308808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:54.309175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:54.309175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:54.309175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:54.309175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:54.309175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:54.309175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:54.309175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:54.309175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:54.309175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:54.309175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:54.309175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:54.309175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:54.309175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.309175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:54.309175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.309465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:54.309465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:54.309465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:54.309465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.309465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:54.309465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:54.309465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:29:54.309465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:54.309465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:54.309465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.309465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:54.309465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:54.309465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:54.309709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.309709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:54.309709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:54.309709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:54.309709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:54.309709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:54.309709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:54.309709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:54.309709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:54.309709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:54.309709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:54.309709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:54.309709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:54.309709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:54.309976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.309976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:54.309976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.309976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:54.309976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:54.309976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:54.309976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:54.309976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:54.309976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.309976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:54.309976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:54.309976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.309976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:54.309976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:54.309976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:54.310259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:54.310627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:54.310627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:54.310627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:54.310627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:54.310627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:54.310627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:54.310627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:54.310627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.310627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:54.315507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:54.315507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:54.315507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:54.315507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:54.315940 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:54.316284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.317053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:54.317053 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:54.317053 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:54.317053 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:54.317053 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:54.317053 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:54.317053 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.317053 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:54.317919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.317919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:54.317919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:54.317919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:54.317919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.317919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:54.317919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:54.317919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:54.317919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.317919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:54.317919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:54.317919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:54.317919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:54.317919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:54.317919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:54.318328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:54.318328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:54.318328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:54.318328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:54.318328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:54.318328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:54.318328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:54.318328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.318328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:54.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:54.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:54.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:54.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:54.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:54.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:54.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:54.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.318818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:54.319110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:54.319110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:54.319110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.319110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:54.319110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:54.319110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:54.319110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:54.319110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:54.319110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:54.319110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:54.319110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:54.319110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:54.319110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:54.319110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:54.319500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:54.319500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:54.319500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.319500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.320084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:54.320533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:54.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:54.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:54.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.321006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:54.328905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:54.329511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:54.329602 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:54.329771 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:54.330381 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:54.330752 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:54.330914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.331660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:54.331660 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:54.331660 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:54.331660 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:54.331660 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:54.331660 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:54.331660 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.331660 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:54.332941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.332941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:54.332941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:54.332941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:54.332941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.332941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:54.332941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:54.332941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.332941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:54.332941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:54.332941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:54.332941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.333331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:54.333331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:54.333331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:54.333331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:54.333331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:54.333331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:54.333331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:54.333331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:54.333331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:54.333331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:54.333331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:54.333331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:54.333331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:54.333715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.333715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:54.334358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.334358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:54.334358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:54.334358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:54.334358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:54.334358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:54.334358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.334358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:54.334358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:54.334358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.334358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:54.334358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:54.334358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.334358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:54.334358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:54.334358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:54.334855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:54.335426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:54.335426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:54.335426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:58.792568 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:58.795049 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:58.795049 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:58.795606 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:58.827274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:58.827504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:58.827908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:58.827908 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:58.827908 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:58.827908 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:58.827908 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:58.827908 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:58.827908 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:58.827908 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:58.828768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:58.828768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:58.828768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:58.828768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:58.828768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:58.828768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:58.828768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:58.828768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:58.828768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:58.828768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:58.828768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:58.828768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:58.830139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:58.830139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:58.830139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:58.830139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:58.830139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:58.830139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:58.830139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:58.830139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:58.830139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:58.830139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:58.830139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:58.830139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:58.830139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:58.830887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:58.830887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:58.830887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:58.830887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:58.830887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:58.830887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:58.830887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:58.830887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:58.830887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:58.830887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:58.830887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:58.830887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:58.830887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:58.830887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:58.830887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:58.831756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:58.833281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:58.833281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:58.833281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:58.833281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:58.833281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:58.833281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:59.256784 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:59.257333 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:59.257631 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:59.258715 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:59.259094 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:59.259360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.260521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:59.260521 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:59.260521 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:59.260521 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:59.260521 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:59.260521 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:59.260521 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.260521 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:59.261608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.261608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:59.261608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:59.261608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:59.261608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.261608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:59.261608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:59.261608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.261608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:59.261608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:59.261608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:59.261608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.263749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:59.263749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:59.263749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:59.263749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:59.263749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:59.263749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:59.263749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:59.263749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:59.263749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:59.263749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:59.263749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:59.263749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:59.263749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:59.264644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.264644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:59.264644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.264644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:59.264644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:59.264644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:59.264644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:59.264644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:59.264644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.264644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:59.264644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:59.264644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.264644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:59.264644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:59.264644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:59.266502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:59.267655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:59.267655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:59.267655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:59.267655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:59.267655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.267655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:59.304471 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:59.305051 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:59.305272 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:59.305528 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:29:59.306231 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:59.306583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.307974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:59.307974 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:59.307974 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:59.307974 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:59.307974 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:59.307974 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:59.307974 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.307974 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:59.309223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.309223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:59.309223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:59.309223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:59.309223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.309223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:59.309223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:59.309223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:59.309223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.309223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:59.309223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:59.309223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:59.309223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:59.309223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:59.309223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:59.309661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:59.309661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:59.309661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:59.309661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:59.309661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:59.309661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:59.309661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:59.309661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.309661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:59.310681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.310681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:59.310681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:59.310681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:59.310681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.310681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:59.310681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:59.310681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:29:59.310681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:59.310681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:59.310681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.310681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:59.310935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:59.310935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:59.310935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.310935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:59.310935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:59.310935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:59.310935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:59.310935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:59.310935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:59.310935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:59.310935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:59.310935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:59.310935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:59.310935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:59.311194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:59.311194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:59.311194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.311194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:59.313138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.313138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:59.313138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:59.313138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:59.313138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:59.313138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:59.313138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.313138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:59.313138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:59.313138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.313138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:59.313138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:59.313138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.313138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:59.313138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:59.313138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:59.314304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:59.314833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:59.314833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:59.314833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:59.314833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:59.314833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:59.314833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.314833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:59.315695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:59.315695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:59.315695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:59.315695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:59.316102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:59.316102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.316636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:59.316636 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:59.316636 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:59.316636 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:59.316636 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:59.316636 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:59.316636 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.316636 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:59.317469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.317469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:29:59.317469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:59.317469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:59.317469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.317469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:59.317469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:59.317469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:59.317469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.317469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:29:59.317469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:59.317469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:29:59.317469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:59.317469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:29:59.317469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:29:59.318095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:59.318095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:29:59.318095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:59.318095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:29:59.318095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:29:59.318095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:59.318095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:29:59.318095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.318095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:29:59.318095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.318095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:59.318095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:59.318095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:59.318095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.318559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:59.318559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:59.318559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:59.318559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:59.318559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.318559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:59.318559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:59.318559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:59.318559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.318559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:59.318559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:59.318559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:59.318559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:59.318982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:59.318982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:59.318982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:59.318982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:59.318982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:59.318982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:59.318982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:59.318982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:59.318982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:59.318982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.318982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:59.318982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:29:59.319428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.320073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:29:59.329528 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:29:59.330155 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:29:59.330500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:29:59.330863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:29:59.331468 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:59.331814 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:29:59.332104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.332917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:29:59.332917 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:59.332917 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:29:59.332917 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:29:59.332917 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:59.332917 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:29:59.332917 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.332917 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:29:59.334615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.334615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:29:59.334615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:59.334615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:29:59.334615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.334615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:59.334615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:59.334615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.334615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:59.334615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:59.334615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:59.334615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.335316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:29:59.335316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:59.335316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:29:59.335316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:59.335316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:29:59.335316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:29:59.335316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:59.335316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:29:59.335316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:59.335316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:29:59.335316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:29:59.335316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:59.335316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:29:59.335638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.335638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:29:59.336674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.336674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:29:59.336674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:29:59.336674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:29:59.336674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:29:59.336674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:29:59.336674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.336674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:29:59.336674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:29:59.336674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.336674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:29:59.336674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:29:59.336674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.336674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:29:59.336674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:29:59.336674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:29:59.337519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:29:59.337962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:29:59.337962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:29:59.337962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:03.772583 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:03.773496 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_for_inconsistencies {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:03.773496 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Checking Neutron and OVN revision consistency. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:03.783981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:440}}
Apr 24 10:30:03.784209 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, security_groups=2, routers=1, router_ports=1 {{(pid=106381) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:419}}
Apr 24 10:30:03.784377 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 412fe0fb-d3c8-41ef-b742-c7e091bf5e56 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:30:03.794715 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:03.840572 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, resource={'id': '412fe0fb-d3c8-41ef-b742-c7e091bf5e56', 'name': 'private', 'tenant_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'project_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['bedea127-581a-4245-bdcf-823b49c82996', 'd98dd98c-3740-4b7b-9054-95b7f384275a'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:19:49Z', 'updated_at': '2026-04-24T10:19:53Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 21598}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:03.840805 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:03.840982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-d9e6c44e-2c1f-4e1c-97fa-3abe15d536c8, external_ids_update=None, columns={'tag': 21598}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:03.840982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:03.841744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:03.841744 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:03.841744 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:03.841744 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:03.841744 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:03.841744 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:03.841744 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:03.841744 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:03.842240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 412fe0fb-d3c8-41ef-b742-c7e091bf5e56 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:03.842240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:03.842240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:30:03.842240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:30:03.842240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:30:03.842240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:30:03.842240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:30:03.842240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:03.842240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:03.842240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:03.842240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:03.843018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:03.843018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:03.843018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:03.843018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:03.843018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:03.843018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:03.843018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:03.843018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:03.843018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:03.843018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:03.843018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:03.843018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:03.843018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:03.843018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:03.843845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:03.843845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:03.843845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:03.843845 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 86c46bc9-7739-46e7-9c49-62d2723e0d83 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:30:03.874249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, resource={'id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'name': 'public', 'tenant_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'project_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['4daf396b-50dc-4100-9154-fd24fc0e5f1d', '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-24T10:19:55Z', 'updated_at': '2026-04-24T10:20:05Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:03.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:03.874754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-b792be55-4fbf-4e4f-a9dc-10cee932ceea, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:03.875088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:03.875405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:03.875405 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:03.875405 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:03.875405 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:03.875405 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:03.875405 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:03.875405 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:03.875405 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:03.876251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 86c46bc9-7739-46e7-9c49-62d2723e0d83 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:03.876251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:03.876251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:30:03.876251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:30:03.876251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:30:03.876251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:30:03.876251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:30:03.876251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:03.876251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:03.876251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:03.876251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:03.876801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:03.876801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:03.876801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:03.876801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:03.876801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:03.876801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:03.876801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:03.876801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:03.876801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:03.876801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:03.876801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:03.876801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:03.876801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:03.876801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:03.877424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:03.877424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:03.877424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:03.877424 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 64c3f969-5120-406a-afc1-20f8f45b7533 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:30:03.903114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-64c3f969-5120-406a-afc1-20f8f45b7533, resource={'id': '64c3f969-5120-406a-afc1-20f8f45b7533', 'name': 'admin_net', 'tenant_id': '91bc93878b40449c8fd1c9924d8a3e8b', 'project_id': '91bc93878b40449c8fd1c9924d8a3e8b', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['18db2f65-6ba9-4ddd-8ab7-55370a16debc'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:23:22Z', 'updated_at': '2026-04-24T10:23:23Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 10837}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:03.903343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-64c3f969-5120-406a-afc1-20f8f45b7533, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:03.903559 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-a26d15c8-ce05-4e3e-84bc-9aa33edf96fe, external_ids_update=None, columns={'tag': 10837}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:03.903630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:03.904107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:03.904107 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:03.904107 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:03.904107 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:03.904107 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:03.904107 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:03.904107 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:03.904107 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:03.904884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 64c3f969-5120-406a-afc1-20f8f45b7533 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:03.904884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:03.904884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:30:03.904884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:30:03.904884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:30:03.904884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:30:03.904884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:30:03.904884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:03.904884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:03.904884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:03.904884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:03.905395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:03.905395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:03.905395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:03.905395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:03.905395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:03.905395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:03.905395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:03.905395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:03.905395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:03.905395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:03.905395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:03.905395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:03.905395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:03.905395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:03.905798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:03.905798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:03.905798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:03.905798 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource b30b34a1-477c-4ef7-aea4-d9540988f10a (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:30:03.931813 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a, resource={'id': 'b30b34a1-477c-4ef7-aea4-d9540988f10a', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'tenant_id': '277dd31c279b430f90665727a827242c', 'project_id': '277dd31c279b430f90665727a827242c', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['a3090689-5a84-48d5-9685-f418bb1fd559'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:24:04Z', 'updated_at': '2026-04-24T10:24:05Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 23713}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:03.932241 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:03.932241 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-6d5b7906-0378-49b8-88fc-e9fa642055e4, external_ids_update=None, columns={'tag': 23713}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:03.932509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:03.932827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:03.932827 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:03.932827 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:03.932827 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:03.932827 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:03.932827 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:03.932827 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:03.932827 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:03.934010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource b30b34a1-477c-4ef7-aea4-d9540988f10a (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:03.934010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:03.934010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:30:03.934010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:30:03.934010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:30:03.934010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:30:03.934010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:30:03.934010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:03.934010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:03.934010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:03.934010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:03.934997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:03.934997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:03.934997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:03.934997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:03.934997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:03.934997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:03.934997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:03.934997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:03.934997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:03.934997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:03.934997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:03.934997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:03.934997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:03.934997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:03.935342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:03.935342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:03.935342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:03.935342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource a6f665d4-42d0-42c1-b65b-28c00546f9e9 (type: security_groups) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:30:03.964969 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.db.ovn_revision_numbers_db [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Successfully bumped revision number for resource a6f665d4-42d0-42c1-b65b-28c00546f9e9 (type: security_groups) to 10
Apr 24 10:30:03.965202 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 681f7c6d-0ebf-471c-a740-b1fe457fc01a (type: security_groups) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:30:04.012443 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.db.ovn_revision_numbers_db [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Successfully bumped revision number for resource 681f7c6d-0ebf-471c-a740-b1fe457fc01a (type: security_groups) to 15
Apr 24 10:30:04.012617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 931f18d3-b7f8-4874-928b-3c06d4d5d355 (type: routers) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:30:04.114700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, resource={'id': '931f18d3-b7f8-4874-928b-3c06d4d5d355', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'project_id': '277dd31c279b430f90665727a827242c', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'external_fixed_ips': [{'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7', 'ip_address': '172.24.5.167'}, {'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'ip_address': '2001:db8::1b3'}], 'enable_snat': True}, 'gw_port_id': '77659748-a2b4-448f-aa2d-e166be8f2be9', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-7ytfi', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'external_fixed_ips': [{'ip_address': '172.24.5.167', 'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7'}, {'ip_address': '2001:db8::1b3', 'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-24T10:24:05Z', 'updated_at': '2026-04-24T10:24:08Z', 'revision_number': 3, 'tenant_id': '277dd31c279b430f90665727a827242c'}, resource_type=routers, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:04.114905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:04.114905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "77659748-a2b4-448f-aa2d-e166be8f2be9"')], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:04.115087 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "77659748-a2b4-448f-aa2d-e166be8f2be9"')], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:04.115087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.115600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:04.115600 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.115600 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:04.115600 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.115600 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.115600 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:04.115600 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.115600 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:04.115782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Unable to update router 931f18d3-b7f8-4874-928b-3c06d4d5d355. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.117094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 931f18d3-b7f8-4874-928b-3c06d4d5d355 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.117094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:04.117094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:30:04.117094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:30:04.117094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:30:04.117094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:30:04.117094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1634, in update_router
Apr 24 10:30:04.117094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 24 10:30:04.117094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
Apr 24 10:30:04.117094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 24 10:30:04.117094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 24 10:30:04.117414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 24 10:30:04.117414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1568, in update_router
Apr 24 10:30:04.117414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:04.117414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.117414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:04.117414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:04.117414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:04.117414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.117414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:04.117414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:04.117414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:04.117414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:04.117414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:04.117414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:04.117689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:04.117689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:04.117689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.117689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:04.117689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.117689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.117689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:04.117689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.117689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:04.117689 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 77659748-a2b4-448f-aa2d-e166be8f2be9 (type: router_ports) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:30:04.257448 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:04.283313 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, resource={'id': '77659748-a2b4-448f-aa2d-e166be8f2be9', 'name': '', 'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'project_id': '', 'mac_address': 'fa:16:3e:fa:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '931f18d3-b7f8-4874-928b-3c06d4d5d355', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7', 'ip_address': '172.24.5.167'}, {'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'ip_address': '2001:db8::1b3'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000170011', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-24T10:24:06Z', 'updated_at': '2026-04-24T10:24:07Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:04.283742 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7 4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'neutron:network_name': 'neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.167/24', '2001:db8::1b3/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:04.283853 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=77659748-a2b4-448f-aa2d-e166be8f2be9, lrouter_port=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:04.285616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.285616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:04.285616 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.285616 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:04.285616 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.285616 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.285616 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:04.285616 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.285616 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:04.285616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 77659748-a2b4-448f-aa2d-e166be8f2be9 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.285616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:04.285616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:30:04.285616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:30:04.285616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:30:04.286516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:30:04.286516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1971, in update_router_port
Apr 24 10:30:04.286516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:04.286516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.286516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:04.286516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:04.286516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:04.286516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.286516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:04.286516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:04.286516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:04.286516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:04.286516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:04.286516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:04.286960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:04.286960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:04.286960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.286960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:04.286960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.286960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.286960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:04.286960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.286960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:04.286960 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_for_inconsistencies finished in 0.512 seconds
Apr 24 10:30:04.286960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:04.287306 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:04.287306 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:04.311704 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:04.316555 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:04.331088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:04.331972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:04.332155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.332635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:04.332635 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.332635 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:04.332635 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.332635 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.332635 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:04.332635 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.332635 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:04.333418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.046 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.333418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:04.333418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:04.333418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:04.333418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.333418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:04.333418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:04.333418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.333418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:04.333418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:04.333418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:04.333418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.333885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:04.333885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:04.333885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:04.333885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:04.333885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:04.333885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:04.333885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:04.333885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:04.333885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.333885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:04.333885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.333885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.333885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:04.334257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.334257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:04.336126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.336126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:04.336126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:04.336126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:04.336126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:04.336126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:04.336126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.336126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:04.336126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:04.336126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.336126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:04.336126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:04.336126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.336126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:04.336126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:04.336126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.336772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.337323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:04.337323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.337323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:04.337323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:04.337323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:04.337323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:04.337323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:04.337323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.337644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:04.337644 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.337644 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:04.337644 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.337644 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.337644 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:04.337644 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.337644 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:04.337644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.337644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:04.337644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:04.337644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:04.337644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.337644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:04.337644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:04.338105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.338105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:04.338105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:04.338105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:04.338105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.338105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:04.338105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:04.338105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:04.338105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:04.338105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:04.338105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:04.338105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:04.338105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:04.338105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.338563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:04.338563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.338563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.338563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:04.338563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.338563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:04.338563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.338563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:04.338563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:04.338563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:04.338563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:04.338563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:04.338563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.338563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:04.338996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:04.339868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:04.339868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:04.339868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:04.339868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.339868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:04.339868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.339868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.339868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:04.339868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.339868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:04.339868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:04.339868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:04.340273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:30:04.340273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:04.340273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.340273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:04.340273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.340273 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:04.340273 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.340273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.340273 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:04.340273 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.340273 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:04.340273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.340273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:04.341510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.341510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.341510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:04.341510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.341510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:04.341510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.341510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:04.341510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:04.341510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:04.341510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.341510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:04.341510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:04.341510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:30:04.341819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:04.341819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:04.341819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.341819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:04.341819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:04.341819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:04.341819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.341819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:04.341819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:04.341819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:04.341819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:04.341819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:04.341819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:04.342090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:04.342090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:04.342090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.342090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:04.342090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.342090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.342090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:04.342090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.342090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:04.342090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.342090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:04.342090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.342348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.343313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:04.343706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:04.343706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:04.343706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:04.343706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:04.343706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.343706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:04.343706 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.343706 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:04.343706 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.343925 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.343925 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:04.343925 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.343925 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:04.343925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.343925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:04.343925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:04.343925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:04.343925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.343925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:04.343925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:04.343925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:04.343925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.343925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:04.343925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:04.343925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:04.344243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:04.344243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:04.344243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:04.344243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:04.344243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:04.344243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.344243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:04.344243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.344243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.344243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:04.344243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.344243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:04.344243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.344243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:04.344554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:04.344554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:04.344554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.344554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:04.344554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:04.344554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:04.344554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:04.344554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.344554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:04.344554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:04.344554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:04.344554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.344554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:04.344831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:04.344831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:04.344831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:04.344831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:04.344831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:04.344831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:04.344831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:04.344831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.344831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:04.344831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.344831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.344831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:04.344831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:04.345140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.345529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:04.345949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.345949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.345949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:04.345949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.345949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:04.345949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:04.345949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:04.345949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:04.345949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:04.346205 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:04.346205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.346205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:04.346205 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.346205 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:04.346205 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.346205 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.346205 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:04.346205 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.346205 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:04.347946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.347946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:04.347946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:04.347946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:04.347946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.347946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:04.347946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:04.347946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.347946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:04.347946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:04.347946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:04.347946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.348356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:04.348356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:04.348356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:04.348356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:04.348356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:04.348356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:04.348356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:04.348356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:04.348356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.348356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:04.348356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.348356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.348356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:04.348787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.348787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:04.348787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.348787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:04.348787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:04.348787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:04.348787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:04.348787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:04.348787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.348787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:04.348787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:04.348787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.348787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:04.348787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:04.348787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:04.349312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:04.349778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:04.349778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:04.349778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:04.349778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:04.349778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:04.349778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:09.286566 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:09.287424 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:09.287424 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:09.288697 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:09.327440 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:09.327664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.328230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:09.328230 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.328230 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:09.328230 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.328230 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.328230 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:09.328230 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.328230 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:09.329203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.329203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:09.329203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:09.329203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:09.329203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.329203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:09.329203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:09.329203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.329203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:09.329203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:09.329203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:09.329203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.330092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:09.330092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:09.330092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:09.330092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:09.330092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:09.330092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:09.330092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:09.330092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:09.330092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.330092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:09.330092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.330092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.330092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:09.330969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.330969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:09.330969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.330969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:09.330969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:09.330969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:09.330969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:09.330969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:09.330969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.330969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:09.330969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:09.330969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.330969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:09.330969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:09.330969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:09.331911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.335350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:09.335350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.335350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.335350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:09.335350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.335350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:09.335350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:09.335350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:09.335878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:09.336190 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:09.336354 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:09.336500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:09.336984 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.336984 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:09.336984 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.336984 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.336984 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:09.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:09.338378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.338378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:09.338378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:09.338378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:09.338378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.338378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:09.338378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:09.338378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.338378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:09.338378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:09.338378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:09.338378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.339546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:09.339546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:09.339546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:09.339546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:09.339546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:09.339546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:09.339546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:09.339546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:09.339546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.339546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:09.339546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.339546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.339546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:09.340334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.340334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:09.340334 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:09.340334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.340334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:09.340334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:09.340334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:09.340334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:09.340334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:09.340334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.340334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:09.340334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:09.340334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:09.341125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:09.341608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:09.341608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:09.341608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.341608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:09.341608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.341608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.341608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:09.341608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.341608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:09.341608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:09.341608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:09.341608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:30:09.341887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:09.341887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:09.341887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.342612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:09.342612 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.342612 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:09.342612 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.342612 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.342612 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:09.342612 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.342612 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:09.343383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.343383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:09.343383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:09.343383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:09.343383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.343383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:09.343383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:09.343383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:09.343383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.343383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:09.343383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:09.343383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:09.343383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:09.343383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:09.343383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:09.344442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:09.344442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:09.344442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.344442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:09.344442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.344442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.344442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:09.344442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.344442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:09.344442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.344442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:09.344442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:09.344442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:09.344442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.344808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:09.344808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:09.344808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:30:09.344808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:09.344808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:09.344808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.344808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:09.344808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:09.344808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:09.344808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.344808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:09.344808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:09.344808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:09.345113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:09.345113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:09.345113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:09.345113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:09.345113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:09.345113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.345113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:09.345113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.345113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.345113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:09.345113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.345113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:09.346513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.346513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:09.346513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:09.346513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:09.346513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:09.346513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:09.346513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.346513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:09.346513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:09.346513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.346513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:09.346513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:09.346513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.346513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:09.346513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:09.346513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:09.347429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:09.348315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.348315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:09.348315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.348315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.348315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:09.348315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.348315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:09.348315 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:09.348315 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:09.348315 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:09.348856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:09.348856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:09.348856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.348856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:09.348856 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.348856 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:09.348856 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.348856 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.348856 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:09.348856 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.348856 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:09.348856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:09.349146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:09.349890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:09.349890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:09.349890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.349890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:09.349890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:09.349890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:09.349890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.349890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:09.349890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:09.349890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:09.349890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:09.349890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:09.349890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:09.350226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:09.350226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:09.350226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.350226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:09.350226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.350226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.350226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:09.350226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.350226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:09.350226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.350226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:09.350226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.351667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.353011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:09.354468 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:09.354468 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:09.354468 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:09.354468 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:09.354468 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:09.354468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.354660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:09.354660 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.354660 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:09.354660 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.354660 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.354660 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:09.354660 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.354660 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:09.354660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.354660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:09.354660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:09.354660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:09.354660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.354660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:09.354660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:09.355028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.355028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:09.355028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:09.355028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:09.355028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.355028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:09.355028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:09.355028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:09.355028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:09.355028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:09.355028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:09.355028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:09.355028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:09.355028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.355562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:09.355562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.355562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.355562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:09.355562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.355562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:09.355562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.355562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:09.355562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:09.355562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:09.355562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:09.355562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:09.355562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.355562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:09.356766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:09.357908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:09.357908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:09.357908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:09.357908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:09.357908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:09.357908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:09.357908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:09.357908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:09.357908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:09.357908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:14.288343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:14.289524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:14.289524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:14.289704 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:14.326936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:14.327140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.327774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:14.327774 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.327774 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:14.327774 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.327774 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.327774 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:14.327774 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.327774 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:14.328653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.328653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:14.328653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:14.328653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:14.328653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.328653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:14.328653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:14.328653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.328653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:14.328653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:14.328653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:14.328653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.329463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:14.329463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:14.329463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:14.329463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:14.329463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:14.329463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:14.329463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:14.329463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:14.329463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.329463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:14.329463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.329463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.329463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:14.330043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.330043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:14.330043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.330043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:14.330043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:14.330043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:14.330043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:14.330043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:14.330043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.330043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:14.330043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:14.330043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.330043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:14.330043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:14.330043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:14.330764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.332587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:14.332587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.332587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.332587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:14.332587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.332587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:14.335582 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:14.336083 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:14.336255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:14.337655 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:14.338178 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:14.338178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.339727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:14.339727 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.339727 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:14.339727 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.339727 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.339727 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:14.339727 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.339727 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:14.340667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.340667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:14.340667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:14.340667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:14.340667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.340667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:14.340667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:14.340667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.340667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:14.340667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:14.340667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:14.340667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.341443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:14.341443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:14.341443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:14.341443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:14.341443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:14.341443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:14.341443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:14.341443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:14.341443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.341443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:14.341443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.341443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.341443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:14.342347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.342347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:14.342810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.342810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:14.342810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:14.342810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:14.342810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:14.342810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:14.342810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.342810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:14.342810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:14.342810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.342810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:14.342810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:14.342810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.342810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:14.342810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:14.342810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.343514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.344126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:14.344126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.344126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:14.344126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:14.344126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:14.344126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:14.344126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:30:14.344404 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:14.345790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.346474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:14.346474 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.346474 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:14.346474 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.346474 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.346474 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:14.346474 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.346474 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:14.347390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.347390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:14.347390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:14.347390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:14.347390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.347390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:14.347390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:14.347390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:14.347390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.347390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:14.347390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:14.347390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:14.347390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:14.347390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:14.347390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:14.348013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:14.348013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:14.348013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.348013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:14.348013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.348013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.348013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:14.348013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.348013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:14.348511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.348511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:14.348511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:14.348511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:14.348511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.348511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:14.348511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:14.348511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:30:14.348511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:14.348511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:14.348511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.348511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:14.349004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:14.349004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:14.349004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.349004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:14.349004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:14.349004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:14.349004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:14.349004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:14.349004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:14.349004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:14.349004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:14.349004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.349004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:14.349004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.349538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.349538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:14.349538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.349538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:14.350855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.350855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:14.350855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:14.350855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:14.350855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:14.350855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:14.350855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.350855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:14.350855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:14.350855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.350855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:14.350855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:14.350855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.350855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:14.350855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:14.350855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:14.351528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:14.352113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.352113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:14.352113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.352113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.352113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:14.352113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.352113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:14.352113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:14.352113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:14.352113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:14.352545 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:14.352545 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:14.352663 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:14.352890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.353555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:14.353555 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.353555 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:14.353555 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.353555 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.353555 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:14.353555 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.353555 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:14.354724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.354724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:14.354724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:14.354724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:14.354724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.354724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:14.354724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:14.354724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:14.354724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.354724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:14.354724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:14.354724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:14.354724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:14.354724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:14.354724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:14.355160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:14.355160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:14.355160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.355160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:14.355160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.355160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.355160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:14.355160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.355160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:14.356014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.356014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:14.356014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:14.356014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:14.356014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.356014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:14.356014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:14.356014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:14.356014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:14.356014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.356014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:14.356409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:14.356409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:14.356409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.356409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:14.356409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:14.356409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:14.356409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:14.356409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:14.356409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:14.356409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:14.356409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:14.356409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.356409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:14.356409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.356801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.356801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:14.356801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.356801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.357149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:14.357838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.358345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.358345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:14.358345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.358345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:14.358345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:14.358345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:14.358345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:14.358753 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:14.359120 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:14.359382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.360138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:14.360138 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.360138 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:14.360138 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.360138 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.360138 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:14.360138 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.360138 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:14.360960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.360960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:14.360960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:14.360960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:14.360960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.360960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:14.360960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:14.360960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.360960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:14.360960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:14.360960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:14.360960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.361421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:14.361421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:14.361421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:14.361421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:14.361421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:14.361421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:14.361421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:14.361421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:14.361421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.361421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:14.361421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.361421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.361421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:14.362135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.362135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:14.362135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.362135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:14.362135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:14.362135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:14.362135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:14.362135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:14.362135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.362135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:14.362135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:14.362135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.362135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:14.362135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:14.362135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:14.362590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:14.363157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:14.363157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:14.363157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:14.363157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:14.363157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:14.363157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:19.289023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:19.289633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:19.289955 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:19.291318 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:19.336818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:19.337714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:19.337975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.338519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:19.338519 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.338519 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:19.338519 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.338519 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.338519 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:19.338519 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.338519 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:19.339355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.049 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.339355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:19.339355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:19.339355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:19.339355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.339355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:19.339355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:19.339355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.339355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:19.339355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:19.339355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:19.339355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.339635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:19.339635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:19.339635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:19.339635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:19.339635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:19.339635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:19.339635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:19.339635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:19.339635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.339635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:19.339635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.339635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.339635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:19.339882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.339882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:19.339998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.339998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:19.339998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:19.339998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:19.339998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:19.339998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:19.339998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.339998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:19.339998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:19.339998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.339998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:19.339998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:19.339998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.339998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:19.339998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:19.339998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.340343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.340738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:19.340738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.340738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:19.340738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:19.340738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:19.341027 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:19.341117 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:19.341277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.341883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:19.341883 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.341883 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:19.341883 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.341883 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.341883 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:19.341883 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.341883 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:19.342335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.342335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:19.342335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:19.342335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:19.342335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.342335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:19.342335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:19.342335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.342335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:19.342335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:19.342335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:19.342335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.342609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:19.342609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:19.342609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:19.342609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:19.342609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:19.342609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:19.342609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:19.342609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:19.342609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.342609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:19.342609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.342609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.342609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:19.342843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.342843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:19.343236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.343236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:19.343236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:19.343236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:19.343236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:19.343236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:19.343236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.343236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:19.343236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:19.343236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.343236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:19.343236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:19.343236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.343236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:19.343236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:19.343236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.343640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.343994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:19.343994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.343994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:19.343994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:19.343994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:19.344093 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:19.344123 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:30:19.344534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:19.344852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.345455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:19.345455 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.345455 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:19.345455 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.345455 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.345455 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:19.345455 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.345455 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:19.346518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.346518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:19.346518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:19.346518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:19.346518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.346518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:19.346518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:19.346518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:19.346518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.346518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:19.346518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:19.346518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:19.346518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:19.346518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:19.346518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:19.346855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:19.346855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:19.346855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.346855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:19.346855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.346855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.346855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:19.346855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.346855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:19.347733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.347733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:19.347733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:19.347733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:19.347733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.347733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:19.347733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:19.347733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:30:19.347733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:19.347733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:19.347733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.347733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:19.348002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:19.348002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:19.348002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.348002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:19.348002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:19.348002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:19.348002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:19.348002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:19.348002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:19.348002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:19.348002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:19.348002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.348002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:19.348002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.348273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.348273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:19.348273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.348273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:19.348888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.348888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:19.348888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:19.348888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:19.348888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:19.348888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:19.348888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.348888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:19.348888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:19.348888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.348888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:19.348888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:19.348888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.348888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:19.348888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:19.348888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:19.349597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:19.349903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.349903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:19.349903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.349903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.349903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:19.349903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.349903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:19.351684 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:19.352001 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:19.352115 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:19.352249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:19.352703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:19.353041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.353583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:19.353583 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.353583 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:19.353583 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.353583 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.353583 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:19.353583 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.353583 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:19.354354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.354354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:19.354354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:19.354354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:19.354354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.354354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:19.354354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:19.354354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:19.354354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.354354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:19.354354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:19.354354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:19.354354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:19.354354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:19.354354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:19.354720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:19.354720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:19.354720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.354720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:19.354720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.354720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.354720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:19.354720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.354720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:19.355432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.355432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:19.355432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:19.355432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:19.355432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.355432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:19.355432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:19.355432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:19.355432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:19.355432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.355432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:19.355683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:19.355683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:19.355683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.355683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:19.355683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:19.355683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:19.355683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:19.355683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:19.355683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:19.355683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:19.355683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:19.355683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.355683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:19.355683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.355951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.355951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:19.355951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.355951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.356687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:19.357077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.357457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.357457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:19.357457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.357457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:19.357678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:19.357920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:19.358056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:19.358216 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:19.358841 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:19.358939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:19.359130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.359813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:19.359813 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.359813 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:19.359813 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.359813 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.359813 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:19.359813 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.359813 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:19.360820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.360820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:19.360820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:19.360820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:19.360820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.360820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:19.360820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:19.360820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.360820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:19.360820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:19.360820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:19.360820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:19.361337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.361337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:19.362434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.362434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:19.362434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:19.362434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:19.362434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:19.362434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:19.362434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.362434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:19.362434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:19.362434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.362434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:19.362434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:19.362434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.362434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:19.362434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:19.362434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:19.362791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:19.363124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:19.363124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:19.363124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:24.289482 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:24.290215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:24.290215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:24.290686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:24.325238 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:24.326126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.327247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:24.327247 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.327247 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:24.327247 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.327247 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.327247 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:24.327247 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.327247 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:24.328040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.328040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:24.328040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:24.328040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:24.328040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.328040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:24.328040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:24.328040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.328040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:24.328040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:24.328040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:24.328040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.328927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:24.328927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:24.328927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:24.328927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:24.328927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:24.328927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:24.328927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:24.328927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:24.328927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.328927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:24.328927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.328927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.328927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:24.329630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.329630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:24.329630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.329630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:24.329630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:24.329630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:24.329630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:24.329630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:24.329630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.329630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:24.329630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:24.329630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.329630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:24.329630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:24.329630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:24.330457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.334842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:24.334842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.334842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.334842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:24.334842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.334842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:24.340647 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:24.340956 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:24.341041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:24.341747 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:24.341977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:24.342132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.342852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:24.342852 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.342852 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:24.342852 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.342852 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.342852 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:24.342852 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.342852 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:24.344496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.344496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:24.344496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:24.344496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:24.344496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.344496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:24.344496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:24.344496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.344496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:24.344496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:24.344496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:24.344496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.344801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:24.344801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:24.344801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:24.344801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:24.344801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:24.344801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:24.344801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:24.344801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:24.344801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.344801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:24.344801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.344801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.344801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:24.345045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.345045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:24.346338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.346338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:24.346338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:24.346338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:24.346338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:24.346338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:24.346338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.346338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:24.346338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:24.346338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.346338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:24.346338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:24.346338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.346338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:24.346338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:24.346338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.346804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.347322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:24.347322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.347322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:24.347322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:24.347322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:24.347322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:24.348212 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:30:24.348212 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:24.348212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.348935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:24.348935 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.348935 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:24.348935 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.348935 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.348935 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:24.348935 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.348935 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:24.350630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.350630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:24.350630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:24.350630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:24.350630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.350630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:24.350630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:24.350630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:24.350630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.350630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:24.350630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:24.350630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:24.350630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:24.350630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:24.350630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:24.351153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:24.351153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:24.351153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.351153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:24.351153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.351153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.351153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:24.351153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.351153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:24.351556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.351556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:24.351556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:24.351556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:24.351556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.351556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:24.351556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:24.351556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:30:24.351556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:24.351556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:24.351556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.351556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:24.351953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:24.351953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:24.351953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.351953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:24.351953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:24.351953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:24.351953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:24.351953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:24.351953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:24.351953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:24.351953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:24.351953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.351953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:24.351953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.352335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.352335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:24.352335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.352335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:24.352769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.352769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:24.352769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:24.352769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:24.352769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:24.352769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:24.352769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.352769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:24.352769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:24.352769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.352769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:24.352769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:24.352769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.352769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:24.352769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:24.352769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:24.353241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:24.353986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.353986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:24.353986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.353986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.353986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:24.353986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.353986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:24.353986 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:24.353986 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:24.353986 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:24.354311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:24.354311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:24.354311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.355073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:24.355073 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.355073 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:24.355073 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.355073 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.355073 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:24.355073 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.355073 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:24.355606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.355606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:24.355606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:24.355606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:24.355606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.355606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:24.355606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:24.355606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:24.355606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.355606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:24.355606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:24.355606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:24.355606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:24.355606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:24.355606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:24.355906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:24.355906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:24.355906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.355906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:24.355906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.355906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.355906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:24.355906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.355906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:24.356559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.356559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:24.356559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:24.356559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:24.356559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.356559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:24.356559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:24.356559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:24.356559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:24.356559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.356559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:24.356826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:24.356826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:24.356826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.356826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:24.356826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:24.356826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:24.356826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:24.356826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:24.356826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:24.356826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:24.356826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:24.356826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.356826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:24.356826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.357089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.357089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:24.357089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.357089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.357797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:24.358168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.358562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.358562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:24.358562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.358562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:24.358562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:24.358562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:24.358562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:24.358562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:24.358970 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:24.359253 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:24.359442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.359983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:24.359983 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.359983 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:24.359983 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.359983 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.359983 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:24.359983 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.359983 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:24.362669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.362669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:24.362669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:24.362669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:24.362669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.362669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:24.362669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:24.362669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.362669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:24.362669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:24.362669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:24.362669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.362979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:24.362979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:24.362979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:24.362979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:24.362979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:24.362979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:24.362979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:24.362979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:24.362979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.362979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:24.362979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.362979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.362979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:24.363211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.363211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:24.363211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.363211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:24.363211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:24.363211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:24.363211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:24.363211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:24.363211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.363211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:24.363211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:24.363211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.363211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:24.363211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:24.363211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:24.363510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:24.363842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:24.363842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:24.363842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:24.363842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:24.363842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:24.363842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:29.290145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:29.290939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:29.290939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:29.292088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:29.331849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:29.332612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.333702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:29.333702 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.333702 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:29.333702 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.333702 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.333702 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:29.333702 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.333702 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:29.334725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.334725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:29.334725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:29.334725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:29.334725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.334725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:29.334725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:29.334725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.334725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:29.334725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:29.334725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:29.334725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.335311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:29.335311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:29.335311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:29.335311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:29.335311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:29.335311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:29.335311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:29.335311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:29.335311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.335311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:29.335311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.335311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.335311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:29.335828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.335828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:29.335828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.335828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:29.335828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:29.335828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:29.335828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:29.335828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:29.335828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.335828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:29.335828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:29.335828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.335828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:29.335828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:29.335828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:29.336332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.337137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:29.337137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.337137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.337137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:29.337137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.337137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:29.341386 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:29.342471 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:29.342711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:29.343979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:29.344261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:29.344462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.345423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:29.345423 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.345423 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:29.345423 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.345423 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.345423 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:29.345423 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.345423 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:29.347213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.347213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:29.347213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:29.347213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:29.347213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.347213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:29.347213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:29.347213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.347213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:29.347213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:29.347213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:29.347213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.347937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:29.347937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:29.347937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:29.347937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:29.347937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:29.347937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:29.347937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:29.347937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:29.347937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.347937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:29.347937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.347937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.347937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:29.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:29.349515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.349515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:29.349515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:29.349515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:29.349515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:29.349515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:29.349515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.349515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:29.349515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:29.349515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.349515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:29.349515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:29.349515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.349515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:29.349515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:29.349515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.350402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.351506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:29.351506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.351506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:29.351506 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:29.351506 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:29.351506 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:29.351506 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:30:29.352868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:29.353134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.353492 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:29.354148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:29.354148 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.354148 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:29.354148 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.354148 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.354148 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:29.354148 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.354148 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:29.355067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.355067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:29.355067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:29.355067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:29.355067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.355067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:29.355067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:29.355067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:29.355067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.355067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:29.355067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:29.355067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:29.355067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:29.355067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:29.355067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:29.355780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:29.355780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:29.355780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.355780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:29.355780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.355780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.355780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:29.355780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.355780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:29.356323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.356323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:29.356323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:29.356323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:29.356323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.356323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:29.356323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:29.356323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:30:29.356323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:29.356323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:29.356323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.356323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:29.356960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:29.356960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:29.356960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.356960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:29.356960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:29.356960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:29.356960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:29.356960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:29.356960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:29.356960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:29.356960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:29.356960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.356960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:29.356960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.357321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.357321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:29.357321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.357321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:29.357565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.357565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:29.357565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:29.357565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:29.357565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:29.357565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:29.357565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.357565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:29.357565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:29.357565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.357565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:29.357565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:29.357565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.357565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:29.357565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:29.357565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:29.358194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:29.358797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.358797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:29.358797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.358797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.358797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:29.358797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.358797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:29.358797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:29.358797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:29.358797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:29.359517 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:29.360026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:29.360301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.360990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:29.360990 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.360990 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:29.360990 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.360990 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.360990 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:29.360990 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.360990 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:29.361742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.361742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:29.361742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:29.361742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:29.361742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.361742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:29.361742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:29.361742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:29.361742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.361742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:29.361742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:29.361742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:29.361742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:29.361742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:29.361742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:29.362119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:29.362119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:29.362119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.362119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:29.362119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.362119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.362119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:29.362119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.362119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:29.362623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.362623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:29.362623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:29.362623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:29.362623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.362623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:29.362623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:29.362623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:29.362623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:29.362623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.362623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:29.362964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:29.362964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:29.362964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.362964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:29.362964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:29.362964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:29.362964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:29.362964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:29.362964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:29.362964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:29.362964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:29.362964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.362964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:29.362964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.363538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.363538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:29.363538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.363538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.363680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:29.364398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.365009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.365009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:29.365009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.365009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:29.365009 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:29.365009 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:29.365009 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:29.365009 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:29.365259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:29.365259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.365466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:29.365466 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.365466 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:29.365466 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.365466 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.365466 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:29.365466 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.365466 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:29.366261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.366261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:29.366261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:29.366261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:29.366261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.366261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:29.366261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:29.366261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.366261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:29.366261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:29.366261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:29.366261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.366718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:29.366718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:29.366718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:29.366718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:29.366718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:29.366718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:29.366718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:29.366718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:29.366718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.366718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:29.366718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.366718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.366718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:29.367257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.367257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:29.367985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.367985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:29.367985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:29.367985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:29.367985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:29.367985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:29.367985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.367985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:29.367985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:29.367985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.367985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:29.367985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:29.367985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.367985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:29.367985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:29.367985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:29.368438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:29.368969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:29.368969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:29.368969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:34.290804 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:34.291488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:34.291488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:34.292068 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:34.332661 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:34.332823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.333447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:34.333447 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.333447 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:34.333447 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.333447 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.333447 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:34.333447 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.333447 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:34.334215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.334215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:34.334215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:34.334215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:34.334215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.334215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:34.334215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:34.334215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.334215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:34.334215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:34.334215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:34.334215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.334647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:34.334647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:34.334647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:34.334647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:34.334647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:34.334647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:34.334647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:34.334647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:34.334647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.334647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:34.334647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.334647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.334647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:34.335034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.335034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:34.335034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.335034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:34.335034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:34.335034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:34.335034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:34.335034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:34.335034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.335034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:34.335034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:34.335034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.335034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:34.335034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:34.335034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:34.335591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.336268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:34.336268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.336268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.336268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:34.336268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.336268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:34.342686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:34.342899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:34.343052 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:34.343958 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:34.344174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:34.344298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.345022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:34.345022 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.345022 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:34.345022 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.345022 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.345022 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:34.345022 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.345022 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:34.346247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.346247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:34.346247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:34.346247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:34.346247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.346247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:34.346247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:34.346247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.346247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:34.346247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:34.346247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:34.346247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.346660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:34.346660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:34.346660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:34.346660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:34.346660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:34.346660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:34.346660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:34.346660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:34.346660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.346660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:34.346660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.346660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.346660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:34.347048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.347048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:34.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:34.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:34.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:34.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:34.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:34.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:34.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:34.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:34.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:34.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:34.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:34.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.350522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:34.350522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.350522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:34.351105 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:34.351502 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:34.351623 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:34.351741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:30:34.354966 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:34.355153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.355730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:34.355730 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.355730 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:34.355730 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.355730 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.355730 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:34.355730 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.355730 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:34.356789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.356789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:34.356789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:34.356789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:34.356789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.356789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:34.356789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:34.356789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:34.356789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.356789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:34.356789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:34.356789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:34.356789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:34.356789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:34.356789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:34.357408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:34.357408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:34.357408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.357408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:34.357408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.357408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.357408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:34.357408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.357408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:34.357850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.357850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:34.357850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:34.357850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:34.357850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.357850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:34.357850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:34.357850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:30:34.357850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:34.357850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:34.357850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.357850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:34.358274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:34.358274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:34.358274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.358274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:34.358274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:34.358274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:34.358274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:34.358274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:34.358274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:34.358274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:34.358274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:34.358274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.358274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:34.358274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.359497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.359497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:34.359497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.359497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:34.359497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.359497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:34.359497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:34.359497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:34.359497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:34.359497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:34.359497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.359497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:34.359497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:34.359497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:34.359869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:34.360537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:34.360537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:34.360537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:34.360537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:34.360537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:34.360537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.360537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:34.360537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.360537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.360537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:34.360537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.360537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:34.360537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:34.360537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:34.360950 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:34.360950 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:34.360950 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:34.360950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.360950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:34.360950 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.360950 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:34.360950 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.360950 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.360950 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:34.360950 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.360950 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:34.361796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.361796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:34.361796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:34.361796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:34.361796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.361796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:34.361796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:34.361796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:34.361796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.361796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:34.361796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:34.361796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:34.361796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:34.361796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:34.361796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:34.362225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:34.362225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:34.362225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.362225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:34.362225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.362225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.362225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:34.362225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.362225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:34.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:34.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:34.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:34.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:34.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:34.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:34.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:34.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:34.363005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:34.363005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:34.363005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.363005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:34.363005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:34.363005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:34.363005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:34.363005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:34.363005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:34.363005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:34.363005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:34.363005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.363005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:34.363005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.363394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.363394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:34.363394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.363394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.363700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:34.364299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.365856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.365856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:34.365856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.365856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:34.365856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:34.365856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:34.365856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:34.366141 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:34.366391 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:34.366834 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:34.366999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.367735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:34.367735 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.367735 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:34.367735 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.367735 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.367735 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:34.367735 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.367735 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:34.368720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.368720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:34.368720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:34.368720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:34.368720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.368720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:34.368720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:34.368720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.368720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:34.368720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:34.368720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:34.368720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.369067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:34.369067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:34.369067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:34.369067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:34.369067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:34.369067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:34.369067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:34.369067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:34.369067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.369067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:34.369067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.369067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.369067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:34.369358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.369358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:34.369707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.369707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:34.369707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:34.369707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:34.369707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:34.369707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:34.369707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.369707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:34.369707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:34.369707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.369707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:34.369707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:34.369707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.369707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:34.369707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:34.369707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:34.370309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:34.370858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:34.370858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:34.370858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:39.291280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:39.291930 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:39.291988 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:39.292831 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:39.329272 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:39.329272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.331636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:39.331636 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.331636 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:39.331636 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.331636 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.331636 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:39.331636 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.331636 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:39.332717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.332717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:39.332717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:39.332717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:39.332717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.332717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:39.332717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:39.332717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.332717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:39.332717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:39.332717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:39.332717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.333429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:39.333429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:39.333429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:39.333429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:39.333429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:39.333429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:39.333429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:39.333429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:39.333429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.333429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:39.333429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.333429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.333429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:39.334225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.334225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:39.334225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.334225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:39.334225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:39.334225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:39.334225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:39.334225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:39.334225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.334225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:39.334225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:39.334225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.334225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:39.334225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:39.334225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:39.335020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.335646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:39.335646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.335646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.335646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:39.335646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.335646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:39.343135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:39.343572 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:39.343658 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:39.345443 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:39.345443 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:39.345443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.345916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:39.345916 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.345916 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:39.345916 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.345916 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.345916 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:39.345916 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.345916 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:39.346473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.346473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:39.346473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:39.346473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:39.346473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.346473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:39.346473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:39.346473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.346473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:39.346473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:39.346473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:39.346473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.347009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:39.347009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:39.347009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:39.347009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:39.347009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:39.347009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:39.347009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:39.347009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:39.347009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.347009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:39.347009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.347009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.347009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:39.347544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.347544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:39.347544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.347544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:39.347544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:39.347544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:39.347544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:39.347544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:39.347544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.347544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:39.347544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:39.347544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.347544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:39.347544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:39.347544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:39.348361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.349181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:39.349181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.349181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.349181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:39.349181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.349181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:39.351579 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:39.352659 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:39.352730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:39.352828 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:30:39.353800 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:39.353800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.353925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:39.353925 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.353925 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:39.353925 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.353925 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.353925 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:39.353925 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.353925 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:39.354603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.354603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:39.354603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:39.354603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:39.354603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.354603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:39.354603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:39.354603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:39.354603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.354603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:39.354603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:39.354603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:39.354603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:39.354603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:39.354603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:39.355203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:39.355203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:39.355203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.355203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:39.355203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.355203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.355203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:39.355203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.355203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:39.355203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.355203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:39.355203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:39.355203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:39.355203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.355644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:39.355644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:39.355644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:30:39.355644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:39.355644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:39.355644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.355644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:39.355644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:39.355644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:39.355644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.355644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:39.355644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:39.355644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:39.356031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:39.356031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:39.356031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:39.356031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:39.356031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:39.356031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.356031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:39.356031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.356031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.356031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:39.356031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.356031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:39.356400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.356400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:39.356400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:39.356400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:39.356400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:39.356400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:39.356400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.356400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:39.356400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:39.356400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.356400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:39.356400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:39.356400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.356400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:39.356400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:39.356400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:39.356857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:39.357425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.357425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:39.357425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.357425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.357425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:39.357425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.357425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:39.361174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:39.361604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:39.361758 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:39.361980 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:39.363024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:39.363024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.363193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:39.363193 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.363193 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:39.363193 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.363193 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.363193 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:39.363193 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.363193 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:39.364266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.364266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:39.364266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:39.364266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:39.364266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.364266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:39.364266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:39.364266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:39.364266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.364266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:39.364266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:39.364266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:39.364266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:39.364266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:39.364266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:39.364819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:39.364819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:39.364819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.364819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:39.364819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.364819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.364819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:39.364819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.364819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:39.368747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.368747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:39.368747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:39.368747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:39.368747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.368747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:39.368747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:39.368747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:39.368747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:39.368747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.368747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:39.369278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:39.369278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:39.369278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.369278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:39.369278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:39.369278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:39.369278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:39.369278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:39.369278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:39.369278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:39.369278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:39.369278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.369278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:39.369278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.369907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.369907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:39.369907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.369907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:39.369907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.369907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:39.369907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:39.369907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:39.369907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:39.369907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:39.369907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.369907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:39.369907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:39.369907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:39.370409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:39.370986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:39.370986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:39.370986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:39.370986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:39.370986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.370986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:39.370986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.370986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.370986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:39.370986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.370986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:39.370986 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:39.370986 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:39.371385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:39.371385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:39.372604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:39.372604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:39.372604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.372753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:39.372753 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.372753 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:39.372753 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.372753 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.372753 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:39.372753 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.372753 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:39.373537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.373537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:39.373537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:39.373537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:39.373537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.373537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:39.373537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:39.373537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.373537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:39.373537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:39.373537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:39.373537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.373974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:39.373974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:39.373974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:39.373974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:39.373974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:39.373974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:39.373974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:39.373974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:39.373974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.373974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:39.373974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.373974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.373974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:39.374326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.374326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:39.374530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.374530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:39.374530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:39.374530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:39.374530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:39.374530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:39.374530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.374530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:39.374530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:39.374530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.374530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:39.374530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:39.374530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.374530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:39.374530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:39.374530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:39.374987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:39.375522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:39.375522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:39.375522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:44.292127 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:44.292127 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:44.292127 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:44.293577 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:44.336884 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:44.337111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.338421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:44.338421 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.338421 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:44.338421 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.338421 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.338421 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:44.338421 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.338421 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:44.338807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.045 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.338807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:44.338807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:44.338807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:44.338807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.338807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:44.338807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:44.338807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.338807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:44.338807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:44.338807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:44.338807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.339350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:44.339350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:44.339350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:44.339350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:44.339350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:44.339350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:44.339350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:44.339350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:44.339350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.339350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:44.339350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.339350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.339350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:44.339911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.339911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:44.339911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.339911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:44.339911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:44.339911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:44.339911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:44.339911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:44.339911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.339911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:44.339911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:44.339911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.339911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:44.339911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:44.339911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:44.340580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.341761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:44.341761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.341761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.341761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:44.341761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.341761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:44.343969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:44.343969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:44.343969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:44.344808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:44.345027 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:44.345187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.345778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:44.345778 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.345778 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:44.345778 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.345778 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.345778 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:44.345778 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.345778 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:44.346873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.346873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:44.346873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:44.346873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:44.346873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.346873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:44.346873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:44.346873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.346873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:44.346873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:44.346873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:44.346873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.347291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:44.347291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:44.347291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:44.347291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:44.347291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:44.347291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:44.347291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:44.347291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:44.347291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.347291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:44.347291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.347291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.347291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:44.347647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.347647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:44.347972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.347972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:44.347972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:44.347972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:44.347972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:44.347972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:44.347972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.347972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:44.347972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:44.347972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.347972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:44.347972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:44.347972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.347972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:44.347972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:44.347972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.348533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.349131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:44.349131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.349131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:44.352771 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:44.353113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:44.353295 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:44.353507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:30:44.354140 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:44.354484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.355507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:44.355507 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.355507 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:44.355507 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.355507 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.355507 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:44.355507 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.355507 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:44.356543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.356543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:44.356543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:44.356543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:44.356543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.356543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:44.356543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:44.356543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:44.356543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.356543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:44.356543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:44.356543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:44.356543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:44.356543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:44.356543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:44.357018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:44.357018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:44.357018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.357018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:44.357018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.357018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.357018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:44.357018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.357018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:44.357738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.357738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:44.357738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:44.357738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:44.357738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.357738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:44.357738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:44.357738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:30:44.357738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:44.357738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:44.357738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.357738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:44.358094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:44.358094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:44.358094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.358094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:44.358094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:44.358094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:44.358094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:44.358094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:44.358094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:44.358094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:44.358094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:44.358094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.358094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:44.358094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.358423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.358423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:44.358423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.358423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:44.358823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.358823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:44.358823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:44.358823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:44.358823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:44.358823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:44.358823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.358823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:44.358823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:44.358823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.358823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:44.358823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:44.358823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.358823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:44.358823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:44.358823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:44.359282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:44.359669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.359669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:44.359669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.359669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.359669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:44.359669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.359669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:44.362484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:44.362484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:44.362484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:44.362484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:44.362808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:44.363237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.364008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:44.364008 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.364008 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:44.364008 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.364008 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.364008 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:44.364008 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.364008 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:44.364930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.364930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:44.364930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:44.364930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:44.364930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.364930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:44.364930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:44.364930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:44.364930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.364930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:44.364930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:44.364930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:44.364930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:44.364930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:44.364930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:44.365426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:44.365426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:44.365426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.365426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:44.365426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.365426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.365426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:44.365426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.365426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:44.365941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.365941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:44.365941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:44.365941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:44.365941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.365941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:44.365941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:44.365941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:44.365941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:44.365941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.365941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:44.366298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:44.366298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:44.366298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.366298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:44.366298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:44.366298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:44.366298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:44.366298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:44.366298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:44.366298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:44.366298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:44.366298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.366298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:44.366298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.366701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.366701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:44.366701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.366701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.367118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:44.367688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.368288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.368288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:44.368288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.368288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:44.369733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:44.370001 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:44.370124 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:44.370300 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:44.370806 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:44.371297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:44.371635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.372540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:44.372540 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.372540 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:44.372540 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.372540 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.372540 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:44.372540 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.372540 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:44.373496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.373496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:44.373496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:44.373496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:44.373496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.373496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:44.373496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:44.373496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.373496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:44.373496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:44.373496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:44.373496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.373856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:44.373856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:44.373856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:44.373856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:44.373856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:44.373856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:44.373856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:44.373856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:44.373856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.373856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:44.373856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.373856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.373856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:44.374219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.374219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:44.374577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.374577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:44.374577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:44.374577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:44.374577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:44.374577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:44.374577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.374577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:44.374577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:44.374577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.374577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:44.374577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:44.374577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.374577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:44.374577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:44.374577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:44.375058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:44.375749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:44.375749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:44.375749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:49.294397 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:49.295013 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:49.295013 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:49.295790 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:49.334566 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:49.334851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.335351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:49.335351 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.335351 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:49.335351 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.335351 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.335351 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:49.335351 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.335351 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:49.336029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.336029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:49.336029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:49.336029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:49.336029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.336029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:49.336029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:49.336029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.336029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:49.336029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:49.336029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:49.336029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.336481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:49.336481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:49.336481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:49.336481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:49.336481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:49.336481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:49.336481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:49.336481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:49.336481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.336481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:49.336481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.336481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.336481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:49.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:49.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:49.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:49.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:49.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:49.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:49.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:49.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:49.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:49.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:49.336984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:49.337485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.338168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:49.338168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.338168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.338168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:49.338168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.338168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:49.343916 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:49.344123 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:49.344192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:49.344805 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:49.345007 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:49.345211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.345849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:49.345849 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.345849 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:49.345849 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.345849 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.345849 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:49.345849 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.345849 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:49.347208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.347208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:49.347208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:49.347208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:49.347208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.347208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:49.347208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:49.347208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.347208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:49.347208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:49.347208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:49.347208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.347611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:49.347611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:49.347611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:49.347611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:49.347611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:49.347611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:49.347611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:49.347611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:49.347611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.347611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:49.347611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.347611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.347611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:49.347967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.347967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:49.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:49.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:49.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:49.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:49.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:49.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:49.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:49.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:49.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:49.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:49.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:49.348899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.349318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.349756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:49.349756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.349756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:49.353242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:49.353622 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:49.353772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:49.353936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:30:49.355056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:49.355266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.355822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:49.355822 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.355822 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:49.355822 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.355822 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.355822 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:49.355822 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.355822 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:49.356743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.356743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:49.356743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:49.356743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:49.356743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.356743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:49.356743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:49.356743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:49.356743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.356743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:49.356743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:49.356743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:49.356743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:49.356743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:49.356743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:49.357177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:49.357177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:49.357177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.357177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:49.357177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.357177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.357177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:49.357177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.357177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:49.357837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.357837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:49.357837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:49.357837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:49.357837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.357837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:49.357837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:49.357837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:30:49.357837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:49.357837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:49.357837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.357837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:49.358182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:49.358182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:49.358182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.358182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:49.358182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:49.358182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:49.358182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:49.358182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:49.358182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:49.358182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:49.358182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:49.358182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.358182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:49.358182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.358567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.358567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:49.358567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.358567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:49.359162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.359162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:49.359162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:49.359162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:49.359162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:49.359162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:49.359162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.359162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:49.359162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:49.359162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.359162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:49.359162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:49.359162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.359162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:49.359162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:49.359162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:49.359615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:49.360090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.360090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:49.360090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.360090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.360090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:49.360090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.360090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:49.362086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:49.362328 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:49.362494 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:49.362663 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:49.363019 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:49.363277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.363954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:49.363954 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.363954 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:49.363954 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.363954 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.363954 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:49.363954 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.363954 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:49.364823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.364823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:49.364823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:49.364823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:49.364823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.364823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:49.364823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:49.364823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:49.364823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.364823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:49.364823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:49.364823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:49.364823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:49.364823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:49.364823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:49.365239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:49.365239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:49.365239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.365239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:49.365239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.365239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.365239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:49.365239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.365239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:49.365969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.365969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:49.365969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:49.365969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:49.365969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.365969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:49.365969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:49.365969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:49.365969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:49.365969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.365969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:49.366302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:49.366302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:49.366302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.366302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:49.366302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:49.366302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:49.366302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:49.366302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:49.366302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:49.366302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:49.366302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:49.366302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.366302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:49.366302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.366714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.366714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:49.366714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.366714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.367340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:49.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.368387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.368387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:49.368387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.368387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:49.370036 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:49.370299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:49.370470 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:49.370668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:49.370964 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:49.371197 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:49.371343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.371835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:49.371835 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.371835 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:49.371835 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.371835 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.371835 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:49.371835 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.371835 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:49.372790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.372790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:49.372790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:49.372790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:49.372790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.372790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:49.372790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:49.372790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.372790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:49.372790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:49.372790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:49.372790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.373064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:49.373064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:49.373064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:49.373064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:49.373064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:49.373064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:49.373064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:49.373064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:49.373064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.373064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:49.373064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.373064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.373064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:49.373348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.373348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:49.374066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.374066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:49.374066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:49.374066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:49.374066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:49.374066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:49.374066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.374066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:49.374066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:49.374066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.374066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:49.374066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:49.374066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.374066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:49.374066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:49.374066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:49.374408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:49.374759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:49.374759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:49.374759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:54.295184 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:54.295976 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:54.295976 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:54.296776 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:54.298308 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=470,neutron:UPDATE=2 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:30:54.332746 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:54.333018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.336157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:54.336157 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.336157 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:54.336157 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.336157 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.336157 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:54.336157 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.336157 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:54.336944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.336944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:54.336944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:54.336944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:54.336944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.336944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:54.336944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:54.336944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.336944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:54.336944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:54.336944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:54.336944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.337601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:54.337601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:54.337601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:54.337601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:54.337601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:54.337601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:54.337601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:54.337601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:54.337601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.337601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:54.337601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.337601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.337601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:54.338164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.338164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:54.338164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.338164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:54.338164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:54.338164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:54.338164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:54.338164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:54.338164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.338164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:54.338164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:54.338164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.338164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:54.338164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:54.338164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:54.338854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.339591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:54.339591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.339591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.339591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:54.339591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.339591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:54.344463 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:54.344744 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:54.344817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:54.345570 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:54.345751 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:54.345899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.346530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:54.346530 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.346530 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:54.346530 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.346530 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.346530 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:54.346530 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.346530 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:54.347247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.347247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:54.347247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:54.347247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:54.347247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.347247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:54.347247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:54.347247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.347247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:54.347247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:54.347247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:54.347247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.347703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:54.347703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:54.347703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:54.347703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:54.347703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:54.347703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:54.347703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:54.347703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:54.347703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.347703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:54.347703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.347703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.347703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:54.348076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.348076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:54.348076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.348076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:54.348076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:54.348076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:54.348076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:54.348076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:54.348076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.348076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:54.348076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:54.348076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.348076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:54.348076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:54.348076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:54.348573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.349417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:54.349417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.349417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.349417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:54.349417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.349417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:54.353750 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:54.354029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:54.354182 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:54.354229 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:30:54.354690 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:54.354887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.356278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:54.356278 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.356278 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:54.356278 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.356278 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.356278 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:54.356278 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.356278 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:54.358082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.358082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:54.358082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:54.358082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:54.358082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.358082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:54.358082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:54.358082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:54.358082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.358082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:54.358082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:54.358082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:54.358082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:54.358082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:54.358082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:54.359424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:54.359424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:54.359424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.359424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:54.359424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.359424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.359424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:54.359424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.359424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:54.359919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.359919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:54.359919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:54.359919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:54.359919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.359919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:54.359919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:54.359919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:30:54.359919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:54.359919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:54.359919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.359919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:54.360259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:54.360259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:54.360259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.360259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:54.360259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:54.360259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:54.360259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:54.360259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:54.360259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:54.360259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:54.360259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:54.360259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.360259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:54.360259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.360686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.360686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:54.360686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.360686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:54.362091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.362091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:54.362091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:54.362091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:54.362091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:54.362091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:54.362091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.362091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:54.362091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:54.362091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.362091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:54.362091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:54.362091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.362091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:54.362091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:54.362091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:54.362692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:54.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:54.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:54.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:54.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:54.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:54.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:54.363546 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:54.363876 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:54.364103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.364763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:54.364763 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.364763 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:54.364763 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.364763 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.364763 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:54.364763 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.364763 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:54.365562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.365562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:54.365562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:54.365562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:54.365562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.365562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:54.365562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:54.365562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:54.365562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.365562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:54.365562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:54.365562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:54.365562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:54.365562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:54.365562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:54.366243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:54.366243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:54.366243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.366243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:54.366243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.366243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.366243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:54.366243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.366243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:54.366742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.366742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:54.366742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:54.366742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:54.366742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.366742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:54.366742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:54.366742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:54.366742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:54.366742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.366742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:54.367084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:54.367084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:54.367084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.367084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:54.367084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:54.367084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:54.367084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:54.367084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:54.367084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:54.367084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:54.367084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:54.367084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.367084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:54.367084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.367593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.367593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:54.367593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.367593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.367954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:54.368466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.369025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.369025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:54.369025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.369025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:54.370417 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:54.370671 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:54.370781 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:54.370977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:54.371303 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:54.371558 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:54.371671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.372161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:54.372161 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.372161 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:54.372161 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.372161 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.372161 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:54.372161 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.372161 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:54.373010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.373010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:54.373010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:54.373010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:54.373010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.373010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:54.373010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:54.373010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.373010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:54.373010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:54.373010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:54.373010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.373419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:54.373419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:54.373419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:54.373419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:54.373419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:54.373419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:54.373419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:54.373419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:54.373419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.373419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:54.373419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.373419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.373419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:54.373942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.373942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:54.374154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.374154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:54.374154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:54.374154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:54.374154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:54.374154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:54.374154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.374154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:54.374154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:54.374154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.374154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:54.374154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:54.374154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.374154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:54.374154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:54.374154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:54.374715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:54.375289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:54.375289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:54.375289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:59.296199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:59.297110 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:59.297229 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:59.298450 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:59.343306 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:59.343620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.344300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:59.344300 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.344300 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:59.344300 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.344300 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.344300 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:59.344300 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.344300 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:59.346545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.047 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.346545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:59.346545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:59.346545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:59.346545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.346545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:59.346545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:59.346545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.346545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:59.346545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:59.346545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:59.346545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.347020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:59.347020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:59.347020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:59.347020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:59.347020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:59.347020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:59.347020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:59.347020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:59.347020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.347020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:59.347020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.347020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.347020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:59.347474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.347474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:59.347474 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:59.347474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.347474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:59.347474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:59.347474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:59.347474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:59.347474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:59.347474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.347474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:59.347474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:59.347474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:59.347978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:59.348655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:59.348655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:59.348655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.348655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:59.348655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.348655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.348655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:59.348655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.348655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:59.348655 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:59.348655 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:59.348655 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:59.349215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:59.349215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.349215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:59.349215 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.349215 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:59.349215 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.349215 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.349215 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:59.349215 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.349215 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:59.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:59.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:59.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:59.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:59.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:59.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:59.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:59.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:59.349703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.350193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:59.350193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:59.350193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:59.350193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:59.350193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:59.350193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:59.350193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:59.350193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:59.350193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.350193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:59.350193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.350193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.350193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:59.350853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.350853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:59.350853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.350853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:59.350853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:59.350853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:59.350853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:59.350853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:59.350853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.350853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:59.350853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:59.350853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.350853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:59.350853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:59.350853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:59.351668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.352604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:59.352604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.352604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.352604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:59.352604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.352604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:59.354045 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:59.354286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:59.354413 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:59.354546 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:30:59.355826 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:59.355985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.356438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:59.356438 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.356438 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:59.356438 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.356438 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.356438 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:59.356438 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.356438 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:59.357204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.357204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:59.357204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:59.357204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:59.357204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.357204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:59.357204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:59.357204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:59.357204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.357204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:59.357204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:59.357204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:59.357204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:59.357204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:59.357204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:59.357731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:59.357731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:59.357731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.357731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:59.357731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.357731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.357731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:59.357731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.357731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:59.358075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.358075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:59.358075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:59.358075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:59.358075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.358075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:59.358075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:59.358075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:30:59.358075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:59.358075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:59.358075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.358075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:59.358449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:59.358449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:59.358449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.358449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:59.358449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:59.358449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:59.358449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:59.358449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:59.358449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:59.358449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:59.358449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:59.358449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.358449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:59.358449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.358807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.358807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:59.358807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.358807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:59.359126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.359126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:59.359126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:59.359126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:59.359126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:59.359126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:59.359126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.359126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:59.359126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:59.359126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.359126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:59.359126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:59.359126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.359126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:59.359126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:59.359126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:59.359663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:59.360260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.360260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:59.360260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.360260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.360260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:59.360260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.360260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:59.362892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:59.363162 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:59.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:59.363454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:59.363855 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:59.364149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.364723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:59.364723 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.364723 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:59.364723 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.364723 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.364723 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:59.364723 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.364723 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:59.365501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.365501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:30:59.365501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:59.365501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:59.365501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.365501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:59.365501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:59.365501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:59.365501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.365501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:30:59.365501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:59.365501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:30:59.365501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:59.365501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:30:59.365501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:30:59.366002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:59.366002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:30:59.366002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.366002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:30:59.366002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.366002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.366002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:30:59.366002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.366002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:30:59.366454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.366454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:59.366454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:59.366454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:59.366454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.366454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:59.366454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:59.366454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:59.366454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:59.366454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.366454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:59.367002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:59.367002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:59.367002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.367002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:59.367002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:59.367002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:59.367002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:59.367002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:59.367002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:59.367002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:59.367002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:59.367002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.367002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:59.367002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.367420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.367420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:59.367420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.367420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.367692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:59.368226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.368772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.368772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:59.368772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.368772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:30:59.370755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:30:59.371022 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:30:59.371146 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:30:59.371325 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:30:59.371678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:59.371891 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:30:59.372036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.372528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:30:59.372528 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.372528 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:30:59.372528 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.372528 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.372528 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:30:59.372528 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.372528 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:30:59.373409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.373409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:30:59.373409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:59.373409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:30:59.373409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.373409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:59.373409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:59.373409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.373409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:59.373409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:59.373409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:59.373409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.373803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:30:59.373803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:59.373803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:30:59.373803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:59.373803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:30:59.373803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:30:59.373803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:59.373803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:30:59.373803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.373803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:30:59.373803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.373803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.373803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:30:59.374174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.374174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:30:59.374437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.374437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:30:59.374437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:30:59.374437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:30:59.374437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:30:59.374437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:30:59.374437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.374437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:30:59.374437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:30:59.374437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.374437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:30:59.374437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:30:59.374437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.374437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:30:59.374437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:30:59.374437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:30:59.375021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:30:59.375737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:30:59.375737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:30:59.375737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:04.296965 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:04.297686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:04.297686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:04.298634 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:04.340081 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:04.340319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.341132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:04.341132 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.341132 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:04.341132 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.341132 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.341132 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:04.341132 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.341132 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:04.342124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.044 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.342124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:04.342124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:04.342124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:04.342124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.342124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:04.342124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:04.342124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.342124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:04.342124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:04.342124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:04.342124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.342663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:04.342663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:04.342663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:04.342663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:04.342663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:04.342663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:04.342663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:04.342663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:04.342663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.342663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:04.342663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.342663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.342663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:04.343101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.343101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:04.343309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.343309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:04.343309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:04.343309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:04.343309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:04.343309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:04.343309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.343309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:04.343309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:04.343309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.343309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:04.343309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:04.343309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.343309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:04.343309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:04.343309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.344157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.345279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:04.345279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.345279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:04.347077 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:04.347329 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:04.347457 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:04.348188 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:04.348462 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:04.348636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.349196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:04.349196 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.349196 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:04.349196 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.349196 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.349196 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:04.349196 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.349196 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:04.350034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.350034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:04.350034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:04.350034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:04.350034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.350034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:04.350034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:04.350034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.350034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:04.350034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:04.350034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:04.350034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.350552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:04.350552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:04.350552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:04.350552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:04.350552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:04.350552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:04.350552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:04.350552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:04.350552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.350552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:04.350552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.350552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.350552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:04.351036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.351036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:04.351036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.351036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:04.351036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:04.351036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:04.351036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:04.351036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:04.351036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.351036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:04.351036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:04.351036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.351036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:04.351036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:04.351036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:04.351651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.352400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:04.352400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.352400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.352400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:04.352400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.352400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:04.356014 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:04.356315 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:04.356439 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:04.356563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:31:04.357034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:04.357382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.358083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:04.358083 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.358083 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:04.358083 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.358083 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.358083 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:04.358083 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.358083 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:04.358755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.358755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:04.358755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:04.358755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:04.358755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.358755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:04.358755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:04.358755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:04.358755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.358755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:04.358755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:04.358755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:04.358755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:04.358755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:04.358755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:04.359131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:04.359131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:04.359131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.359131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:04.359131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.359131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.359131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:04.359131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.359131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:04.359522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.359522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:04.359522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:04.359522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:04.359522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.359522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:04.359522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:04.359522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:31:04.359522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:04.359522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:04.359522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.359522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:04.360075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:04.360075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:04.360075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.360075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:04.360075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:04.360075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:04.360075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:04.360075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:04.360075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:04.360075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:04.360075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:04.360075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.360075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:04.360075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.360348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.360348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:04.360348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.360348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:04.360489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.360489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:04.360489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:04.360489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:04.360489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:04.360489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:04.360489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.360489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:04.360489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:04.360489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.360489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:04.360489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:04.360489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.360489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:04.360489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:04.360489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:04.360851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:04.361215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.361215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:04.361215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.361215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.361215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:04.361215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.361215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:04.363273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:04.363635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:04.363821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:04.363998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:04.364512 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:04.364847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.365602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:04.365602 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.365602 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:04.365602 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.365602 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.365602 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:04.365602 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.365602 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:04.366352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.366352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:04.366352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:04.366352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:04.366352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.366352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:04.366352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:04.366352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:04.366352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.366352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:04.366352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:04.366352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:04.366352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:04.366352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:04.366352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:04.367088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:04.367088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:04.367088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.367088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:04.367088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.367088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.367088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:04.367088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.367088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:04.367536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.367536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:04.367536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:04.367536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:04.367536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.367536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:04.367536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:04.367536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:04.367536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:04.367536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.367536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:04.368244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:04.368244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:04.368244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.368244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:04.368244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:04.368244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:04.368244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:04.368244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:04.368244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:04.368244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:04.368244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:04.368244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.368244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:04.368244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.368946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.368946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:04.368946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.368946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:04.368946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.368946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:04.368946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:04.368946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:04.368946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:04.368946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:04.368946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.368946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:04.368946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:04.368946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:04.369871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:04.370914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:04.370914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:04.370914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:04.370914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:04.370914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.370914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:04.370914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.370914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.370914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:04.370914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.370914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:04.371698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:04.371698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:04.371698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:04.371698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:04.372198 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:04.372294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:04.372540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.373031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:04.373031 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.373031 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:04.373031 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.373031 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.373031 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:04.373031 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.373031 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:04.373887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.373887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:04.373887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:04.373887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:04.373887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.373887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:04.373887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:04.373887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.373887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:04.373887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:04.373887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:04.373887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.374824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:04.374824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:04.374824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:04.374824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:04.374824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:04.374824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:04.374824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:04.374824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:04.374824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.374824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:04.374824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.374824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.374824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:04.375311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.375311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:04.375311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.375311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:04.375311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:04.375311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:04.375311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:04.375311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:04.375311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.375311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:04.375311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:04.375311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.375311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:04.375311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:04.375311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:04.375706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:04.376227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:04.376227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:04.376227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:04.376227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:04.376227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:04.376227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:09.297553 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:09.298230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:09.298428 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:09.299748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:09.338920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:09.339124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.339743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:09.339743 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.339743 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:09.339743 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.339743 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.339743 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:09.339743 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.339743 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:09.341474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.341474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:09.341474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:09.341474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:09.341474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.341474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:09.341474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:09.341474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.341474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:09.341474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:09.341474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:09.341474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.341792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:09.341792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:09.341792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:09.341792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:09.341792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:09.341792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:09.341792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:09.341792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:09.341792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.341792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:09.341792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.341792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.341792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:09.342094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.342094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:09.342094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.342094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:09.342094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:09.342094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:09.342094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:09.342094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:09.342094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.342094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:09.342094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:09.342094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.342094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:09.342094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:09.342094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:09.342445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.342846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:09.342846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.342846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.342846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:09.342846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.342846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:09.347596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:09.347944 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:09.348073 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:09.348963 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:09.349192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:09.349339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.352411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:09.352411 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.352411 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:09.352411 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.352411 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.352411 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:09.352411 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.352411 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:09.352411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.352411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:09.352411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:09.352411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:09.352411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.352411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:09.352411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:09.352884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.352884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:09.352884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:09.352884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:09.352884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.352884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:09.352884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:09.352884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:09.352884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:09.352884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:09.352884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:09.352884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:09.352884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:09.352884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.353251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:09.353251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.353251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.353251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:09.353251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.353251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:09.353444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.353444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:09.353444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:09.353444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:09.353444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:09.353444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:09.353444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.353444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:09.353444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:09.353444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.353444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:09.353444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:09.353444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.353444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:09.353444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:09.353444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.353877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.354460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:09.354460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.354460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:09.356686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:09.357773 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:09.357773 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:09.357773 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:31:09.357773 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:09.357987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.358512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:09.358512 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.358512 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:09.358512 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.358512 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.358512 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:09.358512 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.358512 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:09.359519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.359519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:09.359519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:09.359519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:09.359519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.359519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:09.359519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:09.359519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:09.359519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.359519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:09.359519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:09.359519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:09.359519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:09.359519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:09.359519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:09.359846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:09.359846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:09.359846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.359846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:09.359846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.359846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.359846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:09.359846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.359846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:09.361341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.361341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:09.361341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:09.361341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:09.361341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.361341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:09.361341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:09.361341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:31:09.361341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:09.361341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:09.361341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.361341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:09.361672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:09.361672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:09.361672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.361672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:09.361672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:09.361672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:09.361672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:09.361672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:09.361672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:09.361672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:09.361672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:09.361672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.361672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:09.361672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.361952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.361952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:09.361952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.361952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:09.362124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.362124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:09.362124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:09.362124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:09.362124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:09.362124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:09.362124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.362124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:09.362124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:09.362124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.362124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:09.362124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:09.362124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.362124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:09.362124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:09.362124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:09.362442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:09.362829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.362829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:09.362829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.362829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.362829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:09.362829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.362829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:09.364563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:09.364836 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:09.364934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:09.365075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:09.365421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:09.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.366074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:09.366074 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.366074 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:09.366074 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.366074 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.366074 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:09.366074 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.366074 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:09.367523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.367523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:09.367523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:09.367523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:09.367523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.367523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:09.367523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:09.367523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:09.367523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.367523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:09.367523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:09.367523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:09.367523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:09.367523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:09.367523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:09.368235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:09.368235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:09.368235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.368235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:09.368235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.368235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.368235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:09.368235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.368235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:09.368235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.368235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:09.368235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:09.368235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:09.368235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.368878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:09.368878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:09.368878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:09.368878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:09.368878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.368878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:09.368878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:09.368878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:09.368878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.368878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:09.368878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:09.368878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:09.368878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:09.369690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:09.369690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:09.369690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:09.369690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:09.369690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.369690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:09.369690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.369690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.369690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:09.369690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.369690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:09.369690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:09.370308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.371008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:09.371571 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:09.371741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:09.371896 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:09.371974 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:09.372258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:09.372465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:09.372577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.373087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:09.373087 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.373087 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:09.373087 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.373087 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.373087 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:09.373087 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.373087 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:09.374072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.374072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:09.374072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:09.374072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:09.374072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.374072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:09.374072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:09.374072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.374072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:09.374072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:09.374072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:09.374072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.374581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:09.374581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:09.374581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:09.374581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:09.374581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:09.374581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:09.374581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:09.374581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:09.374581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.374581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:09.374581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.374581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.374581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:09.375030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.375030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:09.375244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.375244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:09.375244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:09.375244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:09.375244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:09.375244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:09.375244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.375244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:09.375244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:09.375244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.375244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:09.375244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:09.375244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.375244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:09.375244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:09.375244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:09.376085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:09.377252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:09.377252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:09.377252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:14.298243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:14.298989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:14.298989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:14.299498 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:14.336070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:14.336444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.337106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:14.337106 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.337106 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:14.337106 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.337106 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.337106 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:14.337106 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.337106 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:14.337933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.337933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:14.337933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:14.337933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:14.337933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.337933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:14.337933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:14.337933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.337933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:14.337933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:14.337933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:14.337933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.338386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:14.338386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:14.338386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:14.338386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:14.338386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:14.338386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:14.338386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:14.338386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:14.338386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.338386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:14.338386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.338386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.338386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:14.338946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.338946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:14.338946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.338946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:14.338946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:14.338946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:14.338946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:14.338946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:14.338946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.338946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:14.338946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:14.338946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.338946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:14.338946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:14.338946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:14.339506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.340147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:14.340147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.340147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.340147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:14.340147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.340147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:14.348175 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:14.348790 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:14.348790 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:14.349546 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:14.349815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:14.349984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.350751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:14.350751 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.350751 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:14.350751 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.350751 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.350751 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:14.350751 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.350751 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:14.352760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.352760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:14.352760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:14.352760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:14.352760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.352760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:14.352760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:14.352760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.352760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:14.352760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:14.352760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:14.352760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.353158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:14.353158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:14.353158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:14.353158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:14.353158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:14.353158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:14.353158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:14.353158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:14.353158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.353158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:14.353158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.353158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.353158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:14.353520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.353520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:14.355197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.355197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:14.355197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:14.355197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:14.355197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:14.355197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:14.355197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.355197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:14.355197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:14.355197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.355197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:14.355197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:14.355197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.355197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:14.355197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:14.355197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.355646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.356181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:14.356181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.356181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:14.357187 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:14.359147 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:14.359147 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:14.359147 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:31:14.359147 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:14.359147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.359528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:14.359528 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.359528 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:14.359528 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.359528 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.359528 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:14.359528 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.359528 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:14.360433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.360433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:14.360433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:14.360433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:14.360433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.360433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:14.360433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:14.360433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:14.360433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.360433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:14.360433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:14.360433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:14.360433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:14.360433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:14.360433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:14.360907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:14.360907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:14.360907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.360907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:14.360907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.360907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.360907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:14.360907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.360907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:14.361242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.361242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:14.361242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:14.361242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:14.361242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.361242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:14.361242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:14.361242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:31:14.361242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:14.361242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:14.361242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.361242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:14.361557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:14.361557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:14.361557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.361557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:14.361557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:14.361557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:14.361557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:14.361557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:14.361557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:14.361557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:14.361557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:14.361557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.361557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:14.361557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.361851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.361851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:14.361851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.361851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:14.362292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.362292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:14.362292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:14.362292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:14.362292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:14.362292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:14.362292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.362292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:14.362292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:14.362292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.362292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:14.362292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:14.362292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.362292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:14.362292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:14.362292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:14.362688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:14.363125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.363125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:14.363125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.363125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.363125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:14.363125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.363125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:14.364977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:14.365168 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:14.365232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:14.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:14.365937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:14.367222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.367222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:14.367222 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.367222 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:14.367222 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.367222 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.367222 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:14.367222 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.367222 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:14.367681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.367681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:14.367681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:14.367681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:14.367681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.367681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:14.367681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:14.367681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:14.367681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.367681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:14.367681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:14.367681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:14.367681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:14.367681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:14.367681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:14.368033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:14.368033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:14.368033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.368033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:14.368033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.368033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.368033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:14.368033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.368033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:14.368530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.368530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:14.368530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:14.368530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:14.368530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.368530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:14.368530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:14.368530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:14.368530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:14.368530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.368530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:14.368851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:14.368851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:14.368851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.368851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:14.368851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:14.368851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:14.368851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:14.368851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:14.368851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:14.368851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:14.368851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:14.368851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.368851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:14.368851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.369125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.369125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:14.369125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.369125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.369528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:14.369910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.370343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.370343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:14.370343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.370343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:14.371871 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:14.372237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:14.372382 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:14.372585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:14.373030 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:14.373386 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:14.374010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.374274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:14.374274 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.374274 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:14.374274 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.374274 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.374274 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:14.374274 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.374274 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:14.375916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.375916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:14.375916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:14.375916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:14.375916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.375916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:14.375916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:14.375916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.375916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:14.375916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:14.375916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:14.375916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.376257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:14.376257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:14.376257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:14.376257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:14.376257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:14.376257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:14.376257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:14.376257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:14.376257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.376257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:14.376257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.376257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.376257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:14.376513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.376513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:14.376513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.376513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:14.376513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:14.376513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:14.376513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:14.376513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:14.376513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.376513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:14.376513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:14.376513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.376513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:14.376513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:14.376513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:14.376812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:14.377211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:14.377211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:14.377211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:14.377211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:14.377211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:14.377211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:19.298850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:19.299887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:19.299887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:19.300269 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:19.336856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:19.337396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.338655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:19.338655 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.338655 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:19.338655 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.338655 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.338655 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:19.338655 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.338655 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:19.339860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.339860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:19.339860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:19.339860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:19.339860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.339860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:19.339860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:19.339860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.339860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:19.339860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:19.339860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:19.339860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.340361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:19.340361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:19.340361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:19.340361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:19.340361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:19.340361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:19.340361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:19.340361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:19.340361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.340361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:19.340361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.340361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.340361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:19.340644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.340644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:19.341280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.341280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:19.341280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:19.341280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:19.341280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:19.341280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:19.341280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.341280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:19.341280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:19.341280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.341280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:19.341280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:19.341280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.341280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:19.341280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:19.341280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.341918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.342295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:19.342295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.342295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:19.348851 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:19.349407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:19.349511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:19.350431 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:19.350795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:19.350920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.351955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:19.351955 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.351955 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:19.351955 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.351955 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.351955 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:19.351955 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.351955 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:19.353998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.353998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:19.353998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:19.353998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:19.353998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.353998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:19.353998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:19.353998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.353998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:19.353998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:19.353998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:19.353998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.354661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:19.354661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:19.354661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:19.354661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:19.354661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:19.354661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:19.354661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:19.354661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:19.354661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.354661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:19.354661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.354661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.354661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:19.355214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.355214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:19.356025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.356025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:19.356025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:19.356025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:19.356025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:19.356025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:19.356025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.356025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:19.356025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:19.356025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.356025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:19.356025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:19.356025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.356025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:19.356025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:19.356025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.356841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.357710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:19.357710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.357710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:19.357710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:19.357961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:19.358936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:19.358936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:31:19.358936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:19.360165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.360165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:19.360165 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.360165 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:19.360165 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.360165 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.360165 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:19.360165 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.360165 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:19.360760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.360760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:19.360760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:19.360760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:19.360760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.360760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:19.360760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:19.360760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:19.360760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.360760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:19.360760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:19.360760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:19.360760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:19.360760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:19.360760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:19.361536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:19.361536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:19.361536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.361536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:19.361536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.361536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.361536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:19.361536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.361536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:19.362061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.362061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:19.362061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:19.362061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:19.362061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.362061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:19.362061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:19.362061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:31:19.362061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:19.362061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:19.362061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.362061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:19.362697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:19.362697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:19.362697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.362697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:19.362697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:19.362697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:19.362697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:19.362697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:19.362697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:19.362697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:19.362697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:19.362697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.362697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:19.362697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.363311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.363311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:19.363311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.363311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:19.363311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.363311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:19.363311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:19.363311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:19.363311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:19.363311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:19.363311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.363311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:19.363311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:19.363311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:19.366644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:19.367045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:19.367045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:19.367045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:19.367045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:19.367045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:19.367045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.367045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:19.367045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.367045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.367045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:19.367045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.367045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:19.367045 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:19.367045 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:19.367351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:19.367351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:19.367351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:19.367351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.367351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:19.367351 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.367351 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:19.367351 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.367351 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.367351 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:19.367351 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.367351 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:19.368339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.368339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:19.368339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:19.368339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:19.368339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.368339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:19.368339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:19.368339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:19.368339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.368339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:19.368339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:19.368339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:19.368339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:19.368339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:19.368339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:19.368721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:19.368721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:19.368721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.368721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:19.368721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.368721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.368721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:19.368721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.368721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:19.368964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.368964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:19.368964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:19.368964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:19.368964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.368964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:19.368964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:19.368964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:19.368964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:19.368964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.368964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:19.369231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:19.369231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:19.369231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.369231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:19.369231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:19.369231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:19.369231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:19.369231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:19.369231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:19.369231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:19.369231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:19.369231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.369231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:19.369231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.369525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.369525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:19.369525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.369525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.370763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:19.371201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.371599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.371599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:19.371599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.371599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:19.372311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:19.372711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:19.372862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:19.373082 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:19.373688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:19.374183 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:19.374922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.375653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:19.375653 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.375653 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:19.375653 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.375653 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.375653 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:19.375653 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.375653 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:19.376566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.376566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:19.376566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:19.376566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:19.376566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.376566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:19.376566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:19.376566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.376566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:19.376566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:19.376566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:19.376566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.377008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:19.377008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:19.377008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:19.377008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:19.377008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:19.377008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:19.377008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:19.377008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:19.377008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.377008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:19.377008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.377008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.377008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:19.377402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.377402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:19.377402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.377402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:19.377402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:19.377402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:19.377402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:19.377402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:19.377402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.377402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:19.377402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:19.377402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.377402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:19.377402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:19.377402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:19.377912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:19.378464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:19.378464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:19.378464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:19.378464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:19.378464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:19.378464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:24.299527 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:24.300272 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:24.300272 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:24.302264 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:24.339907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:24.340190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.340773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:24.340773 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.340773 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:24.340773 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.340773 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.340773 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:24.340773 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.340773 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:24.341736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.341736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:24.341736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:24.341736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:24.341736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.341736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:24.341736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:24.341736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.341736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:24.341736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:24.341736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:24.341736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.342129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:24.342129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:24.342129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:24.342129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:24.342129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:24.342129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:24.342129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:24.342129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:24.342129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.342129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:24.342129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.342129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.342129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:24.342519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.342519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:24.343314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.343314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:24.343314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:24.343314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:24.343314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:24.343314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:24.343314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.343314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:24.343314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:24.343314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.343314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:24.343314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:24.343314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.343314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:24.343314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:24.343314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.344110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.345044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:24.345044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.345044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:24.349322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:24.349615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:24.349730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:24.350479 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:24.350674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:24.350798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.351313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:24.351313 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.351313 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:24.351313 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.351313 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.351313 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:24.351313 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.351313 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:24.352175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.352175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:24.352175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:24.352175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:24.352175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.352175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:24.352175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:24.352175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.352175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:24.352175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:24.352175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:24.352175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.352440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:24.352440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:24.352440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:24.352440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:24.352440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:24.352440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:24.352440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:24.352440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:24.352440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.352440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:24.352440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.352440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.352440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:24.352780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.352780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:24.353187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.353187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:24.353187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:24.353187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:24.353187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:24.353187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:24.353187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.353187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:24.353187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:24.353187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.353187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:24.353187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:24.353187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.353187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:24.353187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:24.353187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.353697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.354174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:24.354174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.354174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:24.357969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:24.358333 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:24.358467 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:24.358555 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:31:24.358971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:24.359349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.359748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:24.359748 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.359748 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:24.359748 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.359748 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.359748 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:24.359748 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.359748 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:24.360499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.360499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:24.360499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:24.360499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:24.360499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.360499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:24.360499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:24.360499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:24.360499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.360499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:24.360499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:24.360499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:24.360499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:24.360499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:24.360499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:24.361069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:24.361069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:24.361069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.361069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:24.361069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.361069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.361069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:24.361069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.361069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:24.361429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.361429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:24.361429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:24.361429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:24.361429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.361429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:24.361429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:24.361429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:31:24.361429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:24.361429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:24.361429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.361429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:24.361854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:24.361854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:24.361854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.361854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:24.361854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:24.361854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:24.361854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:24.361854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:24.361854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:24.361854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:24.361854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:24.361854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.361854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:24.361854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.362294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.362294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:24.362294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.362294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:24.362294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.362294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:24.362294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:24.362294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:24.362294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:24.362294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:24.362294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.362294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:24.362294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:24.362294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:24.362812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:24.366324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:24.366324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:24.366324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:24.366324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:24.366324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:24.366324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.366324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:24.366324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.366324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.366324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:24.366324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.366324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:24.366324 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:24.366324 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:24.367467 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:24.367467 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:24.367467 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:24.367467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.367467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:24.367467 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.367467 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:24.367467 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.367467 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.367467 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:24.367467 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.367467 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:24.368389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.368389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:24.368389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:24.368389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:24.368389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.368389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:24.368389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:24.368389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:24.368389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.368389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:24.368389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:24.368389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:24.368389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:24.368389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:24.368389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:24.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:24.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:24.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:24.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:24.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:24.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:24.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:24.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:24.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.370614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:24.370614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:24.370614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:24.370614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:24.370614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.370614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:24.370614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:24.370614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:24.370614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.370614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:24.370614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:24.370614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:24.370614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:24.371719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:24.371719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:24.371719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:24.371719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:24.371719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.371719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:24.371719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.371719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.371719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:24.371719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.371719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:24.371719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:24.372532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.372936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:24.373347 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:24.373347 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:24.373347 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:24.373347 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:24.373831 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:24.373831 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:24.374060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.374760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:24.374760 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.374760 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:24.374760 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.374760 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.374760 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:24.374760 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.374760 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:24.375641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.375641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:24.375641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:24.375641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:24.375641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.375641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:24.375641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:24.375641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.375641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:24.375641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:24.375641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:24.375641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.376296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:24.376296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:24.376296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:24.376296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:24.376296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:24.376296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:24.376296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:24.376296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:24.376296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.376296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:24.376296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.376296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.376296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:24.377091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.377091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:24.377091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.377091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:24.377091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:24.377091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:24.377091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:24.377091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:24.377091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.377091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:24.377091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:24.377091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.377091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:24.377091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:24.377091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:24.377488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:24.377851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:24.377851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:24.377851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:24.377851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:24.377851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:24.377851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:29.300084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:29.301230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:29.301230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:29.302021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:29.336515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:29.336922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.337392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:29.337392 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.337392 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:29.337392 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.337392 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.337392 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:29.337392 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.337392 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:29.338470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.338470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:29.338470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:29.338470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:29.338470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.338470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:29.338470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:29.338470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.338470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:29.338470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:29.338470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:29.338470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.339264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:29.339264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:29.339264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:29.339264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:29.339264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:29.339264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:29.339264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:29.339264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:29.339264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.339264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:29.339264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.339264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.339264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:29.339875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.339875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:29.339875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.339875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:29.339875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:29.339875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:29.339875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:29.339875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:29.339875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.339875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:29.339875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:29.339875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.339875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:29.339875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:29.339875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:29.340758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.343160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:29.343160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.343160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.343160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:29.343160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.343160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:29.349698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:29.349968 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:29.350111 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:29.350907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:29.351191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:29.351444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.352150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:29.352150 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.352150 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:29.352150 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.352150 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.352150 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:29.352150 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.352150 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:29.353114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.353114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:29.353114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:29.353114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:29.353114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.353114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:29.353114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:29.353114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.353114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:29.353114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:29.353114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:29.353114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.353804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:29.353804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:29.353804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:29.353804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:29.353804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:29.353804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:29.353804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:29.353804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:29.353804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.353804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:29.353804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.353804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.353804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:29.354140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.354140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:29.354679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.354679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:29.354679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:29.354679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:29.354679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:29.354679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:29.354679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.354679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:29.354679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:29.354679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.354679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:29.354679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:29.354679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.354679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:29.354679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:29.354679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.355569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.356063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:29.356063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.356063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:29.358439 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:29.358914 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:29.359125 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:29.359281 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:31:29.359686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:29.359936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.360555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:29.360555 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.360555 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:29.360555 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.360555 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.360555 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:29.360555 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.360555 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:29.361544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.361544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:29.361544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:29.361544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:29.361544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.361544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:29.361544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:29.361544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:29.361544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.361544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:29.361544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:29.361544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:29.361544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:29.361544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:29.361544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:29.362012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:29.362012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:29.362012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.362012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:29.362012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.362012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.362012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:29.362012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.362012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:29.362547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.362547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:29.362547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:29.362547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:29.362547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.362547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:29.362547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:29.362547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:31:29.362547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:29.362547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:29.362547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.362547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:29.363142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:29.363142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:29.363142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.363142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:29.363142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:29.363142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:29.363142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:29.363142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:29.363142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:29.363142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:29.363142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:29.363142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.363142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:29.363142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.363511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.363511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:29.363511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.363511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:29.363511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.363511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:29.363511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:29.363511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:29.363511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:29.363511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:29.363511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.363511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:29.363511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:29.363511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:29.364910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:29.367697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:29.367697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:29.367697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:29.367697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:29.367697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:29.367697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.367697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:29.367697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.367697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.367697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:29.367697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.367697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:29.367697 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:29.367697 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:29.368073 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:29.368073 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:29.368073 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:29.368073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.368073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:29.368073 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.368073 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:29.368073 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.368073 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.368073 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:29.368073 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.368073 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:29.368472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.368472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:29.368472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:29.368472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:29.368472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.368472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:29.368472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:29.368472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:29.368472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.368472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:29.368472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:29.368472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:29.368472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:29.368472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:29.368472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:29.368913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:29.368913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:29.368913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.368913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:29.368913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.368913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.368913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:29.368913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.368913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:29.369409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.369409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:29.369409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:29.369409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:29.369409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.369409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:29.369409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:29.369409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:29.369409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:29.369409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.369409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:29.369725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:29.369725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:29.369725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.369725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:29.369725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:29.369725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:29.369725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:29.369725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:29.369725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:29.369725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:29.369725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:29.369725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.369725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:29.369725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.370083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.370083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:29.370083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.370083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.370517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:29.371019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.371611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.371611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:29.371611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.371611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:29.373162 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:29.373647 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:29.373789 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:29.374039 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:29.374568 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:29.374906 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:29.375204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.376018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:29.376018 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.376018 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:29.376018 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.376018 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.376018 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:29.376018 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.376018 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:29.377125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.377125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:29.377125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:29.377125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:29.377125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.377125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:29.377125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:29.377125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.377125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:29.377125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:29.377125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:29.377125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.377527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:29.377527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:29.377527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:29.377527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:29.377527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:29.377527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:29.377527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:29.377527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:29.377527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.377527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:29.377527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.377527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.377527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:29.378046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.378046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:29.378476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.378476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:29.378476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:29.378476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:29.378476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:29.378476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:29.378476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.378476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:29.378476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:29.378476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.378476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:29.378476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:29.378476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.378476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:29.378476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:29.378476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:29.378887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:29.379262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:29.379262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:29.379262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:34.300855 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:34.302038 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:34.302038 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:34.303209 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:34.341076 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:34.341496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.342509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:34.342509 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.342509 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:34.342509 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.342509 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.342509 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:34.342509 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.342509 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:34.343670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.343670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:34.343670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:34.343670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:34.343670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.343670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:34.343670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:34.343670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.343670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:34.343670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:34.343670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:34.343670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.344143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:34.344143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:34.344143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:34.344143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:34.344143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:34.344143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:34.344143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:34.344143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:34.344143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.344143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:34.344143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.344143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.344143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:34.344640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.344640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:34.344818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.344818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:34.344818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:34.344818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:34.344818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:34.344818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:34.344818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.344818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:34.344818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:34.344818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.344818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:34.344818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:34.344818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.344818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:34.344818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:34.344818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.345225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.345850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:34.345850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.345850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:34.350083 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:34.350663 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:34.350663 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:34.351941 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:34.352203 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:34.352517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.353119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:34.353119 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.353119 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:34.353119 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.353119 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.353119 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:34.353119 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.353119 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:34.354176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.354176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:34.354176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:34.354176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:34.354176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.354176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:34.354176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:34.354176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.354176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:34.354176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:34.354176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:34.354176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.354836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:34.354836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:34.354836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:34.354836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:34.354836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:34.354836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:34.354836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:34.354836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:34.354836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.354836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:34.354836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.354836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.354836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:34.355503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.355503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:34.355503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.355503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:34.355503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:34.355503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:34.355503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:34.355503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:34.355503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.355503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:34.355503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:34.355503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.355503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:34.355503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:34.355503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:34.356236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.357129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:34.357129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.357129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.357129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:34.357129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.357129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:34.359128 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:34.359864 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:34.360020 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:34.360225 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:31:34.360611 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:34.360925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.361716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:34.361716 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.361716 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:34.361716 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.361716 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.361716 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:34.361716 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.361716 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:34.363080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.363080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:34.363080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:34.363080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:34.363080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.363080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:34.363080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:34.363080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:34.363080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.363080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:34.363080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:34.363080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:34.363080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:34.363080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:34.363080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:34.363429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:34.363429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:34.363429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.363429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:34.363429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.363429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.363429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:34.363429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.363429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:34.364945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.364945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:34.364945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:34.364945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:34.364945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.364945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:34.364945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:34.364945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:31:34.364945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:34.364945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:34.364945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.364945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:34.365240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:34.365240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:34.365240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.365240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:34.365240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:34.365240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:34.365240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:34.365240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:34.365240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:34.365240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:34.365240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:34.365240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.365240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:34.365240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.365546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.365546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:34.365546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.365546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:34.368943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.368943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:34.368943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:34.368943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:34.368943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:34.368943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:34.368943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.368943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:34.368943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:34.368943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.368943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:34.368943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:34.368943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.368943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:34.368943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:34.368943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:34.369295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:34.369925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.369925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:34.369925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.369925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.369925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:34.369925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.369925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:34.369925 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:34.369925 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:34.369925 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:34.370239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:34.371049 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:34.371049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.371839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:34.371839 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.371839 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:34.371839 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.371839 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.371839 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:34.371839 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.371839 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:34.372777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.372777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:34.372777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:34.372777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:34.372777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.372777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:34.372777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:34.372777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:34.372777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.372777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:34.372777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:34.372777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:34.372777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:34.372777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:34.372777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:34.373627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:34.373627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:34.373627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.373627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:34.373627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.373627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.373627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:34.373627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.373627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:34.374142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.374142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:34.374142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:34.374142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:34.374142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.374142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:34.374142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:34.374142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:34.374142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:34.374142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.374142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:34.374684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:34.374684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:34.374684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.374684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:34.374684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:34.374684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:34.374684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:34.374684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:34.374684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:34.374684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:34.374684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:34.374684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.374684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:34.374684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.375238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.375238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:34.375238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.375238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:34.375238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.375238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:34.375238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:34.375238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:34.375238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:34.375238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:34.375238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.375238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:34.375238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:34.375238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:34.376090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:34.376975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:34.376975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:34.376975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:34.376975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:34.376975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.376975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:34.376975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.376975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.376975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:34.376975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.376975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:34.376975 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:34.376975 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:34.377542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:34.377542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:34.377542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:34.377542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:34.377542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.377542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:34.377542 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.377542 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:34.377542 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.377916 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.377916 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:34.377916 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.377916 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:34.378127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.378127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:34.378127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:34.378127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:34.378127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.378127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:34.378127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:34.378127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.378127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:34.378127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:34.378127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:34.378127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.378691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:34.378691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:34.378691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:34.378691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:34.378691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:34.378691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:34.378691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:34.378691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:34.378691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.378691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:34.378691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.378691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.378691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:34.379203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.379203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:34.379203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.379203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:34.379203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:34.379203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:34.379203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:34.379203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:34.379203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.379203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:34.379203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:34.379203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.379203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:34.379203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:34.379203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:34.380208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:34.381142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:34.381142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:34.381142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:34.381142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:34.381142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:34.381142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:39.301679 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:39.305467 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:39.305467 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:39.305467 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:39.339662 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:39.340282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.341628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:39.341628 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.341628 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:39.341628 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.341628 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.341628 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:39.341628 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.341628 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:39.342524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.342524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:39.342524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:39.342524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:39.342524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.342524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:39.342524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:39.342524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.342524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:39.342524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:39.342524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:39.342524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.343018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:39.343018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:39.343018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:39.343018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:39.343018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:39.343018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:39.343018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:39.343018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:39.343018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.343018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:39.343018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.343018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.343018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:39.343491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.343491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:39.343564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.343564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:39.343564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:39.343564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:39.343564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:39.343564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:39.343564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.343564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:39.343564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:39.343564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.343564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:39.343564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:39.343564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.343564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:39.343564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:39.343564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.344065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.344660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:39.344660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.344660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:39.350574 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:39.350900 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:39.351026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:39.351872 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:39.352181 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:39.352346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.352978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:39.352978 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.352978 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:39.352978 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.352978 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.352978 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:39.352978 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.352978 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:39.353943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.353943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:39.353943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:39.353943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:39.353943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.353943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:39.353943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:39.353943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.353943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:39.353943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:39.353943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:39.353943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.354341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:39.354341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:39.354341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:39.354341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:39.354341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:39.354341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:39.354341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:39.354341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:39.354341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.354341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:39.354341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.354341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.354341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:39.354777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.354777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:39.354986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.354986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:39.354986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:39.354986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:39.354986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:39.354986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:39.354986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.354986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:39.354986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:39.354986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.354986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:39.354986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:39.354986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.354986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:39.354986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:39.354986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.355529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.356202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:39.356202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.356202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:39.359856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:39.360502 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:39.360691 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:39.360914 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:31:39.361434 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:39.361657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.362459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:39.362459 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.362459 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:39.362459 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.362459 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.362459 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:39.362459 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.362459 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:39.363713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.363713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:39.363713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:39.363713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:39.363713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.363713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:39.363713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:39.363713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:39.363713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.363713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:39.363713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:39.363713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:39.363713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:39.363713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:39.363713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:39.364316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:39.364316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:39.364316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.364316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:39.364316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.364316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.364316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:39.364316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.364316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:39.365254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.365254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:39.365254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:39.365254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:39.365254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.365254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:39.365254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:39.365254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:31:39.365254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:39.365254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:39.365254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.365254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:39.365721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:39.365721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:39.365721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.365721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:39.365721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:39.365721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:39.365721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:39.365721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:39.365721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:39.365721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:39.365721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:39.365721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.365721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:39.365721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.366176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.366176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:39.366176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.366176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:39.367478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.367478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:39.367478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:39.367478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:39.367478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:39.367478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:39.367478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.367478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:39.367478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:39.367478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.367478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:39.367478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:39.367478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.367478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:39.367478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:39.367478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:39.368074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:39.368716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.368716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:39.368716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.368716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.368716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:39.368716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.368716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:39.369646 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:39.369882 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:39.369954 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:39.370074 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:39.370602 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:39.370984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.371740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:39.371740 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.371740 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:39.371740 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.371740 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.371740 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:39.371740 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.371740 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:39.372381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.372381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:39.372381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:39.372381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:39.372381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.372381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:39.372381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:39.372381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:39.372381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.372381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:39.372381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:39.372381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:39.372381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:39.372381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:39.372381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:39.372727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:39.372727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:39.372727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.372727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:39.372727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.372727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.372727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:39.372727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.372727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:39.373081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.373081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:39.373081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:39.373081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:39.373081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.373081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:39.373081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:39.373081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:39.373081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:39.373081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.373081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:39.373355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:39.373355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:39.373355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.373355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:39.373355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:39.373355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:39.373355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:39.373355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:39.373355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:39.373355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:39.373355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:39.373355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.373355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:39.373355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.373675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.373675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:39.373675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.373675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.374103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:39.374537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.374975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.374975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:39.374975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.374975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:39.375628 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:39.375947 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:39.376100 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:39.376248 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:39.376735 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:39.377413 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:39.377772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.378482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:39.378482 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.378482 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:39.378482 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.378482 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.378482 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:39.378482 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.378482 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:39.379214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.379214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:39.379214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:39.379214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:39.379214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.379214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:39.379214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:39.379214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.379214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:39.379214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:39.379214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:39.379214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.379582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:39.379582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:39.379582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:39.379582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:39.379582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:39.379582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:39.379582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:39.379582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:39.379582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.379582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:39.379582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.379582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.379582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:39.379898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.379898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:39.380272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.380272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:39.380272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:39.380272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:39.380272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:39.380272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:39.380272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.380272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:39.380272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:39.380272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.380272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:39.380272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:39.380272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.380272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:39.380272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:39.380272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:39.380680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:39.381138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:39.381138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:39.381138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:44.303180 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:44.304251 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:44.304251 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:44.305284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:44.339817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:44.340307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.342572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:44.342572 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.342572 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:44.342572 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.342572 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.342572 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:44.342572 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.342572 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:44.343310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.343310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:44.343310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:44.343310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:44.343310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.343310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:44.343310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:44.343310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.343310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:44.343310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:44.343310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:44.343310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.343998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:44.343998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:44.343998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:44.343998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:44.343998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:44.343998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:44.343998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:44.343998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:44.343998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.343998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:44.343998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.343998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.343998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:44.344711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.344711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:44.344711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.344711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:44.344711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:44.344711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:44.344711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:44.344711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:44.344711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.344711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:44.344711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:44.344711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.344711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:44.344711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:44.344711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:44.345698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.346779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:44.346779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.346779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.346779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:44.346779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.346779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:44.351058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:44.352155 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:44.352524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:44.353610 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:44.353908 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:44.354142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.354931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:44.354931 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.354931 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:44.354931 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.354931 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.354931 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:44.354931 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.354931 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:44.356050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.356050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:44.356050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:44.356050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:44.356050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.356050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:44.356050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:44.356050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.356050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:44.356050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:44.356050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:44.356050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.356722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:44.356722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:44.356722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:44.356722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:44.356722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:44.356722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:44.356722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:44.356722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:44.356722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.356722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:44.356722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.356722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.356722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:44.357187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.357187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:44.358252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.358252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:44.358252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:44.358252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:44.358252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:44.358252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:44.358252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.358252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:44.358252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:44.358252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.358252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:44.358252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:44.358252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.358252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:44.358252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:44.358252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.358934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.359592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:44.359592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.359592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:44.360394 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:44.360691 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:44.360844 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:44.361036 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:31:44.361648 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:44.361873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.362600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:44.362600 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.362600 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:44.362600 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.362600 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.362600 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:44.362600 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.362600 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:44.363683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.363683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:44.363683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:44.363683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:44.363683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.363683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:44.363683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:44.363683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:44.363683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.363683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:44.363683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:44.363683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:44.363683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:44.363683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:44.363683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:44.364308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:44.364308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:44.364308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.364308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:44.364308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.364308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.364308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:44.364308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.364308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:44.364872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.364872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:44.364872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:44.364872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:44.364872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.364872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:44.364872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:44.364872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:31:44.364872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:44.364872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:44.364872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.364872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:44.365506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:44.365506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:44.365506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.365506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:44.365506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:44.365506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:44.365506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:44.365506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:44.365506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:44.365506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:44.365506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:44.365506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.365506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:44.365506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.366162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.366162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:44.366162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.366162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:44.366419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.366419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:44.366419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:44.366419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:44.366419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:44.366419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:44.366419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.366419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:44.366419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:44.366419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.366419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:44.366419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:44.366419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.366419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:44.366419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:44.366419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:44.366927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:44.367520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.367520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:44.367520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.367520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.367520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:44.367520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.367520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:44.369998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:44.370292 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:44.370488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:44.370669 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:44.371041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:44.371317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.371944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:44.371944 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.371944 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:44.371944 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.371944 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.371944 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:44.371944 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.371944 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:44.372884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.372884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:44.372884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:44.372884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:44.372884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.372884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:44.372884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:44.372884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:44.372884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.372884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:44.372884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:44.372884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:44.372884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:44.372884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:44.372884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:44.373581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:44.373581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:44.373581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.373581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:44.373581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.373581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.373581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:44.373581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.373581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:44.374314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.374314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:44.374314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:44.374314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:44.374314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.374314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:44.374314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:44.374314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:44.374314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:44.374314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.374314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:44.374870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:44.374870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:44.374870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.374870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:44.374870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:44.374870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:44.374870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:44.374870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:44.374870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:44.374870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:44.374870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:44.374870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.374870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:44.374870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.375445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.375445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:44.375445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.375445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.376076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:44.376742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.377407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.377407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:44.377407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.377407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:44.377407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:44.377407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:44.377407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:44.377407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:44.377702 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:44.377822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:44.378031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.378732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:44.378732 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.378732 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:44.378732 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.378732 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.378732 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:44.378732 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.378732 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:44.379766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.379766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:44.379766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:44.379766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:44.379766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.379766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:44.379766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:44.379766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.379766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:44.379766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:44.379766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:44.379766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.380300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:44.380300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:44.380300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:44.380300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:44.380300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:44.380300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:44.380300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:44.380300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:44.380300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.380300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:44.380300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.380300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.380300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:44.380856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.380856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:44.381104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.381104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:44.381104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:44.381104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:44.381104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:44.381104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:44.381104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.381104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:44.381104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:44.381104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.381104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:44.381104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:44.381104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.381104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:44.381104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:44.381104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:44.381630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:44.382098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:44.382098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:44.382098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:49.303862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:49.305428 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:49.305428 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:49.305604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:49.342223 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:49.342640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.343603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:49.343603 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.343603 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:49.343603 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.343603 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.343603 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:49.343603 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.343603 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:49.344434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.344434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:49.344434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:49.344434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:49.344434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.344434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:49.344434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:49.344434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.344434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:49.344434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:49.344434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:49.344434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.344835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:49.344835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:49.344835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:49.344835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:49.344835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:49.344835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:49.344835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:49.344835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:49.344835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.344835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:49.344835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.344835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.344835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:49.345253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.345253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:49.345495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.345495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:49.345495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:49.345495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:49.345495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:49.345495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:49.345495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.345495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:49.345495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:49.345495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.345495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:49.345495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:49.345495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.345495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:49.345495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:49.345495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.345875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.346287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:49.346287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.346287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:49.351724 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:49.352121 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:49.352294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:49.353058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:49.353381 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:49.353645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.354425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:49.354425 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.354425 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:49.354425 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.354425 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.354425 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:49.354425 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.354425 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:49.355474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.355474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:49.355474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:49.355474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:49.355474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.355474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:49.355474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:49.355474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.355474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:49.355474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:49.355474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:49.355474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.355985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:49.355985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:49.355985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:49.355985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:49.355985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:49.355985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:49.355985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:49.355985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:49.355985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.355985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:49.355985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.355985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.355985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:49.356478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.356478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:49.356998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.356998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:49.356998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:49.356998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:49.356998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:49.356998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:49.356998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.356998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:49.356998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:49.356998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.356998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:49.356998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:49.356998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.356998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:49.356998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:49.356998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.358109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.359488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:49.359488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.359488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:49.360818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:49.361085 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:49.361203 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:49.361318 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:31:49.361719 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:49.361925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.362548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:49.362548 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.362548 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:49.362548 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.362548 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.362548 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:49.362548 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.362548 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:49.363349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.363349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:49.363349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:49.363349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:49.363349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.363349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:49.363349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:49.363349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:49.363349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.363349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:49.363349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:49.363349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:49.363349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:49.363349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:49.363349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:49.363952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:49.363952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:49.363952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.363952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:49.363952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.363952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.363952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:49.363952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.363952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:49.364361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.364361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:49.364361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:49.364361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:49.364361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.364361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:49.364361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:49.364361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:31:49.364361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:49.364361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:49.364361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.364361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:49.364755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:49.364755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:49.364755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.364755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:49.364755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:49.364755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:49.364755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:49.364755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:49.364755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:49.364755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:49.364755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:49.364755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.364755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:49.364755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.365114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.365114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:49.365114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.365114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:49.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:49.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:49.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:49.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:49.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:49.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:49.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:49.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:49.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:49.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:49.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:49.365387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:49.365984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:49.366737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.366737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:49.366737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.366737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.366737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:49.366737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.366737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:49.370429 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:49.370703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:49.370814 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:49.370986 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:49.371551 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:49.371925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.372295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:49.372295 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.372295 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:49.372295 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.372295 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.372295 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:49.372295 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.372295 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:49.373108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.373108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:49.373108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:49.373108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:49.373108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.373108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:49.373108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:49.373108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:49.373108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.373108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:49.373108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:49.373108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:49.373108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:49.373108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:49.373108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:49.373620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:49.373620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:49.373620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.373620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:49.373620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.373620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.373620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:49.373620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.373620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:49.374120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.374120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:49.374120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:49.374120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:49.374120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.374120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:49.374120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:49.374120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:49.374120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:49.374120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.374120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:49.374469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:49.374469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:49.374469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.374469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:49.374469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:49.374469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:49.374469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:49.374469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:49.374469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:49.374469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:49.374469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:49.374469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.374469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:49.374469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.374815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.374815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:49.374815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.374815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.375267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:49.375797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.376320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.376320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:49.376320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.376320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:49.378488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:49.378800 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:49.378912 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:49.379074 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:49.379640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:49.380009 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:49.380238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.381117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:49.381117 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.381117 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:49.381117 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.381117 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.381117 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:49.381117 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.381117 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:49.382086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.382086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:49.382086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:49.382086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:49.382086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.382086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:49.382086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:49.382086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.382086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:49.382086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:49.382086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:49.382086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.382509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:49.382509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:49.382509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:49.382509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:49.382509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:49.382509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:49.382509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:49.382509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:49.382509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.382509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:49.382509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.382509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.382509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:49.382862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.382862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:49.383839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.383839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:49.383839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:49.383839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:49.383839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:49.383839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:49.383839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.383839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:49.383839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:49.383839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.383839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:49.383839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:49.383839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.383839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:49.383839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:49.383839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:49.384453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:49.384952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:49.384952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:49.384952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:54.304765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:54.305336 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:54.305336 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:54.306221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:54.328198 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=254 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:31:54.339662 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:54.339919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.340560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:54.340560 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.340560 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:54.340560 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.340560 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.340560 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:54.340560 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.340560 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:54.341573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.341573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:54.341573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:54.341573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:54.341573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.341573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:54.341573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:54.341573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.341573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:54.341573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:54.341573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:54.341573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.341867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:54.341867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:54.341867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:54.341867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:54.341867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:54.341867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:54.341867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:54.341867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:54.341867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.341867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:54.341867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.341867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.341867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:54.342127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.342127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:54.342697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.342697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:54.342697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:54.342697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:54.342697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:54.342697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:54.342697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.342697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:54.342697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:54.342697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.342697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:54.342697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:54.342697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.342697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:54.342697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:54.342697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.343283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.343660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:54.343660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.343660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:54.352631 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:54.353083 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:54.353178 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:54.353924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:54.354147 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:54.354291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.354890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:54.354890 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.354890 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:54.354890 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.354890 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.354890 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:54.354890 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.354890 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:54.356062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.356062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:54.356062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:54.356062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:54.356062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.356062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:54.356062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:54.356062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.356062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:54.356062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:54.356062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:54.356062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.356311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:54.356311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:54.356311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:54.356311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:54.356311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:54.356311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:54.356311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:54.356311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:54.356311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.356311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:54.356311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.356311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.356311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:54.356583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.356583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:54.357234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.357234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:54.357234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:54.357234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:54.357234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:54.357234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:54.357234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.357234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:54.357234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:54.357234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.357234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:54.357234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:54.357234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.357234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:54.357234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:54.357234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.357558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.357897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:54.357897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.357897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:54.361237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:54.361531 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:54.361640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:54.361714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:31:54.362739 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:54.362965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.363515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:54.363515 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.363515 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:54.363515 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.363515 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.363515 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:54.363515 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.363515 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:54.364201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.364201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:54.364201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:54.364201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:54.364201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.364201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:54.364201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:54.364201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:54.364201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.364201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:54.364201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:54.364201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:54.364201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:54.364201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:54.364201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:54.364509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:54.364509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:54.364509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.364509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:54.364509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.364509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.364509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:54.364509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.364509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:54.364865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.364865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:54.364865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:54.364865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:54.364865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.364865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:54.364865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:54.364865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:31:54.364865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:54.364865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:54.364865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.364865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:54.365131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:54.365131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:54.365131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.365131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:54.365131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:54.365131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:54.365131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:54.365131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:54.365131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:54.365131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:54.365131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:54.365131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.365131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:54.365131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.365414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.365414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:54.365414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.365414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:54.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:54.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:54.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:54.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:54.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:54.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:54.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:54.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:54.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:54.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:54.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:54.365618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:54.365927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:54.366404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.366404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:54.366404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.366404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.366404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:54.366404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.366404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:54.371700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:54.371700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:54.371700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:54.371700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:54.372041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:54.372289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.372901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:54.372901 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.372901 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:54.372901 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.372901 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.372901 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:54.372901 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.372901 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:54.373723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.373723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:54.373723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:54.373723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:54.373723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.373723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:54.373723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:54.373723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:54.373723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.373723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:54.373723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:54.373723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:54.373723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:54.373723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:54.373723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:54.374007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:54.374007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:54.374007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.374007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:54.374007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.374007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.374007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:54.374007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.374007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:54.374646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.374646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:54.374646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:54.374646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:54.374646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.374646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:54.374646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:54.374646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:54.374646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:54.374646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.374646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:54.374865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:54.374865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:54.374865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.374865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:54.374865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:54.374865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:54.374865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:54.374865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:54.374865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:54.374865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:54.374865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:54.374865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.374865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:54.374865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.375149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.375149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:54.375149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.375149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.375751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:54.376107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.376486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.376486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:54.376486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.376486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:54.378906 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:54.379174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:54.379284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:54.379463 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:54.380093 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:54.380362 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:54.380524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.381221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:54.381221 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.381221 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:54.381221 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.381221 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.381221 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:54.381221 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.381221 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:54.382338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.382338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:54.382338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:54.382338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:54.382338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.382338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:54.382338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:54.382338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.382338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:54.382338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:54.382338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:54.382338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.382614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:54.382614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:54.382614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:54.382614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:54.382614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:54.382614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:54.382614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:54.382614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:54.382614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.382614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:54.382614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.382614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.382614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:54.382876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.382876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:54.383068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.383068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:54.383068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:54.383068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:54.383068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:54.383068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:54.383068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.383068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:54.383068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:54.383068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.383068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:54.383068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:54.383068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.383068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:54.383068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:54.383068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:54.383380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:54.383744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:54.383744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:54.383744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:59.305397 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:59.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:59.306318 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:59.307685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:59.351118 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:59.351565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.352514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:59.352514 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.352514 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:59.352514 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.352514 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.352514 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:59.352514 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.352514 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:59.353271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.046 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.353271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:59.353271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:59.353271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:59.353271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.353271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:59.353271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:59.353271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.353271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:59.353271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:59.353271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:59.353271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.354472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:59.354472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:59.354472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:59.354472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:59.354472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:59.354472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:59.354472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:59.354472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:59.354472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.354472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:59.354472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.354472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.354472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:59.355119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.355119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:59.355119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.355119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:59.355119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:59.355119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:59.355119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:59.355119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:59.355119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.355119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:59.355119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:59.355119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.355119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:59.355119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:59.355119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:59.355923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.356835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:59.356835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.356835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.356835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:59.356835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.356835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:59.356835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:59.356835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:59.356835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:59.356835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:59.357283 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:59.357283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.357283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:59.357283 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.357283 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:59.357283 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.357283 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.357283 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:59.357283 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.357283 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:59.357737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.357737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:59.357737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:59.357737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:59.357737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.357737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:59.357737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:59.357737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.357737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:59.357737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:59.357737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:59.357737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.358467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:59.358467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:59.358467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:59.358467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:59.358467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:59.358467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:59.358467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:59.358467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:59.358467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.358467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:59.358467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.358467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.358467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:59.359221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.359221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:59.359221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.359221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:59.359221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:59.359221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:59.359221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:59.359221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:59.359221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.359221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:59.359221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:59.359221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.359221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:59.359221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:59.359221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:59.360032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.360937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:59.360937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.360937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.360937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:59.360937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.360937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:59.361706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:59.362149 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:59.362335 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:59.362662 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:31:59.362989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:59.363053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.363560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:59.363560 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.363560 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:59.363560 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.363560 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.363560 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:59.363560 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.363560 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:59.364377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.364377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:59.364377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:59.364377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:59.364377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.364377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:59.364377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:59.364377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:59.364377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.364377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:59.364377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:59.364377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:59.364377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:59.364377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:59.364377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:59.364756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:59.364756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:59.364756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.364756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:59.364756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.364756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.364756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:59.364756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.364756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:59.365230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.365230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:59.365230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:59.365230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:59.365230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.365230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:59.365230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:59.365230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:31:59.365230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:59.365230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:59.365230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.365230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:59.365626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:59.365626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:59.365626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.365626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:59.365626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:59.365626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:59.365626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:59.365626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:59.365626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:59.365626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:59.365626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:59.365626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.365626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:59.365626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.365978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.365978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:59.365978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.365978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:59.366455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.366455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:59.366455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:59.366455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:59.366455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:59.366455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:59.366455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.366455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:59.366455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:59.366455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.366455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:59.366455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:59.366455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.366455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:59.366455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:59.366455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:59.366822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:59.367176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.367176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:59.367176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.367176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.367176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:59.367176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.367176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:59.371336 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:59.371751 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:59.371892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:59.372184 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:59.372728 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:59.373298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.374130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:59.374130 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.374130 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:59.374130 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.374130 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.374130 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:59.374130 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.374130 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:59.375262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.375262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:31:59.375262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:59.375262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:59.375262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.375262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:59.375262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:59.375262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:59.375262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.375262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:31:59.375262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:59.375262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:31:59.375262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:59.375262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:31:59.375262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:31:59.375736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:59.375736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:31:59.375736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.375736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:31:59.375736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.375736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.375736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:31:59.375736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.375736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:31:59.376251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.376251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:59.376251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:59.376251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:59.376251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.376251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:59.376251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:59.376251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:59.376251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:59.376251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.376251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:59.376632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:59.376632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:59.376632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.376632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:59.376632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:59.376632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:59.376632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:59.376632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:59.376632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:59.376632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:59.376632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:59.376632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.376632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:59.376632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.377047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.377047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:59.377047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.377047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.377726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:59.378251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.378943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.378943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:59.378943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.378943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:31:59.379333 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:31:59.379684 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:31:59.379808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:31:59.379978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:31:59.380460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:59.380868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:31:59.381105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.381810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:31:59.381810 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.381810 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:31:59.381810 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.381810 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.381810 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:31:59.381810 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.381810 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:31:59.382935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.382935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:31:59.382935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:59.382935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:31:59.382935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.382935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:59.382935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:59.382935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.382935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:59.382935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:59.382935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:59.382935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.383402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:31:59.383402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:59.383402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:31:59.383402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:59.383402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:31:59.383402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:31:59.383402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:59.383402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:31:59.383402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.383402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:31:59.383402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.383402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.383402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:31:59.383810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.383810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:31:59.384218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.384218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:31:59.384218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:31:59.384218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:31:59.384218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:31:59.384218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:31:59.384218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.384218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:31:59.384218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:31:59.384218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.384218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:31:59.384218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:31:59.384218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.384218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:31:59.384218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:31:59.384218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:31:59.384768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:31:59.385357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:31:59.385357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:31:59.385357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:04.305964 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:04.306978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:04.306978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:04.307731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:04.343585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:04.343870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.344415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:04.344415 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.344415 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:04.344415 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.344415 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.344415 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:04.344415 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.344415 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:04.345230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.345230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:04.345230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:04.345230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:04.345230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.345230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:04.345230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:04.345230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.345230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:04.345230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:04.345230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:04.345230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.345603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:04.345603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:04.345603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:04.345603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:04.345603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:04.345603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:04.345603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:04.345603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:04.345603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.345603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:04.345603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.345603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.345603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:04.345978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.345978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:04.346047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.346047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:04.346047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:04.346047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:04.346047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:04.346047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:04.346047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.346047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:04.346047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:04.346047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.346047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:04.346047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:04.346047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.346047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:04.346047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:04.346047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.346526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.346979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:04.346979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.346979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:04.355135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:04.355668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:04.355900 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:04.357963 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:04.358141 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:04.358245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.358851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:04.358851 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.358851 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:04.358851 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.358851 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.358851 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:04.358851 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.358851 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:04.360469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.360469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:04.360469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:04.360469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:04.360469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.360469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:04.360469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:04.360469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.360469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:04.360469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:04.360469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:04.360469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.360826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:04.360826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:04.360826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:04.360826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:04.360826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:04.360826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:04.360826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:04.360826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:04.360826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.360826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:04.360826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.360826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.360826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:04.361075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.361075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:04.362094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.362094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:04.362094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:04.362094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:04.362094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:04.362094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:04.362094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.362094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:04.362094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:04.362094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.362094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:04.362094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:04.362094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.362094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:04.362094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:04.362094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.362634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.363166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:04.363166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.363166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:04.363166 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:04.363166 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:04.363166 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:04.363166 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:32:04.363868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:04.363868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.364171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:04.364171 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.364171 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:04.364171 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.364171 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.364171 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:04.364171 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.364171 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:04.365478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.365478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:04.365478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:04.365478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:04.365478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.365478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:04.365478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:04.365478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:04.365478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.365478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:04.365478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:04.365478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:04.365478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:04.365478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:04.365478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:04.365983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:04.365983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:04.365983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.365983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:04.365983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.365983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.365983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:04.365983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.365983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:04.366793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.366793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:04.366793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:04.366793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:04.366793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.366793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:04.366793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:04.366793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:32:04.366793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:04.366793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:04.366793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.366793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:04.367525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:04.367525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:04.367525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.367525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:04.367525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:04.367525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:04.367525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:04.367525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:04.367525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:04.367525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:04.367525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:04.367525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.367525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:04.367525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.367894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.367894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:04.367894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.367894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:04.368427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.368427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:04.368427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:04.368427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:04.368427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:04.368427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:04.368427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.368427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:04.368427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:04.368427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.368427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:04.368427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:04.368427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.368427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:04.368427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:04.368427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:04.368834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:04.369319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.369319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:04.369319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.369319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.369319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:04.369319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.369319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:04.371803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:04.372064 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:04.372226 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:04.372226 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:04.372528 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:04.372707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.373065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:04.373065 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.373065 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:04.373065 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.373065 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.373065 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:04.373065 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.373065 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:04.373603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.373603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:04.373603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:04.373603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:04.373603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.373603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:04.373603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:04.373603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:04.373603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.373603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:04.373603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:04.373603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:04.373603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:04.373603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:04.373603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:04.374002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:04.374002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:04.374002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.374002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:04.374002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.374002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.374002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:04.374002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.374002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:04.374275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.374275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:04.374275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:04.374275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:04.374275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.374275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:04.374275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:04.374275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:04.374275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:04.374275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.374275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:04.374652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:04.374652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:04.374652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.374652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:04.374652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:04.374652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:04.374652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:04.374652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:04.374652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:04.374652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:04.374652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:04.374652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.374652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:04.374652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.375032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.375032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:04.375032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.375032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:04.375032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.375032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:04.375032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:04.375032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:04.375032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:04.375032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:04.375032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.375032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:04.375032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:04.375032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:04.375431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:04.376001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:04.376001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:04.376001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:04.376001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:04.376001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.376001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:04.376001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.376001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.376001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:04.376001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.376001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:04.379747 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:04.380444 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:04.380625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:04.381057 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:04.381795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:04.382028 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:04.382173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.382761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:04.382761 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.382761 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:04.382761 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.382761 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.382761 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:04.382761 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.382761 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:04.384517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.384517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:04.384517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:04.384517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:04.384517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.384517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:04.384517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:04.384517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.384517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:04.384517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:04.384517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:04.384517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.384822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:04.384822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:04.384822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:04.384822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:04.384822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:04.384822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:04.384822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:04.384822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:04.384822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.384822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:04.384822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.384822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.384822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:04.385164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.385164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:04.386654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.386654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:04.386654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:04.386654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:04.386654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:04.386654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:04.386654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.386654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:04.386654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:04.386654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.386654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:04.386654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:04.386654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.386654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:04.386654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:04.386654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:04.387003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:04.387347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:04.387347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:04.387347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:09.307091 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:09.307668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:09.307668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:09.308297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:09.344737 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:09.344902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.345614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:09.345614 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.345614 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:09.345614 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.345614 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.345614 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:09.345614 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.345614 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:09.346872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.346872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:09.346872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:09.346872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:09.346872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.346872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:09.346872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:09.346872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.346872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:09.346872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:09.346872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:09.346872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.347284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:09.347284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:09.347284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:09.347284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:09.347284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:09.347284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:09.347284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:09.347284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:09.347284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.347284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:09.347284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.347284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.347284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:09.347675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.347675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:09.348947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.348947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:09.348947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:09.348947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:09.348947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:09.348947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:09.348947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.348947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:09.348947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:09.348947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.348947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:09.348947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:09.348947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.348947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:09.348947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:09.348947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.349567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.350231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:09.350231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.350231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:09.355846 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:09.356315 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:09.356462 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:09.357086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:09.357231 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:09.357339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.357815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:09.357815 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.357815 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:09.357815 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.357815 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.357815 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:09.357815 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.357815 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:09.358932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.358932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:09.358932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:09.358932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:09.358932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.358932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:09.358932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:09.358932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.358932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:09.358932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:09.358932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:09.358932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.359316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:09.359316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:09.359316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:09.359316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:09.359316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:09.359316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:09.359316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:09.359316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:09.359316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.359316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:09.359316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.359316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.359316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:09.359669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.359669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:09.360494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.360494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:09.360494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:09.360494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:09.360494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:09.360494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:09.360494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.360494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:09.360494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:09.360494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.360494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:09.360494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:09.360494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.360494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:09.360494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:09.360494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.361025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.361583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:09.361583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.361583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:09.363020 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:09.363334 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:09.363644 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:09.363644 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:32:09.365401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:09.365401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.365871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:09.365871 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.365871 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:09.365871 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.365871 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.365871 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:09.365871 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.365871 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:09.366898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.366898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:09.366898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:09.366898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:09.366898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.366898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:09.366898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:09.366898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:09.366898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.366898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:09.366898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:09.366898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:09.366898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:09.366898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:09.366898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:09.367342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:09.367342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:09.367342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.367342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:09.367342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.367342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.367342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:09.367342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.367342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:09.368063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.368063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:09.368063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:09.368063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:09.368063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.368063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:09.368063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:09.368063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:32:09.368063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:09.368063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:09.368063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.368063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:09.368404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:09.368404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:09.368404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.368404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:09.368404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:09.368404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:09.368404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:09.368404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:09.368404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:09.368404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:09.368404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:09.368404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.368404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:09.368404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.369062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.369062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:09.369062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.369062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:09.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:09.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:09.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:09.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:09.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:09.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:09.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:09.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:09.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:09.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:09.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:09.369540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:09.369994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:09.370492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.370492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:09.370492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.370492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.370492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:09.370492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.370492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:09.372387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:09.372786 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:09.372971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:09.373158 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:09.373549 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:09.373754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.374337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:09.374337 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.374337 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:09.374337 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.374337 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.374337 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:09.374337 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.374337 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:09.375167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.375167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:09.375167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:09.375167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:09.375167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.375167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:09.375167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:09.375167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:09.375167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.375167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:09.375167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:09.375167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:09.375167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:09.375167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:09.375167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:09.375638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:09.375638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:09.375638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.375638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:09.375638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.375638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.375638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:09.375638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.375638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:09.376324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.376324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:09.376324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:09.376324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:09.376324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.376324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:09.376324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:09.376324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:09.376324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:09.376324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.376324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:09.376692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:09.376692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:09.376692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.376692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:09.376692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:09.376692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:09.376692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:09.376692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:09.376692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:09.376692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:09.376692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:09.376692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.376692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:09.376692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.377077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.377077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:09.377077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.377077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.378693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:09.379040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.379376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.379376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:09.379376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.379376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:09.380274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:09.381235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:09.381235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:09.381235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:09.381328 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:09.381585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:09.381693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.382179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:09.382179 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.382179 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:09.382179 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.382179 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.382179 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:09.382179 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.382179 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:09.383333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.383333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:09.383333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:09.383333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:09.383333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.383333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:09.383333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:09.383333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.383333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:09.383333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:09.383333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:09.383333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.383616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:09.383616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:09.383616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:09.383616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:09.383616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:09.383616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:09.383616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:09.383616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:09.383616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.383616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:09.383616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.383616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.383616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:09.385096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.385096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:09.385096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.385096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:09.385096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:09.385096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:09.385096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:09.385096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:09.385096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.385096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:09.385096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:09.385096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.385096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:09.385096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:09.385096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:09.385452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:09.385902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:09.385902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:09.385902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:09.385902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:09.385902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:09.385902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:14.307646 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:14.308296 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:14.308296 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:14.309205 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:14.341191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:14.341491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.342168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:14.342168 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.342168 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:14.342168 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.342168 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.342168 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:14.342168 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.342168 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:14.343212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.343212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:14.343212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:14.343212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:14.343212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.343212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:14.343212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:14.343212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.343212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:14.343212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:14.343212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:14.343212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.343731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:14.343731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:14.343731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:14.343731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:14.343731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:14.343731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:14.343731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:14.343731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:14.343731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.343731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:14.343731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.343731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.343731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:14.344140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.344140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:14.344445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.344445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:14.344445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:14.344445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:14.344445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:14.344445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:14.344445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.344445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:14.344445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:14.344445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.344445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:14.344445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:14.344445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.344445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:14.344445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:14.344445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.344995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.345532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:14.345532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.345532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:14.356601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:14.357137 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:14.357385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:14.359232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:14.359500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:14.359651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.360353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:14.360353 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.360353 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:14.360353 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.360353 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.360353 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:14.360353 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.360353 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:14.361342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.361342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:14.361342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:14.361342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:14.361342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.361342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:14.361342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:14.361342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.361342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:14.361342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:14.361342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:14.361342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.361938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:14.361938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:14.361938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:14.361938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:14.361938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:14.361938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:14.361938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:14.361938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:14.361938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.361938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:14.361938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.361938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.361938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:14.362537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.362537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:14.362537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.362537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:14.362537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:14.362537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:14.362537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:14.362537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:14.362537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.362537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:14.362537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:14.362537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.362537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:14.362537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:14.362537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:14.363204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.364041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:14.364041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.364041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.364041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:14.364041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.364041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:14.364041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:14.364041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:14.364041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:14.364041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:32:14.364730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:14.364730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.365341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:14.365341 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.365341 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:14.365341 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.365341 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.365341 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:14.365341 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.365341 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:14.366078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.366078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:14.366078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:14.366078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:14.366078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.366078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:14.366078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:14.366078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:14.366078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.366078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:14.366078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:14.366078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:14.366078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:14.366078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:14.366078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:14.366791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:14.366791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:14.366791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.366791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:14.366791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.366791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.366791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:14.366791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.366791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:14.367298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.367298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:14.367298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:14.367298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:14.367298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.367298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:14.367298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:14.367298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:32:14.367298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:14.367298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:14.367298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.367298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:14.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:14.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:14.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:14.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:14.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:14.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:14.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:14.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:14.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:14.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:14.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:14.367838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.368414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.368414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:14.368414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.368414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:14.369035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.369035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:14.369035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:14.369035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:14.369035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:14.369035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:14.369035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.369035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:14.369035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:14.369035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.369035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:14.369035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:14.369035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.369035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:14.369035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:14.369035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:14.369582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:14.370166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.370166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:14.370166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.370166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.370166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:14.370166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.370166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:14.372900 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:14.373165 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:14.373293 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:14.373440 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:14.374025 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:14.374285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.374868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:14.374868 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.374868 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:14.374868 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.374868 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.374868 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:14.374868 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.374868 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:14.375998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.375998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:14.375998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:14.375998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:14.375998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.375998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:14.375998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:14.375998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:14.375998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.375998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:14.375998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:14.375998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:14.375998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:14.375998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:14.375998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:14.376646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:14.376646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:14.376646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.376646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:14.376646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.376646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.376646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:14.376646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.376646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:14.377152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.377152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:14.377152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:14.377152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:14.377152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.377152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:14.377152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:14.377152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:14.377152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:14.377152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.377152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:14.377561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:14.377561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:14.377561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.377561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:14.377561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:14.377561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:14.377561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:14.377561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:14.377561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:14.377561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:14.377561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:14.377561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.377561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:14.377561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.377965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.377965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:14.377965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.377965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.379107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:14.379730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.380226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.380226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:14.380226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.380226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:14.380868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:14.381230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:14.381361 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:14.381583 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:14.383920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:14.384194 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:14.384336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.385006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:14.385006 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.385006 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:14.385006 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.385006 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.385006 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:14.385006 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.385006 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:14.386049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.386049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:14.386049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:14.386049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:14.386049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.386049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:14.386049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:14.386049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.386049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:14.386049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:14.386049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:14.386049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.386529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:14.386529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:14.386529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:14.386529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:14.386529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:14.386529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:14.386529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:14.386529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:14.386529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.386529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:14.386529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.386529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.386529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:14.386917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.386917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:14.388448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.388448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:14.388448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:14.388448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:14.388448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:14.388448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:14.388448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.388448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:14.388448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:14.388448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.388448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:14.388448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:14.388448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.388448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:14.388448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:14.388448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:14.388973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:14.389483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:14.389483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:14.389483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:19.308323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:19.309110 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:19.309110 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:19.309630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:19.347054 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:19.347294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.348187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:19.348187 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.348187 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:19.348187 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.348187 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.348187 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:19.348187 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.348187 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:19.348996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.348996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:19.348996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:19.348996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:19.348996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.348996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:19.348996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:19.348996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.348996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:19.348996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:19.348996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:19.348996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.349694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:19.349694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:19.349694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:19.349694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:19.349694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:19.349694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:19.349694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:19.349694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:19.349694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.349694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:19.349694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.349694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.349694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:19.350421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.350421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:19.350421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.350421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:19.350421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:19.350421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:19.350421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:19.350421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:19.350421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.350421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:19.350421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:19.350421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.350421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:19.350421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:19.350421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:19.351540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.353040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:19.353040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.353040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.353040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:19.353040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.353040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:19.357083 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:19.357333 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:19.357438 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:19.358028 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:19.358266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:19.358444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.359060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:19.359060 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.359060 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:19.359060 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.359060 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.359060 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:19.359060 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.359060 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:19.360588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.360588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:19.360588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:19.360588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:19.360588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.360588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:19.360588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:19.360588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.360588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:19.360588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:19.360588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:19.360588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.361088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:19.361705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.361705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:19.362492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.362492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:19.362492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:19.362492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:19.362492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:19.362492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:19.362492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.362492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:19.362492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:19.362492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.362492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:19.362492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:19.362492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.362492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:19.362492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:19.362492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.363243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.364127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:19.364127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.364127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:19.364127 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:19.365575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:19.365575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:19.365575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:32:19.365575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:19.365833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.366256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:19.366256 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.366256 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:19.366256 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.366256 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.366256 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:19.366256 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.366256 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:19.367209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.367209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:19.367209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:19.367209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:19.367209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.367209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:19.367209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:19.367209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:19.367209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.367209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:19.367209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:19.367209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:19.367209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:19.367209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:19.367209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:19.367575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:19.367575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:19.367575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.367575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:19.367575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.367575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.367575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:19.367575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.367575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:19.368007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.368007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:19.368007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:19.368007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:19.368007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.368007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:19.368007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:19.368007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:32:19.368007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:19.368007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:19.368007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.368007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:19.368273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:19.368273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:19.368273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.368273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:19.368273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:19.368273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:19.368273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:19.368273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:19.368273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:19.368273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:19.368273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:19.368273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.368273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:19.368273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.368552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.368552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:19.368552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.368552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:19.369542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.369542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:19.369542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:19.369542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:19.369542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:19.369542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:19.369542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.369542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:19.369542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:19.369542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.369542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:19.369542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:19.369542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.369542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:19.369542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:19.369542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:19.370307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:19.371071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.371071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:19.371071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.371071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.371071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:19.371071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.371071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:19.373339 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:19.373581 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:19.373668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:19.373808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:19.374226 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:19.374521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.375134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:19.375134 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.375134 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:19.375134 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.375134 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.375134 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:19.375134 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.375134 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:19.376353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.376353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:19.376353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:19.376353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:19.376353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.376353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:19.376353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:19.376353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:19.376353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.376353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:19.376353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:19.376353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:19.376353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:19.376353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:19.376353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:19.376850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:19.376850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:19.376850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.376850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:19.376850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.376850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.376850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:19.376850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.376850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:19.377491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.377491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:19.377491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:19.377491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:19.377491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.377491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:19.377491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:19.377491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:19.377491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:19.377491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.377491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:19.377897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:19.377897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:19.377897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.377897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:19.377897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:19.377897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:19.377897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:19.377897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:19.377897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:19.377897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:19.377897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:19.377897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.377897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:19.377897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.378302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.378302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:19.378302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.378302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.379191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:19.379918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.380483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.380483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:19.380483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.380483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:19.381359 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:19.381609 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:19.381778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:19.382007 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:19.382390 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:19.382669 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:19.382806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.384252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:19.384252 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.384252 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:19.384252 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.384252 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.384252 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:19.384252 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.384252 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:19.384671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.384671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:19.384671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:19.384671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:19.384671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.384671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:19.384671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:19.384671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.384671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:19.384671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:19.384671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:19.384671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.385088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:19.385088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:19.385088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:19.385088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:19.385088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:19.385088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:19.385088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:19.385088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:19.385088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.385088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:19.385088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.385088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.385088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:19.385512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.385512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:19.386063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.386063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:19.386063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:19.386063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:19.386063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:19.386063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:19.386063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.386063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:19.386063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:19.386063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.386063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:19.386063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:19.386063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.386063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:19.386063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:19.386063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:19.386585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:19.387085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:19.387085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:19.387085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:24.311407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:24.311407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:24.311407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:24.311407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:24.346774 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:24.347039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.347584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:24.347584 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.347584 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:24.347584 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.347584 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.347584 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:24.347584 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.347584 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:24.348690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.348690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:24.348690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:24.348690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:24.348690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.348690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:24.348690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:24.348690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.348690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:24.348690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:24.348690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:24.348690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.349166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:24.349166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:24.349166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:24.349166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:24.349166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:24.349166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:24.349166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:24.349166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:24.349166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.349166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:24.349166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.349166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.349166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:24.349694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.349694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:24.349771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.349771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:24.349771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:24.349771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:24.349771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:24.349771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:24.349771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.349771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:24.349771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:24.349771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.349771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:24.349771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:24.349771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.349771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:24.349771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:24.349771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.350651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.351650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:24.351650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.351650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:24.357967 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:24.358466 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:24.358466 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:24.360927 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:24.361166 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:24.361361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.362008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:24.362008 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.362008 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:24.362008 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.362008 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.362008 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:24.362008 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.362008 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:24.362914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.362914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:24.362914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:24.362914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:24.362914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.362914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:24.362914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:24.362914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.362914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:24.362914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:24.362914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:24.362914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.363270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:24.363270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:24.363270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:24.363270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:24.363270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:24.363270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:24.363270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:24.363270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:24.363270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.363270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:24.363270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.363270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.363270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:24.363548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.363548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:24.364107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.364107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:24.364107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:24.364107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:24.364107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:24.364107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:24.364107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.364107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:24.364107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:24.364107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.364107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:24.364107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:24.364107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.364107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:24.364107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:24.364107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.364644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.365029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:24.365029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.365029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:24.365029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:24.365029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:24.365029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:24.365029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:32:24.365610 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:24.365610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.366172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:24.366172 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.366172 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:24.366172 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.366172 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.366172 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:24.366172 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.366172 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:24.366915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.366915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:24.366915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:24.366915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:24.366915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.366915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:24.366915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:24.366915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:24.366915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.366915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:24.366915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:24.366915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:24.366915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:24.366915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:24.366915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:24.367517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:24.367517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:24.367517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.367517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:24.367517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.367517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.367517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:24.367517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.367517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:24.367908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.367908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:24.367908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:24.367908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:24.367908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.367908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:24.367908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:24.367908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:32:24.367908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:24.367908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:24.367908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.367908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:24.368547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:24.368547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:24.368547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.368547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:24.368547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:24.368547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:24.368547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:24.368547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:24.368547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:24.368547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:24.368547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:24.368547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.368547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:24.368547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.368819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.368819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:24.368819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.368819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:24.368898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.368898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:24.368898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:24.368898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:24.368898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:24.368898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:24.368898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.368898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:24.368898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:24.368898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.368898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:24.368898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:24.368898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.368898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:24.368898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:24.368898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:24.369189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:24.369527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.369527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:24.369527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.369527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.369527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:24.369527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.369527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:24.374386 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:24.374837 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:24.374951 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:24.375286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:24.375727 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:24.375982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.376582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:24.376582 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.376582 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:24.376582 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.376582 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.376582 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:24.376582 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.376582 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:24.377332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.377332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:24.377332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:24.377332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:24.377332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.377332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:24.377332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:24.377332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:24.377332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.377332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:24.377332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:24.377332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:24.377332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:24.377332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:24.377332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:24.378123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:24.378123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:24.378123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.378123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:24.378123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.378123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.378123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:24.378123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.378123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:24.378581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.378581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:24.378581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:24.378581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:24.378581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.378581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:24.378581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:24.378581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:24.378581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:24.378581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.378581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:24.379182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:24.379182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:24.379182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.379182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:24.379182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:24.379182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:24.379182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:24.379182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:24.379182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:24.379182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:24.379182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:24.379182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.379182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:24.379182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.379995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.379995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:24.379995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.379995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:24.379995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.379995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:24.379995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:24.379995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:24.379995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:24.379995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:24.379995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.379995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:24.379995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:24.379995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:24.380972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:24.383870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:24.383870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:24.383870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:24.383870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:24.383870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.383870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:24.383870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.383870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.383870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:24.383870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.383870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:24.383870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:24.383870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:24.384259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:24.384259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:24.384259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:24.384259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:24.384259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.386517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:24.386517 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.386517 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:24.386517 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.386517 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.386517 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:24.386517 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.386517 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:24.386517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.386517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:24.386517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:24.386517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:24.386517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.386517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:24.386517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:24.386956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.386956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:24.386956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:24.386956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:24.386956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.386956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:24.386956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:24.386956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:24.386956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:24.386956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:24.386956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:24.386956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:24.386956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:24.386956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.387326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:24.387326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.387326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.387326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:24.387326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.387326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:24.387326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.387326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:24.387326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:24.387326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:24.387326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:24.387326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:24.387326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.387326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:24.387713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:24.388214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:24.388214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:24.388214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:24.388214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:24.388214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:24.388214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:24.388214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:24.388214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:24.388214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:24.388214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:29.444908 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:29.445301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:29.445301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:29.445301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:29.445301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:29.446140 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:29.446454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:29.448348 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:29.479903 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:29.480256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.481082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:29.481082 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.481082 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:29.481082 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.481082 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.481082 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:29.481082 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.481082 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:29.481865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.481865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:29.481865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:29.481865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:29.481865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.481865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:29.481865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:29.481865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.481865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:29.481865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:29.481865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:29.481865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.482149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:29.482149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:29.482149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:29.482149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:29.482149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:29.482149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:29.482149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:29.482149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:29.482149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.482149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:29.482149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.482149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.482149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:29.482435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.482435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:29.482652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.482652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:29.482652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:29.482652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:29.482652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:29.482652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:29.482652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.482652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:29.482652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:29.482652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.482652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:29.482652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:29.482652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.482652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:29.482652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:29.482652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.482996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.484061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:29.484061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.484061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:29.484061 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:29.484061 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:29.484061 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:29.484061 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:29.484319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.485553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:29.485553 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.485553 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:29.485553 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.485553 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.485553 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:29.485553 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.485553 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:29.487037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.487037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:29.487037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:29.487037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:29.487037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.487037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:29.487037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:29.487037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.487037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:29.487037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:29.487037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:29.487037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.487635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:29.487635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:29.487635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:29.487635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:29.487635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:29.487635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:29.487635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:29.487635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:29.487635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.487635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:29.487635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.487635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.487635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:29.487993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.487993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:29.487993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.487993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:29.487993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:29.487993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:29.487993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:29.487993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:29.487993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.487993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:29.487993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:29.487993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.487993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:29.487993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:29.487993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:29.488417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.488930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:29.488930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.488930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.488930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:29.488930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.488930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:29.488930 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:29.488930 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:29.488930 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:32:29.488930 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:29.489213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.490164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:29.490164 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.490164 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:29.490164 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.490164 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.490164 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:29.490164 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.490164 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:29.491021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.491021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:29.491021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:29.491021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:29.491021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.491021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:29.491021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:29.491021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:29.491021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.491021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:29.491021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:29.491021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:29.491021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:29.491021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:29.491021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:29.491478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:29.491478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:29.491478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.491478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:29.491478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.491478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.491478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:29.491478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.491478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:29.492010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.492010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:29.492010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:29.492010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:29.492010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.492010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:29.492010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:29.492010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:32:29.492010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:29.492010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:29.492010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.492010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:29.492360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:29.492360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:29.492360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.492360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:29.492360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:29.492360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:29.492360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:29.492360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:29.492360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:29.492360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:29.492360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:29.492360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.492360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:29.492360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.492718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.492718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:29.492718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.492718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:29.493386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.493386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:29.493386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:29.493386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:29.493386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:29.493386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:29.493386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.493386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:29.493386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:29.493386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.493386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:29.493386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:29.493386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.493386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:29.493386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:29.493386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:29.493844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:29.494305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.494305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:29.494305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.494305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.494305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:29.494305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.494305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:29.494532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:29.494784 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:29.495016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:29.495475 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:29.495769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.496250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:29.496250 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.496250 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:29.496250 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.496250 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.496250 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:29.496250 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.496250 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:29.497032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.497032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:29.497032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:29.497032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:29.497032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.497032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:29.497032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:29.497032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:29.497032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.497032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:29.497032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:29.497032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:29.497032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:29.497032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:29.497032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:29.497448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:29.497448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:29.497448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.497448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:29.497448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.497448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.497448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:29.497448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.497448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:29.497933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.497933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:29.497933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:29.497933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:29.497933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.497933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:29.497933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:29.497933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:29.497933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:29.497933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.497933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:29.498386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:29.498386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:29.498386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.498386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:29.498386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:29.498386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:29.498386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:29.498386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:29.498386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:29.498386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:29.498386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:29.498386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.498386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:29.498386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.498722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.498722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:29.498722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.498722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.498981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:29.499456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.499973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.499973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:29.499973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.499973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:29.499973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:29.499973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:29.499973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:29.499973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:29.500199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:29.500258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.500935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:29.500935 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.500935 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:29.500935 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.500935 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.500935 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:29.500935 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.500935 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:29.501535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.501535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:29.501535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:29.501535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:29.501535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.501535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:29.501535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:29.501535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.501535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:29.501535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:29.501535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:29.501535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.501871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:29.501871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:29.501871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:29.501871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:29.501871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:29.501871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:29.501871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:29.501871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:29.501871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.501871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:29.501871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.501871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.501871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:29.502195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.502195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:29.502195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.502195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:29.502195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:29.502195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:29.502195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:29.502195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:29.502195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.502195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:29.502195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:29.502195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.502195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:29.502195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:29.502195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:29.502604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:29.503072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:29.503072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:29.503072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:29.503072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:29.503072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:29.503072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:34.445800 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:34.510282 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:34.510737 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:34.510862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:34.510980 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:34.511287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:34.511447 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:34.512126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:34.551482 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:34.551482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.554132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:34.554132 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.554132 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:34.554132 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.554132 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.554132 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:34.554132 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.554132 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:34.554132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.554132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:34.554132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:34.554132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:34.554132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.554132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:34.554132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:34.555017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.555017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:34.555017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:34.555017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:34.555017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.555017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:34.555017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:34.555017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:34.555017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:34.555017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:34.555017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:34.555017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:34.555017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:34.555017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.555660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:34.555660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.555660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.555660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:34.555660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.555660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:34.555660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.555660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:34.555660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:34.555660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:34.555660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:34.555660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:34.555660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.555660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:34.556457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:34.557599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:34.557599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:34.557599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.557599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:34.557599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.557599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.557599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:34.557599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.557599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:34.557599 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:34.557599 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:34.557599 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:34.561695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:34.561695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.561695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:34.561695 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.561695 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:34.561695 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.561695 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.561695 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:34.561695 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.561695 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:34.561695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.561695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:34.561695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:34.561695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:34.562811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.562811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:34.562811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:34.562811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.562811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:34.562811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:34.562811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:34.562811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.562811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:34.562811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:34.562811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:34.562811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:34.562811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:34.562811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:34.563909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:34.563909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:34.563909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.563909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:34.563909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.563909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.563909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:34.563909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.563909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:34.563909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.563909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:34.563909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:34.564837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.568958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:34.568958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:34.568958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:34.568958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:34.568958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:34.568958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:34.568958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:34.568958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:34.568958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.568958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:34.568958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.568958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.568958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:34.568958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.568958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:34.568958 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:34.569421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:34.569421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:32:34.569421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:34.569421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.569421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:34.569421 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.569421 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:34.569421 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.569421 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.569421 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:34.569421 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.569421 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:34.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:34.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:34.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:34.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:34.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:34.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:34.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:34.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:34.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:34.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:34.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:34.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:34.570166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:34.570166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:34.570166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.570166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:34.570166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.570166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.570166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:34.570166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.570166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:34.570166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.570166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:34.570166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:34.570166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:34.570166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.570589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:34.570589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:34.570589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:32:34.570589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:34.570589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:34.570589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.570589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:34.570589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:34.570589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:34.570589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.570589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:34.570589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:34.570589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:34.570937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:34.570937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:34.570937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:34.570937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:34.570937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:34.570937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.570937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:34.570937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.570937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.570937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:34.570937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.570937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:34.571264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.571264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:34.571264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:34.571264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:34.571264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:34.571264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:34.571264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.571264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:34.571264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:34.571264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.571264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:34.571264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:34.571264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.571264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:34.571264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:34.571264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:34.571807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:34.572270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.572270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:34.572270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.572270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.572270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:34.572270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.572270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:34.572270 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:34.572270 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:34.572270 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:34.572579 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:34.572579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.572579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:34.572579 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.572579 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:34.572579 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.572579 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.572579 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:34.572579 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.572579 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:34.572579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.572579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:34.572579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:34.572579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.573010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:34.573499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.573499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:34.573499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.573499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:34.573499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:34.573499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:34.573499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.573499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:34.573499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:34.573499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:34.573499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:34.573499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.573773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:34.573773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:34.573773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:34.573773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.573773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:34.573773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:34.573773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:34.573773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:34.573773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:34.573773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:34.573773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:34.573773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:34.573773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.573773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:34.574094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.574094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.574094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:34.574094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.574094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:34.574094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.574094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:34.574094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:34.574094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:34.574094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:34.574094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:34.574094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.574094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:34.574094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:34.574094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:34.574465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:34.574813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:34.574813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:34.574813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:34.574813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:34.574813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.574813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:34.574813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.574813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.574813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:34.574813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.574813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:34.574813 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:34.574813 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:34.575044 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:34.575044 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:34.575246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:34.575395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.575966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:34.575966 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.575966 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:34.575966 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.575966 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.575966 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:34.575966 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.575966 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:34.577847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.577847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:34.577847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:34.577847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:34.577847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.577847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:34.577847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:34.577847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.577847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:34.577847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:34.577847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:34.577847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.578151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:34.578151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:34.578151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:34.578151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:34.578151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:34.578151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:34.578151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:34.578151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:34.578151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.578151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:34.578151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.578151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.578151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:34.578424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.578424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:34.579818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.579818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:34.579818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:34.579818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:34.579818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:34.579818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:34.579818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.579818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:34.579818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:34.579818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.579818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:34.579818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:34.579818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.579818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:34.579818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:34.579818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:34.580130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:34.580492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:34.580492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:34.580492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:39.511636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:39.512158 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:39.512346 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:39.590961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:39.590961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:39.590961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:39.590961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:39.590961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:39.607850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:39.607850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.607973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:39.607973 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.607973 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:39.607973 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.607973 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.607973 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:39.607973 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.607973 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:39.608887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.096 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.608887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:39.608887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:39.608887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:39.608887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.608887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:39.608887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:39.608887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.608887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:39.608887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:39.608887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:39.608887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.609185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:39.609185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:39.609185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:39.609185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:39.609185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:39.609185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:39.609185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:39.609185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:39.609185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.609185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:39.609185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.609185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.609185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:39.609483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.609483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:39.610674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.610674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:39.610674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:39.610674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:39.610674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:39.610674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:39.610674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.610674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:39.610674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:39.610674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.610674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:39.610674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:39.610674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.610674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:39.610674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:39.610674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.611553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:39.611553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.611553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:39.611553 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:39.611553 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:39.613777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:39.614043 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:39.614291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.615983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:39.615983 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.615983 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:39.615983 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.615983 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.615983 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:39.615983 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.615983 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:39.615983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.615983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:39.615983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:39.615983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:39.615983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.615983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:39.615983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:39.616479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.616479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:39.616479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:39.616479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:39.616479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.616479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:39.616479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:39.616479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:39.616479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:39.616479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:39.616479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:39.616479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:39.616479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:39.616479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.616866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:39.616866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.616866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.616866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:39.616866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.616866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:39.616866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.616866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:39.616866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:39.616866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:39.616866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:39.616866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:39.616866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.616866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:39.617281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:39.617840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:39.617840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:39.617840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:39.617840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.617840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:39.617840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.617840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.617840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:39.617840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.617840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:39.617840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:39.617840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:39.618155 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:32:39.621133 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:39.621133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.621405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:39.621405 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.621405 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:39.621405 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.621405 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.621405 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:39.621405 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.621405 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:39.622744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.622744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:39.622744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:39.622744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:39.622744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.622744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:39.622744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:39.622744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:39.622744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.622744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:39.622744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:39.622744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:39.622744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:39.622744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:39.622744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:39.623669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:39.623669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:39.623669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.623669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:39.623669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.623669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.623669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:39.623669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.623669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:39.624136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.006 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.624136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:39.624136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:39.624136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:39.624136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.624136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:39.624136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:39.624136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:32:39.624136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:39.624136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:39.624136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.624136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:39.624443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:39.624443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:39.624443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.624443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:39.624443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:39.624443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:39.624443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:39.624443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:39.624443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:39.624443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:39.624443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:39.624443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.624443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:39.624443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.624703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.624703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:39.624703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.624703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:39.626347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.626347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:39.626347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:39.626347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:39.626347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:39.626347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:39.626347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.626347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:39.626347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:39.626347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.626347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:39.626347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:39.626347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.626347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:39.626347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:39.626347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:39.626693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:39.627056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.627056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:39.627056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.627056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.627056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:39.627056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.627056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:39.627056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:39.627056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:39.627056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:39.631119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:39.631119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.632756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:39.632756 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.632756 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:39.632756 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.632756 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.632756 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:39.632756 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.632756 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:39.633813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.633813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:39.633813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:39.633813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:39.633813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.633813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:39.633813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:39.633813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:39.633813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.633813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:39.633813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:39.633813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:39.633813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:39.633813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:39.633813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:39.634129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:39.634129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:39.634129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.634129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:39.634129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.634129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.634129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:39.634129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.634129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:39.635266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.007 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.635266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:39.635266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:39.635266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:39.635266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.635266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:39.635266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:39.635266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:39.635266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:39.635266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.635266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:39.635542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:39.635542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:39.635542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.635542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:39.635542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:39.635542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:39.635542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:39.635542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:39.635542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:39.635542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:39.635542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:39.635542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.635542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:39.635542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.635788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.635788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:39.635788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.635788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.637708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:39.638052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.638452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.638452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:39.638452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.638452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:39.638452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:39.638452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:39.638452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:39.641039 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:39.641254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:39.641382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.641964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:39.641964 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.641964 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:39.641964 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.641964 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.641964 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:39.641964 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.641964 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:39.643075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.643075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:39.643075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:39.643075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:39.643075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.643075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:39.643075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:39.643075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.643075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:39.643075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:39.643075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:39.643075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.643552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:39.643552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:39.643552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:39.643552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:39.643552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:39.643552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:39.643552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:39.643552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:39.643552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.643552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:39.643552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.643552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.643552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:39.644400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.644400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:39.644400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.644400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:39.644400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:39.644400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:39.644400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:39.644400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:39.644400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.644400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:39.644400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:39.644400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.644400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:39.644400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:39.644400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:39.644817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:39.645493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:39.645493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:39.645493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:39.645493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:39.645493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:39.645493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:44.512507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:44.513289 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:44.513289 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:44.514191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:44.554226 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:44.554226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.554226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:44.554226 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.554226 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:44.554226 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.554226 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.554226 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:44.554226 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.554226 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:44.555393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.555393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:44.555393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:44.555393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:44.555393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.555393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:44.555393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:44.555393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.555393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:44.555393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:44.555393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:44.555393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.556085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:44.556085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:44.556085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:44.556085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:44.556085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:44.556085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:44.556085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:44.556085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:44.556085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.556085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:44.556085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.556085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.556085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:44.556761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.556761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:44.556761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.556761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:44.556761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:44.556761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:44.556761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:44.556761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:44.556761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.556761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:44.556761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:44.556761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.556761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:44.556761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:44.556761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:44.557528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.558956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:44.558956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.558956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.558956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:44.558956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.558956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:44.665586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:44.665586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:44.665586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:44.665586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:44.665799 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:44.665799 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:44.667406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:44.667406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:44.667406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.667406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:44.667406 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.667406 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:44.667406 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.667406 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.667406 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:44.667406 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.667406 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:44.669116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.669116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:44.669116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:44.669116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:44.669116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.669116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:44.669116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:44.669116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.669116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:44.669116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:44.669116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:44.669116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.669803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:44.669803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:44.669803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:44.669803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:44.669803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:44.669803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:44.669803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:44.669803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:44.669803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.669803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:44.669803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.669803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.669803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:44.670085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.670085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:44.670085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.670085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:44.670085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:44.670085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:44.670085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:44.670085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:44.670085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.670085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:44.670085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:44.670085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.670085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:44.670085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:44.670085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:44.670420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.671489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:44.671489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.671489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.671489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:44.671489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.671489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:44.671489 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:44.671489 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:44.671489 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:32:44.671489 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:44.671703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.671909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:44.671909 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.671909 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:44.671909 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.671909 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.671909 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:44.671909 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.671909 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:44.672833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.672833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:44.672833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:44.672833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:44.672833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.672833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:44.672833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:44.672833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:44.672833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.672833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:44.672833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:44.672833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:44.672833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:44.672833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:44.672833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:44.673178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:44.673178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:44.673178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.673178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:44.673178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.673178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.673178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:44.673178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.673178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:44.674119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.674119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:44.674119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:44.674119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:44.674119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.674119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:44.674119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:44.674119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:32:44.674119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:44.674119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:44.674119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.674119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:44.674917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:44.674917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:44.674917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.674917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:44.674917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:44.674917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:44.674917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:44.674917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:44.674917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:44.674917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:44.674917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:44.674917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.674917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:44.674917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.675181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.675181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:44.675181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.675181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:44.675814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.675814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:44.675814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:44.675814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:44.675814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:44.675814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:44.675814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.675814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:44.675814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:44.675814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.675814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:44.675814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:44.675814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.675814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:44.675814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:44.675814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:44.676167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:44.676543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.676543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:44.676543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.676543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.676543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:44.676543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.676543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:44.676543 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:44.676543 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:44.676543 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:44.677653 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:44.677795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.678383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:44.678383 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.678383 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:44.678383 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.678383 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.678383 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:44.678383 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.678383 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:44.679117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.679117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:44.679117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:44.679117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:44.679117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.679117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:44.679117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:44.679117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:44.679117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.679117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:44.679117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:44.679117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:44.679117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:44.679117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:44.679117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:44.679992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:44.679992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:44.679992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.679992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:44.679992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.679992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.679992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:44.679992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.679992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:44.679992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.679992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:44.679992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:44.679992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:44.679992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.680709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:44.680709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:44.680709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:44.680709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:44.680709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.680709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:44.680709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:44.680709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:44.680709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.680709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:44.680709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:44.680709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:44.680709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:44.680942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:44.680942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:44.680942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:44.680942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:44.680942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.680942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:44.680942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.680942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.680942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:44.680942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.680942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.681150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:44.682277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.682635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.682635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:44.682635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.682635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:44.682635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:44.682635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:44.682635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:44.682635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:44.682801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:44.682801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.682801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:44.682801 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.682801 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:44.682801 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.682801 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.682801 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:44.682801 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.682801 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:44.683492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.683492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:44.683492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:44.683492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:44.683492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.683492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:44.683492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:44.683492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.683492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:44.683492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:44.683492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:44.683492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.683812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:44.683812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:44.683812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:44.683812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:44.683812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:44.683812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:44.683812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:44.683812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:44.683812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.683812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:44.683812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.683812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.683812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:44.684095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.684095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:44.686107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.686107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:44.686107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:44.686107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:44.686107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:44.686107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:44.686107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.686107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:44.686107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:44.686107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.686107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:44.686107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:44.686107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.686107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:44.686107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:44.686107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:44.686462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:44.686918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:44.686918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:44.686918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:49.513080 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:49.513656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:49.513656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:49.514456 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:49.547644 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:49.547855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.548319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:49.548319 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.548319 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:49.548319 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.548319 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.548319 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:49.548319 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.548319 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:49.549129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.549129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:49.549129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:49.549129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:49.549129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.549129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:49.549129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:49.549129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.549129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:49.549129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:49.549129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:49.549129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.549726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:49.549726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:49.549726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:49.549726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:49.549726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:49.549726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:49.549726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:49.549726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:49.549726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.549726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:49.549726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.549726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.549726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:49.550458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.550458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:49.550458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.550458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:49.550458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:49.550458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:49.550458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:49.550458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:49.550458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.550458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:49.550458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:49.550458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.550458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:49.550458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:49.550458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:49.551118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.551922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:49.551922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.551922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.551922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:49.551922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.551922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:49.665826 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:49.666493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:49.666700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:49.667681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:49.667871 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:49.667986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.706758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:49.706758 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.706758 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:49.706758 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.706758 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.706758 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:49.706758 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.706758 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:49.706758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.706758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:49.706758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:49.706758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:49.706758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.706758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:49.706758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:49.708609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.708609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:49.708609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:49.708609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:49.708609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.708609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:49.708609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:49.708609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:49.708609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:49.708609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:49.708609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:49.708609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:49.708609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:49.708609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.710081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:49.710081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.710081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.710081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:49.710081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.710081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:49.710081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.710081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:49.710081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:49.710081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:49.710081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:49.710081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:49.710081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.710081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:49.711251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:49.712223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:49.712223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:49.712223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:49.712223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.712223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:49.712223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.712223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.712223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:49.712223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.712223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:49.712223 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:49.712223 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:49.713254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:49.713254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:32:49.713254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:49.713254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.713254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:49.713254 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.713254 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:49.713254 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.713254 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.713254 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:49.713254 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.713254 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:49.714516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.714516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:49.714516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:49.714516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:49.714516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.714516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:49.714516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:49.714516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:49.714516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.714516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:49.714516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:49.714516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:49.714516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:49.714516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:49.714516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:49.714904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:49.714904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:49.714904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.714904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:49.714904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.714904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.714904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:49.714904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.714904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:49.714904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.714904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:49.714904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:49.714904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:49.714904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.715444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:49.715444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:49.715444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:32:49.715444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:49.715444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:49.715444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.715444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:49.715444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:49.715444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:49.715444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.715444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:49.715444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:49.715444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:49.715889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:49.715889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:49.715889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:49.715889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:49.715889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:49.715889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.715889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:49.715889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.715889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.715889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:49.715889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.715889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:49.716244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.716244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:49.716244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:49.716244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:49.716244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:49.716244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:49.716244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.716244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:49.716244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:49.716244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.716244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:49.716244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:49.716244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.716244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:49.716244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:49.716244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:49.716776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:49.717256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.717256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:49.717256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.717256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.717256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:49.717256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.717256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:49.717256 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:49.717256 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:49.717256 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:49.717575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:49.717575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:49.717575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.717575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:49.717575 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.717575 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:49.717575 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.717575 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.717575 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:49.717575 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.717575 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:49.717575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:49.718078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.718545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:49.718545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.718545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.718545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:49.718545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.718545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:49.718545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.718545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:49.718545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:49.718545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:49.718545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.718545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:49.718545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:49.718905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:49.718905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:49.718905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.718905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:49.718905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:49.718905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:49.718905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.718905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:49.718905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:49.718905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:49.718905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:49.718905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:49.718905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:49.719249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:49.719249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:49.719249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.719249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:49.719249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.719249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.719249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:49.719249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.719249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:49.719249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.719568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:49.720303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.721361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.721361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:49.721361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.721361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:49.721361 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:49.721361 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:49.721361 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:49.721361 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:49.721804 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:49.721804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.721804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:49.721804 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.721804 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:49.721804 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.721804 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.721804 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:49.721804 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.721804 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:49.721804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.721804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:49.721804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:49.721804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:49.722307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.722307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:49.722307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:49.722307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.722307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:49.722307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:49.722307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:49.722307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.722307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:49.722307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:49.722307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:49.722307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:49.722307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:49.722307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:49.722765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:49.722765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:49.722765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.722765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:49.722765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.722765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.722765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:49.722765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.722765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:49.722765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.722765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:49.722765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:49.723116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:49.723534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:49.723534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:49.723534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:49.723534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:49.723534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:49.723534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:49.723534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:49.723534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:49.723534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:49.723534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:49.723534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:49.723534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:49.723534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:49.723534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:49.723534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:54.513765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:54.514429 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:54.514429 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:54.514928 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:54.516250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=226 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:32:54.552256 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:54.552635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.553323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:54.553323 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.553323 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:54.553323 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.553323 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.553323 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:54.553323 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.553323 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:54.554127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.554127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:54.554127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:54.554127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:54.554127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.554127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:54.554127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:54.554127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.554127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:54.554127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:54.554127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:54.554127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.554752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:54.554752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:54.554752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:54.554752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:54.554752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:54.554752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:54.554752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:54.554752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:54.554752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.554752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:54.554752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.554752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.554752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:54.555028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.555028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:54.555028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.555028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:54.555028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:54.555028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:54.555028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:54.555028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:54.555028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.555028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:54.555028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:54.555028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.555028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:54.555028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:54.555028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:54.555350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.555797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:54.555797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.555797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.555797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:54.555797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.555797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:54.666416 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:54.666810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:54.666882 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:54.667994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:54.668404 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:54.668499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.672723 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:54.679755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:54.683039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:54.683039 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.683039 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:54.683039 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.683039 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.683039 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:54.683039 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.683039 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:54.684919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.016 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.684919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:54.684919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:54.684919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:54.684919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.684919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:54.684919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:54.684919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.684919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:54.684919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:54.684919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:54.684919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.685353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:54.685353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:54.685353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:54.685353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:54.685353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:54.685353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:54.685353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:54.685353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:54.685353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.685353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:54.685353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.685353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.685353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:54.685741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.685741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:54.685741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:54.690178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.690178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:54.690178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:54.690178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:54.690178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:54.690178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:54.690178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.690178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:54.690178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:54.690178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.690178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:54.690178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:54.690178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.690178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:54.690178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:54.690178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.690765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.691304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:54.691304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.691304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:54.691304 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:54.691304 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:54.691304 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:32:54.691879 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:54.692096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.692813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:54.692813 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.692813 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:54.692813 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.692813 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.692813 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:54.692813 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.692813 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:54.693871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.693871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:54.693871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:54.693871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:54.693871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.693871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:54.693871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:54.693871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:54.693871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.693871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:54.693871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:54.693871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:54.693871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:54.693871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:54.693871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:54.694437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:54.694437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:54.694437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.694437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:54.694437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.694437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.694437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:54.694437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.694437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:54.695218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.695218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:54.695218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:54.695218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:54.695218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.695218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:54.695218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:54.695218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:32:54.695218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:54.695218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:54.695218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.695218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:54.695720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:54.695720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:54.695720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.695720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:54.695720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:54.695720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:54.695720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:54.695720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:54.695720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:54.695720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:54.695720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:54.695720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.695720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:54.695720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.696123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.696123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:54.696123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.696123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:54.696598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.696598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:54.696598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:54.696598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:54.696598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:54.696598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:54.696598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.696598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:54.696598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:54.696598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.696598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:54.696598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:54.696598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.696598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:54.696598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:54.696598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:54.697092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:54.697822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.697822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:54.697822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.697822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.697822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:54.697822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.697822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:54.697822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:54.697822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:54.697822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:54.698140 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:54.698140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.698217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:54.698217 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.698217 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:54.698217 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.698217 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.698217 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:54.698217 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.698217 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:54.698900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.698900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:54.698900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:54.698900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:54.698900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.698900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:54.698900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:54.698900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:54.698900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.698900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:54.698900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:54.698900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:54.698900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:54.698900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:54.698900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:54.699312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:54.699312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:54.699312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.699312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:54.699312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.699312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.699312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:54.699312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.699312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:54.699796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.699796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:54.699796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:54.699796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:54.699796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.699796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:54.699796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:54.699796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:54.699796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:54.699796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.699796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:54.700149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:54.700149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:54.700149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.700149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:54.700149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:54.700149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:54.700149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:54.700149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:54.700149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:54.700149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:54.700149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:54.700149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.700149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:54.700149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.700549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.700549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:54.700549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.700549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.700834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:54.701310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.701878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.701878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:54.701878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.701878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:54.701878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:54.701878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:54.701878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:54.701878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:54.702129 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:54.702169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.705411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:54.705411 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.705411 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:54.705411 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.705411 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.705411 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:54.705411 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.705411 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:54.705411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.705411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:54.705411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:54.705411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:54.705411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.705411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:54.705411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:54.705971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.705971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:54.705971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:54.705971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:54.705971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.705971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:54.705971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:54.705971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:54.705971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:54.705971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:54.705971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:54.705971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:54.705971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:54.705971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.706390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:54.706390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.706390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.706390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:54.706390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.706390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:54.706390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.706390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:54.706390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:54.706390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:54.706390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:54.706390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:54.706390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.706390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:54.706831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:54.707417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:54.707417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:54.707417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:54.707417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:54.707417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:54.707417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:54.707417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:54.707417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:54.707417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:54.707417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:59.514359 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:59.515093 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:59.515093 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:59.515971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:59.558287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:59.558877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.560036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:59.560036 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.560036 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:59.560036 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.560036 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.560036 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:59.560036 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.560036 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:59.561419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.045 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.561419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:59.561419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:59.561419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:59.561419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.561419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:59.561419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:59.561419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.561419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:59.561419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:59.561419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:59.561419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.562414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:59.562414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:59.562414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:59.562414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:59.562414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:59.562414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:59.562414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:59.562414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:59.562414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.562414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:59.562414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.562414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.562414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:59.565633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.565633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:59.565633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.565633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:59.565633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:59.565633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:59.565633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:59.565633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:59.565633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.565633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:59.565633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:59.565633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.565633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:59.565633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:59.565633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:59.568737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.569759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:59.569759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.569759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.569759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:59.569759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.569759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:59.667116 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:59.667969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:59.668237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:59.669458 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:59.669825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:59.670040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.670957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:59.670957 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.670957 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:59.670957 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.670957 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.670957 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:59.670957 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.670957 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:59.672875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.672875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:59.672875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:59.672875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:59.672875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.672875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:59.672875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:59.672875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.672875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:59.672875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:59.672875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:59.672875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.673581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:59.673581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:59.673581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:59.673581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:59.673581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:59.673581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:59.673581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:59.673581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:59.673581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.673581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:59.673581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.673581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.673581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:59.674660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.674660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:59.674660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.674660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:59.674660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:59.674660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:59.674660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:59.674660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:59.674660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.674660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:59.674660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:59.674660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.674660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:59.674660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:59.674660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:59.674946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.675338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:59.675338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.675338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.675338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:59.675338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.675338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:59.690775 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:59.691624 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:59.691725 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:59.691876 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:32:59.692445 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:59.692738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.693461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:59.693461 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.693461 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:59.693461 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.693461 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.693461 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:59.693461 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.693461 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:59.694470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.694470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:59.694470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:59.694470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:59.694470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.694470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:59.694470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:59.694470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:59.694470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.694470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:59.694470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:59.694470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:59.694470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:59.694470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:59.694470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:59.695143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:59.695143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:59.695143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.695143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:59.695143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.695143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.695143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:59.695143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.695143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:59.695477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.695477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:59.695477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:59.695477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:59.695477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.695477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:59.695477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:59.695477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:32:59.695477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:59.695477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:59.695477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.695477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:59.695906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:59.695906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:59.695906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.695906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:59.695906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:59.695906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:59.695906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:59.695906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:59.695906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:59.695906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:59.695906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:59.695906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.695906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:59.695906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.696393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.696393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:59.696393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.696393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:59.698341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.698341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:59.698341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:59.698341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:59.698341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:59.698341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:59.698341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.698341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:59.698341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:59.698341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.698341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:59.698341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:59.698341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.698341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:59.698341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:59.698341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:59.699201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:59.699825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.699825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:59.699825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.699825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.699825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:59.699825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.699825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:59.699825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:59.699825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:59.699825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:59.700198 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:59.700198 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:59.700198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.701293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:59.701293 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.701293 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:59.701293 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.701293 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.701293 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:59.701293 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.701293 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:59.704413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.704413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:32:59.704413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:59.704413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:59.704413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.704413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:59.704413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:59.704413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:59.704413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.704413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:32:59.704413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:59.704413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:32:59.704413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:59.704413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:32:59.704413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:32:59.705760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:59.705760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:32:59.705760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.705760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:32:59.705760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.705760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.705760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:32:59.705760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.705760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:32:59.705760 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:32:59.706034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.706034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:59.706034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:59.706034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:59.706034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.706034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:59.706034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:59.706034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:59.706034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:59.706034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.706034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:59.706245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:59.706245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:59.706245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.706245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:59.706245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:59.706245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:59.706245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:59.706245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:59.706245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:59.706245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:59.706245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:59.706245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.706245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:59.706245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.706509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.706509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:59.706509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.706509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.707169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:59.707513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.707902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.707902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:59.707902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.707902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:32:59.707902 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:32:59.707902 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:32:59.707902 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:32:59.708186 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:59.708487 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:32:59.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.710928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:32:59.710928 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.710928 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:32:59.710928 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.710928 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.710928 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:32:59.710928 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.710928 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:32:59.711905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.711905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:32:59.711905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:59.711905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:32:59.711905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.711905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:59.711905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:59.711905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.711905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:59.711905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:59.711905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:59.711905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.712708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:32:59.712708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:59.712708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:32:59.712708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:59.712708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:32:59.712708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:32:59.712708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:59.712708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:32:59.712708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.712708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:32:59.712708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.712708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.712708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:32:59.713308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.713308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:32:59.713308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.713308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:32:59.713308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:32:59.713308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:32:59.713308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:32:59.713308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:32:59.713308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.713308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:32:59.713308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:32:59.713308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.713308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:32:59.713308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:32:59.713308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:32:59.713708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:32:59.715231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:32:59.715231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:32:59.715231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:32:59.715231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:32:59.715231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:32:59.715231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:04.515003 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:04.515678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:04.515678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:04.516407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:04.549261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:04.549718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.550397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:04.550397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.550397 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:04.550397 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.550397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.550397 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:04.550397 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.550397 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:04.551281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.551281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:04.551281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:04.551281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:04.551281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.551281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:04.551281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:04.551281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.551281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:04.551281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:04.551281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:04.551281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.551775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:04.551775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:04.551775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:04.551775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:04.551775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:04.551775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:04.551775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:04.551775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:04.551775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.551775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:04.551775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.551775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.551775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:04.552283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.552283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:04.552283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.552283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:04.552283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:04.552283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:04.552283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:04.552283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:04.552283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.552283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:04.552283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:04.552283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.552283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:04.552283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:04.552283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:04.552846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.553451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:04.553451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.553451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.553451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:04.553451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.553451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:04.667592 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:04.668255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:04.668339 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:04.669385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:04.669667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:04.669865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.670568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:04.670568 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.670568 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:04.670568 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.670568 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.670568 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:04.670568 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.670568 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:04.671941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.671941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:04.671941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:04.671941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:04.671941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.671941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:04.671941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:04.671941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.671941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:04.671941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:04.671941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:04.671941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.672454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:04.672454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:04.672454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:04.672454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:04.672454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:04.672454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:04.672454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:04.672454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:04.672454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.672454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:04.672454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.672454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.672454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:04.672885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.672885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:04.673561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.673561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:04.673561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:04.673561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:04.673561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:04.673561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:04.673561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.673561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:04.673561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:04.673561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.673561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:04.673561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:04.673561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.673561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:04.673561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:04.673561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.674056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.674632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:04.674632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.674632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:04.692135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:04.692577 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:04.692699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:04.692971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:33:04.693882 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:04.694301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.695238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:04.695238 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.695238 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:04.695238 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.695238 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.695238 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:04.695238 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.695238 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:04.696351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.696351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:04.696351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:04.696351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:04.696351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.696351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:04.696351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:04.696351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:04.696351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.696351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:04.696351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:04.696351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:04.696351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:04.696351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:04.696351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:04.697361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:04.697361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:04.697361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.697361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:04.697361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.697361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.697361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:04.697361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.697361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:04.697954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.697954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:04.697954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:04.697954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:04.697954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.697954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:04.697954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:04.697954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:33:04.697954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:04.697954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:04.697954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.697954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:04.698583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:04.698583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:04.698583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.698583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:04.698583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:04.698583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:04.698583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:04.698583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:04.698583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:04.698583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:04.698583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:04.698583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.698583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:04.698583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.699203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.699203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:04.699203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.699203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:04.699203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.699203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:04.699203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:04.699203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:04.699203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:04.699203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:04.699203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.699203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:04.699203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:04.699203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:04.700383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:04.701211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:04.701211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:04.701211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:04.701211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:04.701211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:04.701211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.701211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:04.701211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.701211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.701211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:04.701211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.701211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:04.701211 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:04.701211 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:04.701561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:04.701561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:04.701561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:04.701561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.701561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:04.701561 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.701561 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:04.701561 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.701561 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.701561 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:04.701561 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.701561 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:04.702110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.702110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:04.702110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:04.702110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:04.702110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.702110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:04.702110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:04.702110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:04.702110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.702110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:04.702110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:04.702110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:04.702110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:04.702110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:04.702110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:04.702433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:04.702433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:04.702433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.702433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:04.702433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.702433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.702433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:04.702433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.702433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:04.703482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.703482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:04.703482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:04.703482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:04.703482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.703482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:04.703482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:04.703482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:04.703482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:04.703482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.703482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:04.703741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:04.703741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:04.703741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.703741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:04.703741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:04.703741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:04.703741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:04.703741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:04.703741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:04.703741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:04.703741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:04.703741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.703741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:04.703741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.704008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.704008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:04.704008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.704008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.708396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:04.708786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.709292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.709292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:04.709292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.709292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:04.709292 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:04.709292 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:04.709292 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:04.709292 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:04.709567 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:04.709567 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:04.709567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.710233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:04.710233 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.710233 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:04.710233 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.710233 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.710233 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:04.710233 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.710233 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:04.711208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.711208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:04.711208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:04.711208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:04.711208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.711208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:04.711208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:04.711208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.711208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:04.711208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:04.711208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:04.711208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.711471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:04.711471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:04.711471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:04.711471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:04.711471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:04.711471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:04.711471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:04.711471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:04.711471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.711471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:04.711471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.711471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.711471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:04.711702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.711702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:04.712462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.712462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:04.712462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:04.712462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:04.712462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:04.712462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:04.712462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.712462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:04.712462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:04.712462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.712462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:04.712462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:04.712462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.712462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:04.712462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:04.712462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:04.712793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:04.713362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:04.713362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:04.713362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:09.515898 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:09.516730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:09.516730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:09.517799 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:09.551873 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:09.552116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.552656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:09.552656 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.552656 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:09.552656 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.552656 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.552656 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:09.552656 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.552656 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:09.553592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.553592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:09.553592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:09.553592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:09.553592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.553592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:09.553592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:09.553592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.553592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:09.553592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:09.553592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:09.553592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.554230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:09.554230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:09.554230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:09.554230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:09.554230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:09.554230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:09.554230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:09.554230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:09.554230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.554230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:09.554230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.554230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.554230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:09.554942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.554942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:09.554942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.554942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:09.554942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:09.554942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:09.554942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:09.554942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:09.554942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.554942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:09.554942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:09.554942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.554942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:09.554942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:09.554942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:09.555968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.556785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:09.556785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.556785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.556785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:09.556785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.556785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:09.668326 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:09.668945 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:09.669128 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:09.669934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:09.670158 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:09.670320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.671175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:09.671175 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.671175 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:09.671175 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.671175 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.671175 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:09.671175 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.671175 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:09.672620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.672620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:09.672620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:09.672620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:09.672620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.672620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:09.672620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:09.672620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.672620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:09.672620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:09.672620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:09.672620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.673237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:09.673237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:09.673237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:09.673237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:09.673237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:09.673237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:09.673237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:09.673237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:09.673237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.673237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:09.673237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.673237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.673237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:09.673833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.673833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:09.674274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.674274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:09.674274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:09.674274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:09.674274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:09.674274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:09.674274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.674274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:09.674274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:09.674274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.674274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:09.674274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:09.674274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.674274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:09.674274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:09.674274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.675011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.675678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:09.675678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.675678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:09.692834 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:09.693462 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:09.693665 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:09.693870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:33:09.695024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:09.695225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.695901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:09.695901 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.695901 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:09.695901 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.695901 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.695901 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:09.695901 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.695901 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:09.697205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.697205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:09.697205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:09.697205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:09.697205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.697205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:09.697205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:09.697205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:09.697205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.697205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:09.697205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:09.697205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:09.697205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:09.697205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:09.697205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:09.698034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:09.698034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:09.698034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.698034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:09.698034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.698034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.698034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:09.698034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.698034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:09.698633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.698633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:09.698633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:09.698633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:09.698633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.698633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:09.698633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:09.698633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:33:09.698633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:09.698633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:09.698633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.698633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:09.699269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:09.699269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:09.699269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.699269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:09.699269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:09.699269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:09.699269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:09.699269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:09.699269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:09.699269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:09.699269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:09.699269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.699269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:09.699269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.699789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.699789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:09.699789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.699789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:09.700979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.700979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:09.700979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:09.700979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:09.700979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:09.700979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:09.700979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.700979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:09.700979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:09.700979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.700979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:09.700979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:09.700979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.700979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:09.700979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:09.700979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:09.701720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:09.702507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.702507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:09.702507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.702507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.702507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:09.702507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.702507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:09.702507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:09.702507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:09.702507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:09.702880 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:09.702880 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:09.702880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.703459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:09.703459 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.703459 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:09.703459 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.703459 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.703459 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:09.703459 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.703459 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:09.704831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.704831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:09.704831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:09.704831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:09.704831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.704831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:09.704831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:09.704831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:09.704831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.704831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:09.704831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:09.704831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:09.704831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:09.704831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:09.704831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:09.705493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:09.705493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:09.705493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.705493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:09.705493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.705493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.705493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:09.705493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.705493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:09.706253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.706253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:09.706253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:09.706253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:09.706253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.706253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:09.706253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:09.706253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:09.706253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:09.706253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.706253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:09.706806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:09.706806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:09.706806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.706806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:09.706806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:09.706806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:09.706806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:09.706806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:09.706806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:09.706806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:09.706806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:09.706806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.706806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:09.706806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.707364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.707364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:09.707364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.707364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.708454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:09.709283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.709972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.709972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:09.709972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.709972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:09.709972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:09.709972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:09.709972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:09.709972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:09.710474 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:09.710474 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:09.710603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.711593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:09.711593 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.711593 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:09.711593 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.711593 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.711593 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:09.711593 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.711593 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:09.712185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.712185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:09.712185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:09.712185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:09.712185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.712185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:09.712185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:09.712185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.712185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:09.712185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:09.712185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:09.712185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.712685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:09.712685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:09.712685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:09.712685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:09.712685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:09.712685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:09.712685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:09.712685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:09.712685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.712685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:09.712685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.712685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.712685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:09.713143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.713143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:09.713143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.713143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:09.713143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:09.713143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:09.713143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:09.713143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:09.713143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.713143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:09.713143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:09.713143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.713143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:09.713143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:09.713143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:09.713685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:09.714279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:09.714279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:09.714279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:09.714279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:09.714279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:09.714279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:14.518593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:14.518593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:14.518593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:14.519844 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:14.552808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:14.553000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.553639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:14.553639 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.553639 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:14.553639 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.553639 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.553639 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:14.553639 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.553639 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:14.554691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.554691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:14.554691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:14.554691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:14.554691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.554691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:14.554691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:14.554691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.554691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:14.554691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:14.554691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:14.554691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.554994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:14.554994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:14.554994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:14.554994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:14.554994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:14.554994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:14.554994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:14.554994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:14.554994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.554994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:14.554994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.554994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.554994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:14.555271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.555271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:14.556273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.556273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:14.556273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:14.556273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:14.556273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:14.556273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:14.556273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.556273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:14.556273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:14.556273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.556273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:14.556273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:14.556273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.556273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:14.556273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:14.556273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.556632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.557025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:14.557025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.557025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:14.668995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:14.669314 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:14.669481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:14.670681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:14.670910 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:14.671057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.673601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:14.673601 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.673601 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:14.673601 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.673601 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.673601 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:14.673601 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.673601 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:14.674566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.674566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:14.674566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:14.674566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:14.674566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.674566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:14.674566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:14.674566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.674566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:14.674566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:14.674566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:14.674566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.675019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:14.675019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:14.675019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:14.675019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:14.675019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:14.675019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:14.675019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:14.675019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:14.675019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.675019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:14.675019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.675019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.675019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:14.675358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.675358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:14.675700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.675700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:14.675700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:14.675700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:14.675700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:14.675700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:14.675700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.675700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:14.675700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:14.675700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.675700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:14.675700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:14.675700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.675700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:14.675700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:14.675700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.676127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.676652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:14.676652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.676652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:14.693393 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:14.693860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:14.693860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:14.693949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:33:14.694317 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:14.694714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.695230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:14.695230 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.695230 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:14.695230 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.695230 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.695230 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:14.695230 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.695230 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:14.695908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.695908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:14.695908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:14.695908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:14.695908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.695908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:14.695908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:14.695908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:14.695908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.695908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:14.695908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:14.695908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:14.695908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:14.695908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:14.695908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:14.696333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:14.696333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:14.696333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.696333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:14.696333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.696333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.696333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:14.696333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.696333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:14.697015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.697015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:14.697015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:14.697015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:14.697015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.697015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:14.697015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:14.697015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:33:14.697015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:14.697015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:14.697015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.697015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:14.697398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:14.697398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:14.697398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.697398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:14.697398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:14.697398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:14.697398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:14.697398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:14.697398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:14.697398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:14.697398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:14.697398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.697398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:14.697398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.697753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.697753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:14.697753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.697753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:14.697753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.697753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:14.697753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:14.697753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:14.697753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:14.697753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:14.697753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.697753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:14.697753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:14.697753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:14.698131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:14.698629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:14.698629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:14.698629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:14.698629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:14.698629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:14.698629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.698629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:14.698629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.698629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.698629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:14.698629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.698629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:14.701810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:14.702086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:14.702256 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:14.702456 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:14.702960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:14.703326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.704042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:14.704042 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.704042 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:14.704042 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.704042 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.704042 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:14.704042 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.704042 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:14.705092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.705092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:14.705092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:14.705092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:14.705092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.705092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:14.705092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:14.705092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:14.705092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.705092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:14.705092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:14.705092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:14.705092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:14.705092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:14.705092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:14.706142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:14.706142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:14.706142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.706142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:14.706142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.706142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.706142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:14.706142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.706142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:14.706412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.706412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:14.706412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:14.706412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:14.706412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.706412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:14.706412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:14.706412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:14.706412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:14.706412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.706412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:14.706711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:14.706711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:14.706711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.706711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:14.706711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:14.706711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:14.706711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:14.706711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:14.706711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:14.706711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:14.706711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:14.706711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.706711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:14.706711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.707089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.707089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:14.707089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.707089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.708105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:14.708574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.709066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.709066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:14.709066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.709066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:14.709066 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:14.709381 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:14.709485 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:14.709645 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:14.710071 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:14.710447 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:14.711015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.711467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:14.711467 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.711467 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:14.711467 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.711467 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.711467 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:14.711467 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.711467 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:14.712517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.712517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:14.712517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:14.712517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:14.712517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.712517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:14.712517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:14.712517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.712517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:14.712517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:14.712517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:14.712517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.712875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:14.712875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:14.712875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:14.712875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:14.712875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:14.712875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:14.712875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:14.712875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:14.712875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.712875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:14.712875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.712875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.712875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:14.713254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.713254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:14.713742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.713742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:14.713742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:14.713742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:14.713742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:14.713742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:14.713742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.713742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:14.713742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:14.713742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.713742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:14.713742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:14.713742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.713742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:14.713742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:14.713742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:14.714123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:14.714718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:14.714718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:14.714718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:19.516887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:19.517599 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:19.517599 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:19.518740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:19.580897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:19.581415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.582474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:19.582474 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.582474 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:19.582474 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.582474 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.582474 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:19.582474 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.582474 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:19.583722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.065 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.583722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:19.583722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:19.583722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:19.583722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.583722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:19.583722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:19.583722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.583722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:19.583722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:19.583722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:19.583722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.584127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:19.584127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:19.584127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:19.584127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:19.584127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:19.584127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:19.584127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:19.584127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:19.584127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.584127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:19.584127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.584127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.584127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:19.584538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.584538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:19.585067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.585067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:19.585067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:19.585067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:19.585067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:19.585067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:19.585067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.585067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:19.585067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:19.585067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.585067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:19.585067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:19.585067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.585067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:19.585067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:19.585067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.586518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.588232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:19.588232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.588232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:19.670107 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:19.670891 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:19.671079 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:19.672063 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:19.672311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:19.672522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.673186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:19.673186 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.673186 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:19.673186 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.673186 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.673186 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:19.673186 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.673186 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:19.674029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.674029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:19.674029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:19.674029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:19.674029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.674029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:19.674029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:19.674029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.674029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:19.674029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:19.674029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:19.674029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.674404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:19.674404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:19.674404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:19.674404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:19.674404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:19.674404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:19.674404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:19.674404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:19.674404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.674404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:19.674404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.674404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.674404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:19.674858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.674858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:19.674858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.674858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:19.674858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:19.674858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:19.674858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:19.674858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:19.674858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.674858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:19.674858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:19.674858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.674858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:19.674858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:19.674858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:19.675254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.675756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:19.675756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.675756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.675756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:19.675756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.675756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:19.693845 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:19.694295 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:19.694295 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:19.694384 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:33:19.697815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:19.698165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.698769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:19.698769 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.698769 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:19.698769 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.698769 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.698769 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:19.698769 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.698769 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:19.699470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.699470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:19.699470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:19.699470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:19.699470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.699470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:19.699470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:19.699470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:19.699470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.699470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:19.699470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:19.699470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:19.699470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:19.699470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:19.699470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:19.699895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:19.699895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:19.699895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.699895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:19.699895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.699895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.699895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:19.699895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.699895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:19.700140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.700140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:19.700140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:19.700140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:19.700140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.700140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:19.700140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:19.700140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:33:19.700140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:19.700140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:19.700140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.700140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:19.700507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:19.700507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:19.700507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.700507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:19.700507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:19.700507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:19.700507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:19.700507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:19.700507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:19.700507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:19.700507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:19.700507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.700507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:19.700507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.700849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.700849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:19.700849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.700849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:19.700849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.700849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:19.700849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:19.700849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:19.700849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:19.700849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:19.700849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.700849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:19.700849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:19.700849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:19.701222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:19.701722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:19.701722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:19.701722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:19.701722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:19.701722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:19.701722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.701722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:19.701722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.701722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.701722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:19.701722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.701722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:19.702710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:19.702710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:19.702710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:19.702710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:19.704207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:19.704207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.704207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:19.704207 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.704207 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:19.704207 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.704207 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.704207 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:19.704207 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.704207 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:19.704207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.704207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:19.704207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:19.704207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.704911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:19.705897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.705897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:19.705897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.705897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:19.705897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:19.705897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:19.705897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.705897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:19.705897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:19.705897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:19.705897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:19.705897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.706665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:19.706665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:19.706665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:19.706665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.706665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:19.706665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:19.706665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:19.706665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:19.706665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:19.706665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:19.706665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:19.706665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:19.706665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.706665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:19.707659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.707659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.707659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:19.707659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.707659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:19.707659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.707659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:19.707659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:19.707659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:19.707659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:19.707659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:19.707659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.707659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:19.707659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:19.707659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:19.708671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:19.709164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:19.709164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:19.709164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:19.709164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:19.709164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.709164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:19.709164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.709164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.709164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:19.709164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.709164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:19.709451 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:19.709606 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:19.709704 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:19.709826 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:19.710234 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:19.710514 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:19.710663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.711176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:19.711176 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.711176 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:19.711176 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.711176 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.711176 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:19.711176 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.711176 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:19.711863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.711863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:19.711863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:19.711863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:19.711863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.711863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:19.711863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:19.711863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.711863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:19.711863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:19.711863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:19.711863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.712201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:19.712201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:19.712201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:19.712201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:19.712201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:19.712201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:19.712201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:19.712201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:19.712201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.712201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:19.712201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.712201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.712201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:19.712482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.712482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:19.712544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.712544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:19.712544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:19.712544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:19.712544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:19.712544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:19.712544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.712544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:19.712544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:19.712544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.712544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:19.712544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:19.712544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.712544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:19.712544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:19.712544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:19.712914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:19.713278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:19.713278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:19.713278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:24.517638 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:24.518482 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:24.518482 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:24.518621 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:24.558980 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:24.559144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.559713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:24.559713 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.559713 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:24.559713 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.559713 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.559713 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:24.559713 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.559713 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:24.560421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.560421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:24.560421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:24.560421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:24.560421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.560421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:24.560421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:24.560421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.560421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:24.560421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:24.560421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:24.560421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.560861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:24.560861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:24.560861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:24.560861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:24.560861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:24.560861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:24.560861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:24.560861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:24.560861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.560861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:24.560861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.560861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.560861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:24.561227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.561227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:24.561227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.561227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:24.561227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:24.561227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:24.561227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:24.561227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:24.561227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.561227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:24.561227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:24.561227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.561227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:24.561227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:24.561227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:24.561698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.562231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:24.562231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.562231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.562231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:24.562231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.562231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:24.670790 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:24.671143 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:24.671223 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:24.671878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:24.672009 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:24.672199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.673318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:24.673318 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.673318 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:24.673318 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.673318 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.673318 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:24.673318 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.673318 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:24.674062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.674062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:24.674062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:24.674062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:24.674062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.674062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:24.674062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:24.674062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.674062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:24.674062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:24.674062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:24.674062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.674358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:24.674358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:24.674358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:24.674358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:24.674358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:24.674358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:24.674358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:24.674358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:24.674358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.674358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:24.674358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.674358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.674358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:24.674604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.674604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:24.674966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.674966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:24.674966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:24.674966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:24.674966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:24.674966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:24.674966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.674966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:24.674966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:24.674966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.674966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:24.674966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:24.674966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.674966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:24.674966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:24.674966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.675273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.675682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:24.675682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.675682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:24.694509 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:24.694813 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:24.694949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:24.695126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:33:24.695540 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:24.695711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.696311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:24.696311 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.696311 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:24.696311 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.696311 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.696311 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:24.696311 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.696311 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:24.697165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.697165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:24.697165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:24.697165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:24.697165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.697165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:24.697165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:24.697165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:24.697165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.697165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:24.697165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:24.697165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:24.697165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:24.697165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:24.697165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:24.697807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:24.697807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:24.697807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.697807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:24.697807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.697807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.697807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:24.697807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.697807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:24.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:24.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:24.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:24.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:24.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:24.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:33:24.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:24.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:24.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.698821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:24.699286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:24.699286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:24.699286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.699286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:24.699286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:24.699286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:24.699286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:24.699286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:24.699286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:24.699286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:24.699286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:24.699286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.699286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:24.699286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.699899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.699899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:24.699899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.699899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:24.699899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.699899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:24.699899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:24.699899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:24.699899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:24.699899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:24.699899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.699899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:24.699899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:24.699899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:24.700452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:24.701284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:24.701284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:24.701284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:24.701284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:24.701284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:24.701284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.701284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:24.701284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.701284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.701284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:24.701284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.701284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:24.702694 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:24.703679 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:24.703876 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:24.704070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:24.704580 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:24.704975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.705602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:24.705602 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.705602 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:24.705602 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.705602 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.705602 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:24.705602 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.705602 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:24.706614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.706614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:24.706614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:24.706614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:24.706614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.706614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:24.706614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:24.706614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:24.706614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.706614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:24.706614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:24.706614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:24.706614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:24.706614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:24.706614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:24.707271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:24.707271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:24.707271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.707271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:24.707271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.707271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.707271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:24.707271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.707271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:24.707979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.707979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:24.707979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:24.707979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:24.707979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.707979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:24.707979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:24.707979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:24.707979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:24.707979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.707979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:24.708473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:24.708473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:24.708473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.708473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:24.708473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:24.708473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:24.708473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:24.708473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:24.708473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:24.708473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:24.708473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:24.708473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.708473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:24.708473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.708867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.708867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:24.708867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.708867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.709808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:24.710408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.710879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.710879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:24.710879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.710879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:24.710879 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:24.710879 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:24.710879 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:24.710879 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:24.711118 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:24.711118 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:24.711210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.711587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:24.711587 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.711587 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:24.711587 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.711587 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.711587 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:24.711587 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.711587 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:24.712190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.712190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:24.712190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:24.712190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:24.712190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.712190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:24.712190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:24.712190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.712190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:24.712190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:24.712190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:24.712190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.712565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:24.712565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:24.712565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:24.712565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:24.712565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:24.712565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:24.712565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:24.712565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:24.712565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.712565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:24.712565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.712565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.712565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:24.712892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.712892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:24.712892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.712892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:24.712892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:24.712892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:24.712892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:24.712892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:24.712892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.712892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:24.712892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:24.712892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.712892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:24.712892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:24.712892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:24.713298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:24.713780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:24.713780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:24.713780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:24.713780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:24.713780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:24.713780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:29.518117 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:29.518846 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:29.518970 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:29.519969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:29.558847 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:29.559136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.559957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:29.559957 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.559957 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:29.559957 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.559957 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.559957 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:29.559957 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.559957 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:29.561307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.561307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:29.561307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:29.561307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:29.561307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.561307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:29.561307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:29.561307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.561307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:29.561307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:29.561307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:29.561307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.561743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:29.561743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:29.561743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:29.561743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:29.561743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:29.561743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:29.561743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:29.561743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:29.561743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.561743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:29.561743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.561743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.561743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:29.563015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.563015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:29.563015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.563015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:29.563015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:29.563015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:29.563015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:29.563015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:29.563015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.563015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:29.563015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:29.563015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.563015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:29.563015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:29.563015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:29.563978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.565004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:29.565004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.565004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.565004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:29.565004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.565004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:29.671562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:29.672138 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:29.672237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:29.673004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:29.673253 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:29.673488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.674173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:29.674173 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.674173 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:29.674173 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.674173 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.674173 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:29.674173 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.674173 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:29.675181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.675181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:29.675181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:29.675181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:29.675181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.675181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:29.675181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:29.675181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.675181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:29.675181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:29.675181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:29.675181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.675838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:29.675838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:29.675838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:29.675838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:29.675838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:29.675838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:29.675838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:29.675838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:29.675838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.675838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:29.675838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.675838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.675838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:29.676513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.676513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:29.677510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.677510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:29.677510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:29.677510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:29.677510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:29.677510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:29.677510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.677510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:29.677510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:29.677510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.677510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:29.677510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:29.677510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.677510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:29.677510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:29.677510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.678171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.678707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:29.678707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.678707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:29.695001 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:29.695604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:29.695695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:29.695862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:33:29.697010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:29.697504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.698378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:29.698378 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.698378 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:29.698378 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.698378 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.698378 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:29.698378 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.698378 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:29.699542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.699542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:29.699542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:29.699542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:29.699542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.699542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:29.699542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:29.699542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:29.699542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.699542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:29.699542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:29.699542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:29.699542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:29.699542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:29.699542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:29.700039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:29.700039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:29.700039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.700039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:29.700039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.700039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.700039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:29.700039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.700039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:29.700429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.700429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:29.700429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:29.700429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:29.700429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.700429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:29.700429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:29.700429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:33:29.700429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:29.700429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:29.700429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.700429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:29.700864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:29.700864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:29.700864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.700864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:29.700864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:29.700864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:29.700864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:29.700864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:29.700864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:29.700864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:29.700864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:29.700864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.700864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:29.700864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.701269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.701269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:29.701269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.701269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:29.701987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.701987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:29.701987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:29.701987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:29.701987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:29.701987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:29.701987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.701987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:29.701987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:29.701987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.701987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:29.701987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:29.701987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.701987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:29.701987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:29.701987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:29.702871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:29.703412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.703412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:29.703412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.703412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.703412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:29.703412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.703412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:29.703785 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:29.704053 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:29.704772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:29.704772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:29.704772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:29.705117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.705732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:29.705732 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.705732 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:29.705732 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.705732 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.705732 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:29.705732 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.705732 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:29.706551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.706551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:29.706551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:29.706551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:29.706551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.706551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:29.706551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:29.706551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:29.706551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.706551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:29.706551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:29.706551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:29.706551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:29.706551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:29.706551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:29.707019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:29.707019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:29.707019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.707019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:29.707019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.707019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.707019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:29.707019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.707019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:29.707487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.707487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:29.707487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:29.707487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:29.707487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.707487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:29.707487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:29.707487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:29.707487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:29.707487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.707487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:29.707858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:29.707858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:29.707858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.707858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:29.707858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:29.707858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:29.707858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:29.707858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:29.707858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:29.707858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:29.707858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:29.707858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.707858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:29.707858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.708258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.708258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:29.708258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.708258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.708756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:29.710110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.710648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.710648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:29.710648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.710648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:29.710648 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:29.710949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:29.711073 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:29.711212 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:29.711537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:29.711757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:29.711968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.712519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:29.712519 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.712519 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:29.712519 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.712519 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.712519 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:29.712519 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.712519 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:29.713660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.713660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:29.713660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:29.713660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:29.713660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.713660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:29.713660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:29.713660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.713660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:29.713660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:29.713660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:29.713660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.714065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:29.714065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:29.714065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:29.714065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:29.714065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:29.714065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:29.714065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:29.714065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:29.714065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.714065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:29.714065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.714065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.714065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:29.714311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.714311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:29.714711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.714711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:29.714711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:29.714711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:29.714711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:29.714711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:29.714711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.714711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:29.714711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:29.714711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.714711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:29.714711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:29.714711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.714711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:29.714711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:29.714711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:29.715044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:29.715406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:29.715406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:29.715406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:34.518904 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:34.520051 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:34.520051 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:34.520536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:34.553198 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:34.553472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.554008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:34.554008 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.554008 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:34.554008 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.554008 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.554008 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:34.554008 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.554008 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:34.554665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.554665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:34.554665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:34.554665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:34.554665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.554665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:34.554665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:34.554665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.554665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:34.554665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:34.554665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:34.554665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.555255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:34.555255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:34.555255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:34.555255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:34.555255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:34.555255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:34.555255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:34.555255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:34.555255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.555255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:34.555255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.555255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.555255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:34.555916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.555916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:34.555916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.555916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:34.555916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:34.555916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:34.555916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:34.555916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:34.555916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.555916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:34.555916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:34.555916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.555916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:34.555916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:34.555916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:34.556509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.557312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:34.557312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.557312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.557312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:34.557312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.557312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:34.675483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:34.676188 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:34.676465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:34.677391 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:34.677733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:34.677958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.678762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:34.678762 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.678762 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:34.678762 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.678762 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.678762 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:34.678762 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.678762 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:34.679845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.679845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:34.679845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:34.679845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:34.679845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.679845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:34.679845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:34.679845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.679845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:34.679845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:34.679845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:34.679845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.680265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:34.680265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:34.680265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:34.680265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:34.680265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:34.680265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:34.680265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:34.680265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:34.680265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.680265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:34.680265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.680265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.680265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:34.680652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.680652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:34.681390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.681390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:34.681390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:34.681390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:34.681390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:34.681390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:34.681390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.681390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:34.681390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:34.681390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.681390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:34.681390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:34.681390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.681390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:34.681390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:34.681390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.681844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.682383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:34.682383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.682383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:34.695685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:34.696109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:34.696206 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:34.696328 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:33:34.697481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:34.697785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.698580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:34.698580 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.698580 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:34.698580 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.698580 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.698580 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:34.698580 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.698580 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:34.699580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.699580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:34.699580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:34.699580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:34.699580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.699580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:34.699580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:34.699580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:34.699580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.699580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:34.699580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:34.699580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:34.699580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:34.699580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:34.699580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:34.700624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:34.700624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:34.700624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.700624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:34.700624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.700624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.700624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:34.700624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.700624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:34.700624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.700624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:34.700624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:34.700624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:34.700624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.701229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:34.701229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:34.701229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:33:34.701229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:34.701229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:34.701229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.701229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:34.701229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:34.701229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:34.701229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.701229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:34.701229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:34.701229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:34.701786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:34.701786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:34.701786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:34.701786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:34.701786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:34.701786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.701786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:34.701786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.701786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.701786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:34.701786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.701786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:34.702249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.702249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:34.702249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:34.702249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:34.702249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:34.702249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:34.702249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.702249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:34.702249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:34.702249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.702249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:34.702249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:34.702249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.702249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:34.702249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:34.702249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:34.704460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:34.705272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.705272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:34.705272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.705272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.705272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:34.705272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.705272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:34.705272 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:34.705272 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:34.705272 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:34.705769 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:34.705769 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:34.705883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.706518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:34.706518 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.706518 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:34.706518 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.706518 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.706518 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:34.706518 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.706518 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:34.707354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.707354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:34.707354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:34.707354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:34.707354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.707354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:34.707354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:34.707354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:34.707354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.707354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:34.707354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:34.707354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:34.707354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:34.707354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:34.707354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:34.708202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:34.708202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:34.708202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.708202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:34.708202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.708202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.708202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:34.708202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.708202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:34.708380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.708380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:34.708380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:34.708380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:34.708380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.708380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:34.708380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:34.708380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:34.708380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:34.708380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.708380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:34.708621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:34.708621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:34.708621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.708621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:34.708621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:34.708621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:34.708621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:34.708621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:34.708621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:34.708621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:34.708621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:34.708621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.708621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:34.708621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.708874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.708874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:34.708874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.708874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.709691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:34.710020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.710357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.710357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:34.710357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.710357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:34.711075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:34.711380 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:34.711507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:34.711816 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:34.713949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:34.714277 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:34.714544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.715214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:34.715214 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.715214 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:34.715214 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.715214 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.715214 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:34.715214 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.715214 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:34.716338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.716338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:34.716338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:34.716338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:34.716338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.716338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:34.716338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:34.716338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.716338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:34.716338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:34.716338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:34.716338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.716816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:34.716816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:34.716816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:34.716816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:34.716816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:34.716816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:34.716816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:34.716816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:34.716816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.716816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:34.716816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.716816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.716816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:34.717231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.717231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:34.717469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.717469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:34.717469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:34.717469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:34.717469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:34.717469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:34.717469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.717469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:34.717469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:34.717469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.717469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:34.717469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:34.717469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.717469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:34.717469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:34.717469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:34.717921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:34.718452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:34.718452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:34.718452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:39.521028 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:39.522062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:39.522144 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:39.522801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:39.558817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:39.559124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.559895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:39.559895 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.559895 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:39.559895 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.559895 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.559895 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:39.559895 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.559895 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:39.560666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.560666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:39.560666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:39.560666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:39.560666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.560666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:39.560666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:39.560666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.560666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:39.560666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:39.560666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:39.560666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.561300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:39.561300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:39.561300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:39.561300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:39.561300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:39.561300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:39.561300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:39.561300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:39.561300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.561300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:39.561300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.561300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.561300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:39.561894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.561894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:39.561894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.561894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:39.561894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:39.561894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:39.561894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:39.561894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:39.561894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.561894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:39.561894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:39.561894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.561894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:39.561894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:39.561894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:39.562546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.563320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:39.563320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.563320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.563320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:39.563320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.563320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:39.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:39.676541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:39.676810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:39.677650 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:39.678066 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:39.678325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.679398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:39.679398 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.679398 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:39.679398 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.679398 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.679398 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:39.679398 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.679398 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:39.680548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.680548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:39.680548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:39.680548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:39.680548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.680548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:39.680548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:39.680548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.680548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:39.680548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:39.680548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:39.680548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:39.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:39.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:39.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:39.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:39.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:39.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:39.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:39.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:39.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:39.681270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.681270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:39.682346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.682346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:39.682346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:39.682346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:39.682346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:39.682346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:39.682346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.682346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:39.682346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:39.682346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.682346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:39.682346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:39.682346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.682346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:39.682346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:39.682346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.682970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.683699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:39.683699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.683699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:39.696463 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:39.696866 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:39.697066 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:39.697266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:33:39.697871 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:39.698143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.698912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:39.698912 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.698912 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:39.698912 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.698912 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.698912 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:39.698912 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.698912 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:39.700317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.700317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:39.700317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:39.700317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:39.700317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.700317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:39.700317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:39.700317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:39.700317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.700317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:39.700317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:39.700317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:39.700317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:39.700317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:39.700317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:39.701332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:39.701332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:39.701332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.701332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:39.701332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.701332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.701332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:39.701332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.701332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:39.701332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.701332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:39.701332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:39.701332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:39.701332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.702276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:39.702276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:39.702276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:33:39.702276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:39.702276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:39.702276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.702276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:39.702276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:39.702276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:39.702276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.702276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:39.702276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:39.702276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:39.703160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:39.703160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:39.703160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:39.703160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:39.703160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:39.703160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.703160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:39.703160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.703160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.703160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:39.703160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.703160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:39.703941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.703941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:39.703941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:39.703941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:39.703941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:39.703941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:39.703941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.703941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:39.703941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:39.703941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.703941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:39.703941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:39.703941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.703941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:39.703941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:39.703941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:39.704995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:39.706215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.706215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:39.706215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.706215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.706215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:39.706215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.706215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:39.706215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:39.706215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:39.706215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:39.706703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:39.706703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:39.706703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.706977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:39.706977 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.706977 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:39.706977 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.706977 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.706977 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:39.706977 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.706977 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:39.707534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.707534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:39.707534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:39.707534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:39.707534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.707534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:39.707534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:39.707534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:39.707534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.707534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:39.707534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:39.707534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:39.707534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:39.707534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:39.707534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:39.707943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:39.707943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:39.707943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.707943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:39.707943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.707943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.707943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:39.707943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.707943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:39.708176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.708176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:39.708176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:39.708176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:39.708176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.708176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:39.708176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:39.708176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:39.708176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:39.708176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.708176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:39.708527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:39.708527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:39.708527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.708527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:39.708527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:39.708527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:39.708527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:39.708527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:39.708527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:39.708527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:39.708527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:39.708527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.708527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:39.708527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.708889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.708889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:39.708889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.708889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:39.708889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.708889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:39.708889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:39.708889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:39.708889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:39.708889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:39.708889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.708889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:39.708889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:39.708889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:39.709272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:39.709843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:39.709843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:39.709843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:39.709843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:39.709843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.709843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:39.709843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.709843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.709843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:39.709843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.709843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:39.711378 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:39.711624 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:39.711748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:39.711911 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:39.712273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:39.712825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:39.712825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.713330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:39.713330 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.713330 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:39.713330 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.713330 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.713330 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:39.713330 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.713330 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:39.714378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.714378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:39.714378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:39.714378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:39.714378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.714378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:39.714378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:39.714378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.714378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:39.714378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:39.714378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:39.714378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.714705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:39.714705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:39.714705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:39.714705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:39.714705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:39.714705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:39.714705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:39.714705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:39.714705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.714705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:39.714705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.714705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.714705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:39.714956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.714956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:39.715385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.715385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:39.715385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:39.715385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:39.715385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:39.715385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:39.715385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.715385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:39.715385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:39.715385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.715385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:39.715385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:39.715385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.715385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:39.715385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:39.715385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:39.715830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:39.716516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:39.716516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:39.716516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:44.523413 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:44.523413 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:44.523413 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:44.524332 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:44.567840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:44.567840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.568339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:44.568339 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.568339 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:44.568339 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.568339 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.568339 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:44.568339 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.568339 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:44.570070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.045 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.570070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:44.570070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:44.570070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:44.570070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.570070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:44.570070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:44.570070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.570070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:44.570070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:44.570070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:44.570070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.570838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:44.570838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:44.570838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:44.570838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:44.570838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:44.570838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:44.570838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:44.570838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:44.570838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.570838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:44.570838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.570838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.570838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:44.571729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.571729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:44.571729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.571729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:44.571729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:44.571729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:44.571729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:44.571729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:44.571729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.571729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:44.571729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:44.571729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.571729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:44.571729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:44.571729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:44.572612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.574211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:44.574211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.574211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.574211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:44.574211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.574211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:44.676759 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:44.677279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:44.677435 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:44.678282 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:44.678596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:44.678810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.679675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:44.679675 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.679675 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:44.679675 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.679675 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.679675 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:44.679675 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.679675 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:44.680586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.680586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:44.680586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:44.680586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:44.680586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.680586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:44.680586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:44.680586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.680586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:44.680586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:44.680586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:44.680586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.681080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:44.681080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:44.681080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:44.681080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:44.681080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:44.681080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:44.681080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:44.681080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:44.681080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.681080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:44.681080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.681080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.681080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:44.681498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.681498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:44.681588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.681588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:44.681588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:44.681588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:44.681588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:44.681588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:44.681588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.681588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:44.681588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:44.681588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.681588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:44.681588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:44.681588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.681588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:44.681588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:44.681588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.682017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.682549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:44.682549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.682549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:44.696902 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:44.697479 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:44.697590 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:44.697741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:33:44.698143 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:44.698356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.699179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:44.699179 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.699179 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:44.699179 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.699179 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.699179 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:44.699179 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.699179 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:44.700053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.700053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:44.700053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:44.700053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:44.700053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.700053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:44.700053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:44.700053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:44.700053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.700053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:44.700053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:44.700053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:44.700053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:44.700053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:44.700053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:44.700736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:44.700736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:44.700736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.700736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:44.700736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.700736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.700736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:44.700736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.700736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:44.701089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.701089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:44.701089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:44.701089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:44.701089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.701089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:44.701089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:44.701089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:33:44.701089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:44.701089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:44.701089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.701089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:44.701612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:44.701612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:44.701612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.701612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:44.701612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:44.701612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:44.701612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:44.701612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:44.701612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:44.701612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:44.701612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:44.701612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.701612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:44.701612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.702163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.702163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:44.702163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.702163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:44.702163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.702163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:44.702163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:44.702163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:44.702163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:44.702163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:44.702163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.702163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:44.702163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:44.702163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:44.702729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:44.704307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:44.704307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:44.704307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:44.704307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:44.704307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:44.704307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.704307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:44.704307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.704307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.704307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:44.704307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.704307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:44.705131 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:44.705452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:44.705547 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:44.705662 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:44.706026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:44.706306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.706866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:44.706866 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.706866 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:44.706866 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.706866 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.706866 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:44.706866 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.706866 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:44.707387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.707387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:44.707387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:44.707387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:44.707387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.707387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:44.707387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:44.707387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:44.707387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.707387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:44.707387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:44.707387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:44.707387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:44.707387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:44.707387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:44.707733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:44.707733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:44.707733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.707733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:44.707733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.707733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.707733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:44.707733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.707733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:44.708142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.708142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:44.708142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:44.708142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:44.708142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.708142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:44.708142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:44.708142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:44.708142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:44.708142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.708142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:44.708453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:44.708453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:44.708453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.708453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:44.708453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:44.708453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:44.708453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:44.708453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:44.708453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:44.708453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:44.708453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:44.708453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.708453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:44.708453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.708834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.708834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:44.708834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.708834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.708939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:44.709400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.709861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.709861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:44.709861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.709861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:44.711736 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:44.712121 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:44.712334 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:44.712603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:44.712972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:44.713238 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:44.713433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.714044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:44.714044 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.714044 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:44.714044 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.714044 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.714044 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:44.714044 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.714044 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:44.714949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.714949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:44.714949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:44.714949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:44.714949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.714949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:44.714949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:44.714949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.714949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:44.714949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:44.714949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:44.714949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.715284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:44.715284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:44.715284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:44.715284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:44.715284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:44.715284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:44.715284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:44.715284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:44.715284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.715284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:44.715284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.715284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.715284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:44.715676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.715676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:44.716033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.716033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:44.716033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:44.716033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:44.716033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:44.716033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:44.716033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.716033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:44.716033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:44.716033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.716033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:44.716033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:44.716033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.716033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:44.716033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:44.716033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:44.716493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:44.717189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:44.717189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:44.717189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:49.523302 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:49.524026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:49.524026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:49.524667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:49.560959 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:49.560959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.561273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:49.561273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.561273 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:49.561273 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.561273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.561273 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:49.561273 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.561273 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:49.562063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.562063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:49.562063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:49.562063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:49.562063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.562063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:49.562063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:49.562063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.562063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:49.562063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:49.562063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:49.562063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.563009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:49.563009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:49.563009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:49.563009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:49.563009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:49.563009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:49.563009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:49.563009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:49.563009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.563009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:49.563009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.563009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.563009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:49.564276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.564276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:49.564276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.564276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:49.564276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:49.564276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:49.564276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:49.564276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:49.564276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.564276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:49.564276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:49.564276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.564276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:49.564276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:49.564276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:49.565304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.566479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:49.566479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.566479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.566479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:49.566479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.566479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:49.677337 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:49.678537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:49.678686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:49.680131 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:49.681050 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:49.681242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.681992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:49.681992 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.681992 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:49.681992 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.681992 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.681992 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:49.681992 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.681992 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:49.682934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.682934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:49.682934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:49.682934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:49.682934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.682934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:49.682934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:49.682934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.682934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:49.682934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:49.682934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:49.682934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.683347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:49.683347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:49.683347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:49.683347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:49.683347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:49.683347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:49.683347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:49.683347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:49.683347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.683347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:49.683347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.683347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.683347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:49.683760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.683760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:49.683929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.683929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:49.683929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:49.683929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:49.683929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:49.683929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:49.683929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.683929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:49.683929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:49.683929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.683929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:49.683929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:49.683929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.683929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:49.683929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:49.683929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.685703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.686206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:49.686206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.686206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:49.697540 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:49.697978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:49.698056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:49.698159 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:33:49.699119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:49.699868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.701575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:49.701575 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.701575 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:49.701575 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.701575 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.701575 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:49.701575 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.701575 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:49.702527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.702527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:49.702527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:49.702527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:49.702527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.702527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:49.702527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:49.702527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:49.702527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.702527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:49.702527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:49.702527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:49.702527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:49.702527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:49.702527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:49.703150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:49.703150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:49.703150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.703150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:49.703150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.703150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.703150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:49.703150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.703150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:49.703564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.703564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:49.703564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:49.703564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:49.703564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.703564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:49.703564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:49.703564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:33:49.703564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:49.703564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:49.703564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.703564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:49.704052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:49.704052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:49.704052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.704052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:49.704052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:49.704052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:49.704052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:49.704052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:49.704052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:49.704052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:49.704052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:49.704052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.704052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:49.704052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.704612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.704612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:49.704612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.704612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:49.704612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.704612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:49.704612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:49.704612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:49.704612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:49.704612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:49.704612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.704612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:49.704612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:49.704612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:49.705188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:49.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:49.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:49.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:49.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:49.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:49.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:49.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:49.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:49.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:49.706205 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:49.706783 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:49.706783 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:49.706783 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:49.706942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.707470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:49.707470 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.707470 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:49.707470 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.707470 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.707470 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:49.707470 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.707470 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:49.708514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.708514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:49.708514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:49.708514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:49.708514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.708514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:49.708514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:49.708514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:49.708514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.708514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:49.708514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:49.708514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:49.708514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:49.708514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:49.708514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:49.708962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:49.708962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:49.708962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.708962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:49.708962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.708962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.708962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:49.708962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.708962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:49.709833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.709833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:49.709833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:49.709833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:49.709833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.709833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:49.709833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:49.709833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:49.709833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:49.709833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.709833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:49.710306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:49.710306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:49.710306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.710306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:49.710306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:49.710306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:49.710306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:49.710306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:49.710306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:49.710306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:49.710306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:49.710306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.710306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:49.710306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.710864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.710864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:49.710864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.710864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.711336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:49.712024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.712619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.712619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:49.712619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.712619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:49.712619 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:49.712619 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:49.712827 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:49.713096 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:49.713620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:49.713886 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:49.714036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.714708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:49.714708 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.714708 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:49.714708 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.714708 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.714708 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:49.714708 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.714708 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:49.715946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.715946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:49.715946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:49.715946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:49.715946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.715946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:49.715946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:49.715946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.715946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:49.715946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:49.715946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:49.715946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.716742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:49.716742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:49.716742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:49.716742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:49.716742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:49.716742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:49.716742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:49.716742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:49.716742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.716742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:49.716742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.716742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.716742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:49.717488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.717488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:49.717488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.717488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:49.717488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:49.717488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:49.717488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:49.717488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:49.717488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.717488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:49.717488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:49.717488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.717488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:49.717488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:49.717488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:49.718260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:49.719258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:49.719258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:49.719258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:49.719258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:49.719258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:49.719258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:54.524088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:54.524975 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:54.525065 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:54.526844 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:54.529708 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:33:54.562202 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:54.562515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.563269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:54.563269 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.563269 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:54.563269 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.563269 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.563269 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:54.563269 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.563269 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:54.564293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.564293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:54.564293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:54.564293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:54.564293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.564293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:54.564293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:54.564293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.564293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:54.564293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:54.564293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:54.564293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.564945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:54.564945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:54.564945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:54.564945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:54.564945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:54.564945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:54.564945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:54.564945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:54.564945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.564945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:54.564945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.564945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.564945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:54.565648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.565648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:54.565648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.565648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:54.565648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:54.565648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:54.565648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:54.565648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:54.565648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.565648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:54.565648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:54.565648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.565648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:54.565648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:54.565648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:54.566317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.567199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:54.567199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.567199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.567199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:54.567199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.567199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:54.680451 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:54.680451 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:54.680451 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:54.680451 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:54.680922 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:54.680922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.681541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:54.681541 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.681541 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:54.681541 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.681541 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.681541 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:54.681541 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.681541 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:54.683080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.683080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:54.683080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:54.683080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:54.683080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.683080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:54.683080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:54.683080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.683080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:54.683080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:54.683080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:54.683080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.683692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:54.683692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:54.683692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:54.683692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:54.683692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:54.683692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:54.683692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:54.683692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:54.683692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.683692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:54.683692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.683692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.683692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:54.684023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.684023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:54.684623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.684623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:54.684623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:54.684623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:54.684623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:54.684623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:54.684623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.684623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:54.684623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:54.684623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.684623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:54.684623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:54.684623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.684623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:54.684623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:54.684623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.685053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.685674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:54.685674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.685674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:54.698221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:54.698801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:54.699031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:54.699206 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:33:54.700039 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:54.700264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.700922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:54.700922 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.700922 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:54.700922 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.700922 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.700922 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:54.700922 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.700922 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:54.702261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.702261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:54.702261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:54.702261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:54.702261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.702261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:54.702261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:54.702261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:54.702261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.702261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:54.702261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:54.702261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:54.702261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:54.702261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:54.702261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:54.702679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:54.702679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:54.702679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.702679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:54.702679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.702679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.702679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:54.702679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.702679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:54.703703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.703703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:54.703703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:54.703703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:54.703703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.703703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:54.703703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:54.703703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:33:54.703703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:54.703703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:54.703703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.703703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:54.704143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:54.704143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:54.704143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.704143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:54.704143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:54.704143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:54.704143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:54.704143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:54.704143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:54.704143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:54.704143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:54.704143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.704143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:54.704143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.704664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.704664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:54.704664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.704664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:54.705362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.705362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:54.705362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:54.705362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:54.705362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:54.705362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:54.705362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.705362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:54.705362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:54.705362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.705362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:54.705362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:54.705362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.705362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:54.705362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:54.705362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:54.705974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:54.706592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.706592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:54.706592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.706592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.706592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:54.706592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.706592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:54.706592 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:54.706592 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:54.706969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:54.706969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:54.707340 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:54.707634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.708193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:54.708193 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.708193 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:54.708193 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.708193 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.708193 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:54.708193 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.708193 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:54.708901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.708901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:54.708901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:54.708901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:54.708901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.708901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:54.708901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:54.708901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:54.708901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.708901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:54.708901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:54.708901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:54.708901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:54.708901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:54.708901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:54.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:54.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:54.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:54.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:54.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.709316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:54.709742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.709742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:54.709742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:54.709742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:54.709742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.709742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:54.709742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:54.709742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:54.709742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:54.709742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.709742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:54.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:54.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:54.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:54.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:54.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:54.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:54.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:54.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:54.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:54.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:54.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:54.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.710450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.710450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:54.710450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.710450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.710754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:54.711280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.711829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.711829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:54.711829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.711829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:54.712667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:54.712917 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:54.713026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:54.713175 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:54.713651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:54.713969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:54.714164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.714795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:54.714795 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.714795 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:54.714795 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.714795 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.714795 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:54.714795 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.714795 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:54.715735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.715735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:54.715735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:54.715735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:54.715735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.715735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:54.715735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:54.715735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.715735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:54.715735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:54.715735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:54.715735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.716058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:54.716058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:54.716058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:54.716058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:54.716058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:54.716058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:54.716058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:54.716058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:54.716058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.716058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:54.716058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.716058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.716058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:54.716431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.716431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:54.716727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.716727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:54.716727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:54.716727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:54.716727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:54.716727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:54.716727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.716727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:54.716727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:54.716727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.716727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:54.716727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:54.716727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.716727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:54.716727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:54.716727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:54.717166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:54.717718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:54.717718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:54.717718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:59.524834 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:59.525637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:59.525637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:59.527106 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:59.561993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:59.562148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.563679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:59.563679 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.563679 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:59.563679 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.563679 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.563679 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:59.563679 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.563679 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:59.564345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.564345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:59.564345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:59.564345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:59.564345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.564345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:59.564345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:59.564345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.564345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:59.564345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:59.564345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:59.564345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.564855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:59.564855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:59.564855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:59.564855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:59.564855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:59.564855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:59.564855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:59.564855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:59.564855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.564855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:59.564855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.564855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.564855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:59.565549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.565549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:59.565549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.565549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:59.565549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:59.565549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:59.565549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:59.565549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:59.565549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.565549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:59.565549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:59.565549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.565549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:59.565549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:59.565549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:59.566027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.566820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:59.566820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.566820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.566820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:59.566820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.566820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:59.679391 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:59.679899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:59.680007 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:59.680980 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:59.681260 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:59.681451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.682091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:59.682091 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.682091 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:59.682091 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.682091 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.682091 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:59.682091 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.682091 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:59.683078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.683078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:59.683078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:59.683078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:59.683078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.683078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:59.683078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:59.683078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.683078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:59.683078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:59.683078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:59.683078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.684022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:59.684022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:59.684022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:59.684022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:59.684022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:59.684022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:59.684022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:59.684022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:59.684022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.684022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:59.684022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.684022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.684022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:59.684590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.684590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:59.684590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.684590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:59.684590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:59.684590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:59.684590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:59.684590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:59.684590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.684590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:59.684590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:59.684590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.684590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:59.684590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:59.684590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:59.685033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.685547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:59.685547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.685547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.685547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:59.685547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.685547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:59.698861 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:59.699232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:59.699397 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:59.699547 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:33:59.700239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:59.700613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.701740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:59.701740 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.701740 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:59.701740 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.701740 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.701740 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:59.701740 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.701740 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:59.702834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.702834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:59.702834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:59.702834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:59.702834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.702834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:59.702834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:59.702834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:59.702834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.702834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:59.702834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:59.702834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:59.702834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:59.702834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:59.702834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:59.703625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:59.703625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:59.703625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.703625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:59.703625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.703625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.703625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:59.703625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.703625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:59.704320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.704320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:59.704320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:59.704320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:59.704320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.704320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:59.704320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:59.704320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:33:59.704320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:59.704320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:59.704320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.704320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:59.705169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:59.705169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:59.705169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.705169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:59.705169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:59.705169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:59.705169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:59.705169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:59.705169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:59.705169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:59.705169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:59.705169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.705169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:59.705169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.705865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.705865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:59.705865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.705865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:59.706517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.706517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:59.706517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:59.706517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:59.706517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:59.706517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:59.706517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.706517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:59.706517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:59.706517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.706517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:59.706517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:59.706517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.706517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:59.706517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:59.706517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:59.707281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:59.708103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.708103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:59.708103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.708103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.708103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:59.708103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.708103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:59.708103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:59.708103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:59.708103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:59.709144 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:59.709144 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:59.709144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.709549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:59.709549 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.709549 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:59.709549 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.709549 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.709549 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:59.709549 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.709549 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:59.710324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.710324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:33:59.710324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:59.710324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:59.710324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.710324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:59.710324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:59.710324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:59.710324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.710324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:33:59.710324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:59.710324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:33:59.710324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:59.710324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:33:59.710324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:33:59.710768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:59.710768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:33:59.710768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.710768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:33:59.710768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.710768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.710768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:33:59.710768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.710768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:33:59.711313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.711313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:59.711313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:59.711313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:59.711313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.711313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:59.711313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:59.711313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:59.711313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:59.711313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.711313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:59.711930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:59.711930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:59.711930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.711930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:59.711930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:59.711930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:59.711930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:59.711930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:59.711930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:59.711930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:59.711930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:59.711930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.711930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:59.711930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.712575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.712575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:59.712575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.712575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.712818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:59.713430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.714274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.714274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:59.714274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.714274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:33:59.714274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:33:59.714560 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:33:59.714703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:33:59.714828 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:33:59.715505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:59.715505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:33:59.715505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.716490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:33:59.716490 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.716490 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:33:59.716490 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.716490 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.716490 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:33:59.716490 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.716490 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:33:59.717136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.717136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:33:59.717136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:59.717136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:33:59.717136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.717136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:59.717136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:59.717136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.717136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:59.717136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:59.717136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:59.717136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.717629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:33:59.717629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:59.717629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:33:59.717629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:59.717629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:33:59.717629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:33:59.717629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:59.717629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:33:59.717629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.717629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:33:59.717629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.717629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.717629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:33:59.718056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.718056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:33:59.718056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.718056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:33:59.718056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:33:59.718056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:33:59.718056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:33:59.718056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:33:59.718056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.718056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:33:59.718056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:33:59.718056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.718056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:33:59.718056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:33:59.718056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:33:59.718537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:33:59.719081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:33:59.719081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:33:59.719081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:33:59.719081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:33:59.719081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:33:59.719081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:04.525563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:04.526141 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:04.526348 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:04.527613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:04.564949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:04.565261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.566536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:04.566536 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.566536 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:04.566536 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.566536 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.566536 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:04.566536 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.566536 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:04.567107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.567107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:04.567107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:04.567107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:04.567107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.567107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:04.567107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:04.567107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.567107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:04.567107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:04.567107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:04.567107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.567450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:04.567450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:04.567450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:04.567450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:04.567450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:04.567450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:04.567450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:04.567450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:04.567450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.567450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:04.567450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.567450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.567450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:04.567804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.567804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:04.568156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.568156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:04.568156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:04.568156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:04.568156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:04.568156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:04.568156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.568156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:04.568156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:04.568156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.568156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:04.568156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:04.568156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.568156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:04.568156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:04.568156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.568617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.569271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:04.569271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.569271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:04.679862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:04.680682 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:04.680737 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:04.681564 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:04.681749 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:04.681861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.682422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:04.682422 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.682422 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:04.682422 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.682422 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.682422 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:04.682422 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.682422 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:04.683889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.683889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:04.683889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:04.683889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:04.683889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.683889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:04.683889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:04.683889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.683889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:04.683889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:04.683889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:04.683889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.684320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:04.684320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:04.684320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:04.684320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:04.684320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:04.684320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:04.684320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:04.684320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:04.684320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.684320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:04.684320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.684320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.684320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:04.684713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.684713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:04.685550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.685550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:04.685550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:04.685550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:04.685550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:04.685550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:04.685550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.685550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:04.685550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:04.685550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.685550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:04.685550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:04.685550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.685550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:04.685550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:04.685550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.686117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.686667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:04.686667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.686667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:04.700690 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:04.701287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:04.701287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:04.701728 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:34:04.703403 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:04.703403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.703403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:04.703403 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.703403 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:04.703403 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.703403 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.703403 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:04.703403 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.703403 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:04.704144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.704144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:04.704144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:04.704144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:04.704144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.704144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:04.704144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:04.704144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:04.704144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.704144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:04.704144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:04.704144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:04.704144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:04.704144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:04.704144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:04.704490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:04.704490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:04.704490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.704490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:04.704490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.704490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.704490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:04.704490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.704490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:04.705423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.705423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:04.705423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:04.705423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:04.705423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.705423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:04.705423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:04.705423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:34:04.705423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:04.705423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:04.705423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.705423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:04.705677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:04.705677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:04.705677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.705677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:04.705677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:04.705677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:04.705677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:04.705677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:04.705677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:04.705677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:04.705677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:04.705677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.705677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:04.705677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.705943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.705943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:04.705943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.705943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:04.707299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.707299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:04.707299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:04.707299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:04.707299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:04.707299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:04.707299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.707299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:04.707299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:04.707299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.707299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:04.707299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:04.707299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.707299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:04.707299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:04.707299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:04.707624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:04.707946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.707946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:04.707946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.707946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.707946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:04.707946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.707946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:04.707946 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:04.707946 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:04.708115 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:04.708140 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:04.709456 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:04.709643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.710108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:04.710108 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.710108 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:04.710108 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.710108 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.710108 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:04.710108 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.710108 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:04.711020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.711020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:04.711020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:04.711020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:04.711020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.711020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:04.711020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:04.711020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:04.711020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.711020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:04.711020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:04.711020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:04.711020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:04.711020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:04.711020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:04.711323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:04.711323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:04.711323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.711323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:04.711323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.711323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.711323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:04.711323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.711323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:04.711887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.711887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:04.711887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:04.711887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:04.711887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.711887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:04.711887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:04.711887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:04.711887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:04.711887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.711887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:04.712122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:04.712122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:04.712122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.712122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:04.712122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:04.712122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:04.712122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:04.712122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:04.712122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:04.712122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:04.712122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:04.712122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.712122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:04.712122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.712417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.712417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:04.712417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.712417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:04.713343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.713729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.713729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:04.713729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.713729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:04.715608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:04.715608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:04.715608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:04.715728 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:04.716245 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:04.716525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:04.716722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.717538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:04.717538 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.717538 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:04.717538 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.717538 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.717538 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:04.717538 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.717538 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:04.718435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.718435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:04.718435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:04.718435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:04.718435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.718435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:04.718435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:04.718435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.718435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:04.718435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:04.718435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:04.718435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.718721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:04.718721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:04.718721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:04.718721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:04.718721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:04.718721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:04.718721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:04.718721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:04.718721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.718721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:04.718721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.718721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.718721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:04.719003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.719003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:04.720204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.720204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:04.720204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:04.720204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:04.720204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:04.720204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:04.720204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.720204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:04.720204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:04.720204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.720204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:04.720204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:04.720204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.720204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:04.720204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:04.720204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:04.720514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:04.720857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:04.720857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:04.720857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:09.527021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:09.527754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:09.527846 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:09.528656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:09.570939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:09.571263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.571996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:09.571996 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.571996 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:09.571996 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.571996 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.571996 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:09.571996 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.571996 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:09.573215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.044 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.573215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:09.573215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:09.573215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:09.573215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.573215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:09.573215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:09.573215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.573215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:09.573215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:09.573215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:09.573215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.573968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:09.573968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:09.573968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:09.573968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:09.573968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:09.573968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:09.573968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:09.573968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:09.573968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.573968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:09.573968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.573968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.573968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:09.574688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.574688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:09.574688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.574688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:09.574688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:09.574688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:09.574688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:09.574688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:09.574688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.574688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:09.574688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:09.574688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.574688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:09.574688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:09.574688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:09.575515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.576910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:09.576910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.576910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.576910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:09.576910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.576910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:09.680323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:09.680800 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:09.681011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:09.681668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:09.681867 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:09.682013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.682679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:09.682679 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.682679 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:09.682679 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.682679 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.682679 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:09.682679 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.682679 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:09.684618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.684618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:09.684618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:09.684618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:09.684618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.684618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:09.684618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:09.684618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.684618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:09.684618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:09.684618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:09.684618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.685546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:09.685546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:09.685546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:09.685546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:09.685546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:09.685546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:09.685546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:09.685546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:09.685546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.685546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:09.685546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.685546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.685546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:09.685951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.685951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:09.686465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.686465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:09.686465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:09.686465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:09.686465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:09.686465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:09.686465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.686465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:09.686465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:09.686465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.686465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:09.686465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:09.686465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.686465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:09.686465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:09.686465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.686982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.687538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:09.687538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.687538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:09.701302 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:09.701990 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:09.702198 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:09.702387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:34:09.702795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:09.703009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.703603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:09.703603 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.703603 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:09.703603 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.703603 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.703603 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:09.703603 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.703603 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:09.705123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.705123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:09.705123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:09.705123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:09.705123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.705123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:09.705123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:09.705123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:09.705123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.705123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:09.705123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:09.705123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:09.705123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:09.705123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:09.705123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:09.705535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:09.705535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:09.705535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.705535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:09.705535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.705535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.705535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:09.705535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.705535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:09.706582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.706582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:09.706582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:09.706582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:09.706582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.706582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:09.706582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:09.706582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:34:09.706582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:09.706582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:09.706582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.706582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:09.706980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:09.706980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:09.706980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.706980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:09.706980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:09.706980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:09.706980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:09.706980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:09.706980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:09.706980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:09.706980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:09.706980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.706980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:09.706980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.707252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.707252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:09.707252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.707252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:09.708326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.708326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:09.708326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:09.708326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:09.708326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:09.708326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:09.708326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.708326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:09.708326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:09.708326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.708326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:09.708326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:09.708326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.708326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:09.708326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:09.708326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:09.708803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:09.709324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.709324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:09.709324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.709324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.709324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:09.709324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.709324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:09.709324 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:09.709324 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:09.709324 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:09.709628 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:09.709628 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:09.709806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.710209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:09.710209 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.710209 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:09.710209 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.710209 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.710209 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:09.710209 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.710209 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:09.711084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.711084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:09.711084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:09.711084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:09.711084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.711084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:09.711084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:09.711084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:09.711084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.711084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:09.711084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:09.711084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:09.711084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:09.711084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:09.711084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:09.711642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:09.711642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:09.711642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.711642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:09.711642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.711642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.711642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:09.711642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.711642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:09.712091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.712091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:09.712091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:09.712091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:09.712091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.712091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:09.712091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:09.712091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:09.712091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:09.712091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.712091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:09.712495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:09.712495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:09.712495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.712495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:09.712495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:09.712495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:09.712495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:09.712495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:09.712495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:09.712495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:09.712495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:09.712495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.712495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:09.712495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.712880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.712880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:09.712880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.712880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.713350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:09.713864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.714456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.714456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:09.714456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.714456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:09.715534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:09.715836 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:09.716003 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:09.716208 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:09.716539 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:09.716779 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:09.716959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.717984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:09.717984 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.717984 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:09.717984 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.717984 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.717984 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:09.717984 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.717984 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:09.718916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.718916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:09.718916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:09.718916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:09.718916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.718916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:09.718916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:09.718916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.718916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:09.718916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:09.718916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:09.718916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.719487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:09.719487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:09.719487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:09.719487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:09.719487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:09.719487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:09.719487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:09.719487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:09.719487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.719487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:09.719487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.719487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.719487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:09.720063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.720063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:09.720291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.720291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:09.720291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:09.720291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:09.720291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:09.720291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:09.720291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.720291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:09.720291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:09.720291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.720291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:09.720291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:09.720291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.720291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:09.720291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:09.720291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:09.720816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:09.721429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:09.721429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:09.721429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:14.527789 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:14.528669 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:14.528669 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:14.529864 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:14.566838 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:14.567262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.568291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:14.568291 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.568291 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:14.568291 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.568291 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.568291 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:14.568291 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.568291 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:14.569527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.569527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:14.569527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:14.569527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:14.569527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.569527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:14.569527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:14.569527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.569527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:14.569527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:14.569527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:14.569527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.570136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:14.570136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:14.570136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:14.570136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:14.570136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:14.570136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:14.570136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:14.570136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:14.570136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.570136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:14.570136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.570136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.570136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:14.570735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.570735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:14.571542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.571542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:14.571542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:14.571542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:14.571542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:14.571542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:14.571542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.571542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:14.571542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:14.571542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.571542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:14.571542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:14.571542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.571542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:14.571542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:14.571542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.572232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.573081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:14.573081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.573081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:14.680988 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:14.681486 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:14.681616 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:14.682656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:14.683015 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:14.683246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.684148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:14.684148 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.684148 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:14.684148 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.684148 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.684148 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:14.684148 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.684148 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:14.685402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.685402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:14.685402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:14.685402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:14.685402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.685402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:14.685402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:14.685402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.685402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:14.685402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:14.685402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:14.685402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.686010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:14.686010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:14.686010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:14.686010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:14.686010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:14.686010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:14.686010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:14.686010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:14.686010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.686010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:14.686010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.686010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.686010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:14.686823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.686823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:14.686823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.686823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:14.686823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:14.686823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:14.686823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:14.686823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:14.686823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.686823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:14.686823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:14.686823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.686823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:14.686823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:14.686823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:14.687559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.688486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:14.688486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.688486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.688486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:14.688486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.688486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:14.701910 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:14.702414 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:14.702539 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:14.702710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:34:14.703177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:14.704034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.704953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:14.704953 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.704953 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:14.704953 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.704953 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.704953 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:14.704953 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.704953 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:14.706631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.706631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:14.706631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:14.706631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:14.706631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.706631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:14.706631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:14.706631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:14.706631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.706631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:14.706631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:14.706631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:14.706631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:14.706631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:14.706631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:14.707127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:14.707127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:14.707127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.707127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:14.707127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.707127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.707127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:14.707127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.707127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:14.708681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.708681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:14.708681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:14.708681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:14.708681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.708681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:14.708681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:14.708681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:34:14.708681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:14.708681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:14.708681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.708681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:14.709123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:14.709123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:14.709123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.709123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:14.709123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:14.709123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:14.709123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:14.709123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:14.709123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:14.709123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:14.709123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:14.709123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.709123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:14.709123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.709572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.709572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:14.709572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.709572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:14.710354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.710354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:14.710354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:14.710354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:14.710354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:14.710354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:14.710354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.710354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:14.710354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:14.710354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.710354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:14.710354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:14.710354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.710354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:14.710354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:14.710354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:14.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:14.711290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.711290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:14.711290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.711290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.711290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:14.711290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.711290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:14.711290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:14.711290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:14.711290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:14.711587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:14.711758 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:14.712045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.712526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:14.712526 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.712526 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:14.712526 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.712526 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.712526 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:14.712526 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.712526 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:14.713245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.713245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:14.713245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:14.713245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:14.713245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.713245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:14.713245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:14.713245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:14.713245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.713245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:14.713245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:14.713245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:14.713245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:14.713245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:14.713245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:14.713654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:14.713654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:14.713654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.713654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:14.713654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.713654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.713654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:14.713654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.713654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:14.714127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.714127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:14.714127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:14.714127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:14.714127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.714127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:14.714127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:14.714127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:14.714127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:14.714127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.714127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:14.714438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:14.714438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:14.714438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.714438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:14.714438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:14.714438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:14.714438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:14.714438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:14.714438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:14.714438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:14.714438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:14.714438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.714438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:14.714438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.714817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.714817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:14.714817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.714817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.715194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:14.715648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.716536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.716536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:14.716536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.716536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:14.716536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:14.716536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:14.716536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:14.716536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:14.716879 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:14.717024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:14.717185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.717634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:14.717634 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.717634 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:14.717634 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.717634 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.717634 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:14.717634 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.717634 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:14.718420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.718420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:14.718420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:14.718420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:14.718420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.718420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:14.718420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:14.718420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.718420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:14.718420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:14.718420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:14.718420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.718750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:14.718750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:14.718750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:14.718750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:14.718750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:14.718750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:14.718750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:14.718750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:14.718750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.718750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:14.718750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.718750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.718750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:14.719095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.719095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:14.719342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.719342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:14.719342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:14.719342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:14.719342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:14.719342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:14.719342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.719342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:14.719342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:14.719342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.719342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:14.719342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:14.719342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.719342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:14.719342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:14.719342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:14.719796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:14.720341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:14.720341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:14.720341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:19.528794 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:19.531563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:19.531563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:19.531563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:19.568278 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:19.568729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:19.569748 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.569748 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:19.569748 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.569748 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.569748 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:19.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.569748 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:19.572307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.572307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:19.572307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:19.572307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:19.572307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.572307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:19.572307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:19.572307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.572307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:19.572307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:19.572307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:19.572307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.573051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:19.573051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:19.573051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:19.573051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:19.573051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:19.573051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:19.573051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:19.573051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:19.573051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.573051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:19.573051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.573051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.573051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:19.573829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.573829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:19.573829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.573829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:19.573829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:19.573829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:19.573829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:19.573829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:19.573829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.573829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:19.573829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:19.573829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.573829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:19.573829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:19.573829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:19.574608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.575576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:19.575576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.575576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.575576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:19.575576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.575576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:19.681767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:19.682096 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:19.682217 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:19.683082 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:19.683331 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:19.683517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.684138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:19.684138 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.684138 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:19.684138 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.684138 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.684138 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:19.684138 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.684138 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:19.685217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.685217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:19.685217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:19.685217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:19.685217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.685217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:19.685217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:19.685217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.685217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:19.685217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:19.685217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:19.685217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.685988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:19.685988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:19.685988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:19.685988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:19.685988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:19.685988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:19.685988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:19.685988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:19.685988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.685988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:19.685988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.685988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.685988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:19.686577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.686577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:19.686577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.686577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:19.686577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:19.686577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:19.686577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:19.686577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:19.686577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.686577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:19.686577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:19.686577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.686577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:19.686577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:19.686577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:19.687460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.688643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:19.688643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.688643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.688643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:19.688643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.688643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:19.702579 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:19.702971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:19.703152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:19.703333 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:34:19.704031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:19.704435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.705396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:19.705396 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.705396 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:19.705396 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.705396 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.705396 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:19.705396 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.705396 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:19.706632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.706632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:19.706632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:19.706632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:19.706632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.706632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:19.706632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:19.706632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:19.706632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.706632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:19.706632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:19.706632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:19.706632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:19.706632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:19.706632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:19.707091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:19.707091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:19.707091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.707091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:19.707091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.707091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.707091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:19.707091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.707091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:19.707956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.707956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:19.707956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:19.707956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:19.707956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.707956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:19.707956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:19.707956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:34:19.707956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:19.707956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:19.707956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.707956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:19.708264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:19.708264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:19.708264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.708264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:19.708264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:19.708264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:19.708264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:19.708264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:19.708264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:19.708264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:19.708264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:19.708264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.708264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:19.708264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:19.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.708646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:19.709622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.709622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:19.709622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:19.709622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:19.709622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:19.709622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:19.709622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.709622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:19.709622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:19.709622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.709622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:19.709622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:19.709622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.709622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:19.709622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:19.709622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:19.709957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:19.710294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.710294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:19.710294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.710294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.710294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:19.710294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.710294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:19.711123 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:19.711420 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:19.711612 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:19.711803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:19.712190 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:19.712445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.712993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:19.712993 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.712993 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:19.712993 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.712993 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.712993 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:19.712993 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.712993 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:19.714187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.714187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:19.714187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:19.714187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:19.714187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.714187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:19.714187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:19.714187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:19.714187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.714187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:19.714187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:19.714187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:19.714187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:19.714187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:19.714187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:19.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:19.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:19.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:19.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:19.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:19.715059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.715059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:19.715059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:19.715059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:19.715059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.715059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:19.715059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:19.715059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:19.715059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:19.715059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.715059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:19.715404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:19.715404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:19.715404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.715404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:19.715404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:19.715404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:19.715404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:19.715404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:19.715404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:19.715404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:19.715404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:19.715404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.715404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:19.715404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.715761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.715761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:19.715761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.715761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.716497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:19.717354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.718009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.718009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:19.718009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.718009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:19.718009 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:19.718227 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:19.718227 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:19.718623 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:19.718761 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:19.719004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:19.719252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.719797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:19.719797 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.719797 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:19.719797 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.719797 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.719797 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:19.719797 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.719797 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:19.720694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.720694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:19.720694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:19.720694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:19.720694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.720694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:19.720694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:19.720694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.720694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:19.720694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:19.720694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:19.720694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.721494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:19.721494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:19.721494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:19.721494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:19.721494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:19.721494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:19.721494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:19.721494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:19.721494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.721494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:19.721494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.721494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.721494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:19.721963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.721963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:19.721963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.721963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:19.721963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:19.721963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:19.721963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:19.721963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:19.721963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.721963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:19.721963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:19.721963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.721963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:19.721963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:19.721963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:19.722490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:19.722972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:19.722972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:19.722972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:19.722972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:19.722972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:19.722972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:24.530294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:24.530852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:24.530890 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:24.531549 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:24.563503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:24.563694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.564510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:24.564510 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.564510 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:24.564510 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.564510 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.564510 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:24.564510 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.564510 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:24.565448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.565448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:24.565448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:24.565448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:24.565448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.565448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:24.565448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:24.565448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.565448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:24.565448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:24.565448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:24.565448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.565892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:24.565892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:24.565892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:24.565892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:24.565892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:24.565892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:24.565892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:24.565892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:24.565892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.565892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:24.565892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.565892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.565892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:24.566397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.566397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:24.566548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.566548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:24.566548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:24.566548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:24.566548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:24.566548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:24.566548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.566548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:24.566548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:24.566548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.566548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:24.566548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:24.566548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.566548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:24.566548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:24.566548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.567116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.567950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:24.567950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.567950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:24.682508 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:24.683054 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:24.683271 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:24.684184 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:24.684502 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:24.684743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.685604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:24.685604 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.685604 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:24.685604 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.685604 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.685604 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:24.685604 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.685604 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:24.687213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.687213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:24.687213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:24.687213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:24.687213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.687213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:24.687213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:24.687213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.687213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:24.687213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:24.687213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:24.687213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.687843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:24.687843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:24.687843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:24.687843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:24.687843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:24.687843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:24.687843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:24.687843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:24.687843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.687843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:24.687843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.687843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.687843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:24.688480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.688480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:24.689386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.689386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:24.689386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:24.689386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:24.689386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:24.689386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:24.689386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.689386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:24.689386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:24.689386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.689386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:24.689386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:24.689386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.689386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:24.689386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:24.689386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.690203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.690868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:24.690868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.690868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:24.703324 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:24.703934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:24.704128 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:24.704354 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:34:24.704916 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:24.705222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.706126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:24.706126 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.706126 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:24.706126 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.706126 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.706126 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:24.706126 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.706126 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:24.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:24.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:24.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:24.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:24.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:24.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:24.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:24.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:24.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:24.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:24.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:24.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:24.708181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:24.708181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:24.708181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.708181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:24.708181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.708181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.708181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:24.708181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.708181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:24.708685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.708685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:24.708685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:24.708685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:24.708685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.708685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:24.708685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:24.708685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:34:24.708685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:24.708685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:24.708685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.708685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:24.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:24.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:24.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:24.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:24.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:24.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:24.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:24.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:24.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:24.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:24.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:24.709295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.710029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.710029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:24.710029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.710029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:24.710029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.710029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:24.710029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:24.710029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:24.710029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:24.710029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:24.710029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.710029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:24.710029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:24.710029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:24.711428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:24.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:24.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:24.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:24.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:24.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:24.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:24.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:24.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:24.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:24.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:24.713598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:24.713598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:24.713598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:24.713598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.713598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:24.713598 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.713598 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:24.713598 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.713598 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.713598 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:24.713598 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.713598 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:24.714359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.714359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:24.714359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:24.714359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:24.714359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.714359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:24.714359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:24.714359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:24.714359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.714359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:24.714359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:24.714359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:24.714359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:24.714359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:24.714359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:24.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:24.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:24.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:24.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:24.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:24.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:24.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:24.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:24.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.715863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:24.715863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:24.715863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:24.715863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:24.715863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.715863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:24.715863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:24.715863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:24.715863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.715863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:24.715863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:24.715863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:24.715863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:24.716251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:24.716251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:24.716251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:24.716251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:24.716251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.716251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:24.716251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.716251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.716251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:24.716251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.716251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:24.716251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:24.716626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.717128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:24.718226 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:24.718640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:24.718747 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:24.718905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:24.719136 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:24.719351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:24.719561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.720035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:24.720035 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.720035 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:24.720035 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.720035 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.720035 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:24.720035 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.720035 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:24.720951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.720951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:24.720951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:24.720951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:24.720951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.720951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:24.720951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:24.720951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.720951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:24.720951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:24.720951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:24.720951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.721474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:24.721474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:24.721474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:24.721474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:24.721474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:24.721474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:24.721474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:24.721474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:24.721474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.721474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:24.721474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.721474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.721474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:24.721861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.721861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:24.722062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.722062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:24.722062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:24.722062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:24.722062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:24.722062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:24.722062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.722062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:24.722062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:24.722062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.722062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:24.722062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:24.722062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.722062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:24.722062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:24.722062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:24.722599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:24.723131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:24.723131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:24.723131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:29.530768 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:29.531262 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:29.531408 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:29.532297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:29.569526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:29.569708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.570258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:29.570258 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.570258 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:29.570258 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.570258 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.570258 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:29.570258 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.570258 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:29.571247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.571247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:29.571247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:29.571247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:29.571247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.571247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:29.571247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:29.571247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.571247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:29.571247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:29.571247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:29.571247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.571825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:29.571825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:29.571825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:29.571825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:29.571825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:29.571825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:29.571825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:29.571825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:29.571825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.571825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:29.571825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.571825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.571825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:29.572280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.572280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:29.572280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.572280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:29.572280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:29.572280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:29.572280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:29.572280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:29.572280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.572280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:29.572280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:29.572280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.572280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:29.572280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:29.572280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:29.572864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.573357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:29.573357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.573357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.573357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:29.573357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.573357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:29.683201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:29.683841 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:29.684040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:29.684998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:29.685766 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:29.685766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.686396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:29.686396 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.686396 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:29.686396 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.686396 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.686396 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:29.686396 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.686396 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:29.687906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.687906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:29.687906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:29.687906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:29.687906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.687906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:29.687906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:29.687906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.687906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:29.687906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:29.687906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:29.687906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.688202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:29.688202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:29.688202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:29.688202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:29.688202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:29.688202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:29.688202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:29.688202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:29.688202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.688202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:29.688202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.688202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.688202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:29.688461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.688461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:29.689707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.689707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:29.689707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:29.689707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:29.689707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:29.689707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:29.689707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.689707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:29.689707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:29.689707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.689707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:29.689707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:29.689707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.689707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:29.689707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:29.689707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.690053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.690422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:29.690422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.690422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:29.703880 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:29.704382 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:29.704605 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:29.704827 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:34:29.705320 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:29.705668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.706454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:29.706454 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.706454 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:29.706454 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.706454 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.706454 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:29.706454 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.706454 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:29.707939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.707939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:29.707939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:29.707939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:29.707939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.707939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:29.707939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:29.707939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:29.707939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.707939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:29.707939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:29.707939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:29.707939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:29.707939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:29.707939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:29.708285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:29.708285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:29.708285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.708285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:29.708285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.708285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.708285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:29.708285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.708285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:29.709319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.709319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:29.709319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:29.709319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:29.709319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.709319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:29.709319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:29.709319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:34:29.709319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:29.709319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:29.709319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.709319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:29.709605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:29.709605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:29.709605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.709605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:29.709605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:29.709605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:29.709605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:29.709605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:29.709605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:29.709605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:29.709605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:29.709605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.709605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:29.709605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.709898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.709898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:29.709898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.709898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:29.710654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.710654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:29.710654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:29.710654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:29.710654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:29.710654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:29.710654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.710654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:29.710654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:29.710654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.710654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:29.710654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:29.710654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.710654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:29.710654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:29.710654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:29.711044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:29.711389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.711389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:29.711389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.711389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.711389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:29.711389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.711389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:29.712113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:29.713565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:29.713565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:29.713565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:29.713565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:29.713565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.714083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:29.714083 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.714083 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:29.714083 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.714083 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.714083 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:29.714083 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.714083 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:29.715037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.715037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:29.715037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:29.715037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:29.715037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.715037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:29.715037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:29.715037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:29.715037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.715037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:29.715037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:29.715037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:29.715037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:29.715037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:29.715037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:29.715731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:29.715731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:29.715731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.715731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:29.715731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.715731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.715731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:29.715731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.715731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:29.715731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.715731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:29.715731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:29.715731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:29.715731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.716356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:29.716356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:29.716356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:29.716356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:29.716356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.716356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:29.716356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:29.716356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:29.716356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.716356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:29.716356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:29.716356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:29.716356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:29.717066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:29.717066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:29.717066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:29.717066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:29.717066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.717066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:29.717066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.717066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.717066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:29.717066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.717066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:29.717066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:29.720994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.721829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:29.722201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:29.722201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:29.722201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:29.722201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:29.722201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:29.722201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:29.722353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.722353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:29.722353 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.722353 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:29.722353 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.722353 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.722353 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:29.722353 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.722353 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:29.722353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.722353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:29.722353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:29.722353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:29.722353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.722353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:29.722667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:29.722667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.722667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:29.722667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:29.722667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:29.722667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.722667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:29.722667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:29.722667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:29.722667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:29.722667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:29.722667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:29.722667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:29.722667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:29.722924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.722924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:29.722924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.722924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.722924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:29.722924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.722924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:29.722924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.722924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:29.722924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:29.722924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:29.722924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:29.722924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:29.723169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:29.723620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:29.723620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:29.723620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:29.723620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:29.723620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:29.723620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:29.723620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:29.723620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:29.723620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:29.723620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:29.723620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:29.723620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:34.532171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:34.532171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:34.533137 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:34.533806 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:34.565562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:34.565769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.566196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:34.566196 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.566196 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:34.566196 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.566196 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.566196 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:34.566196 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.566196 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:34.566861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.566861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:34.566861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:34.566861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:34.566861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.566861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:34.566861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:34.566861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.566861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:34.566861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:34.566861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:34.566861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.567309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:34.567309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:34.567309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:34.567309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:34.567309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:34.567309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:34.567309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:34.567309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:34.567309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.567309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:34.567309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.567309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.567309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:34.568423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.568423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:34.568423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.568423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:34.568423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:34.568423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:34.568423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:34.568423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:34.568423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.568423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:34.568423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:34.568423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.568423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:34.568423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:34.568423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:34.569060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.569767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:34.569767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.569767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.569767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:34.569767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.569767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:34.683854 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:34.685547 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:34.685547 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:34.685547 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:34.685547 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:34.685731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.686282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:34.686282 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.686282 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:34.686282 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.686282 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.686282 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:34.686282 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.686282 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:34.687126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.687126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:34.687126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:34.687126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:34.687126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.687126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:34.687126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:34.687126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.687126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:34.687126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:34.687126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:34.687126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.687436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:34.687436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:34.687436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:34.687436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:34.687436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:34.687436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:34.687436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:34.687436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:34.687436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.687436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:34.687436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.687436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.687436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:34.687709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.687709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:34.688675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.688675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:34.688675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:34.688675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:34.688675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:34.688675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:34.688675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.688675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:34.688675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:34.688675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.688675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:34.688675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:34.688675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.688675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:34.688675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:34.688675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.689034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.689380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:34.689380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.689380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:34.704533 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:34.705295 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:34.705403 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:34.705497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:34:34.705943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:34.706147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.706922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:34.706922 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.706922 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:34.706922 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.706922 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.706922 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:34.706922 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.706922 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:34.708282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.708282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:34.708282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:34.708282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:34.708282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.708282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:34.708282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:34.708282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:34.708282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.708282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:34.708282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:34.708282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:34.708282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:34.708282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:34.708282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:34.708697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:34.708697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:34.708697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.708697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:34.708697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.708697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.708697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:34.708697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.708697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:34.710251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.710251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:34.710251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:34.710251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:34.710251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.710251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:34.710251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:34.710251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:34:34.710251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:34.710251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:34.710251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.710251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:34.710556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:34.710556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:34.710556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.710556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:34.710556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:34.710556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:34.710556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:34.710556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:34.710556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:34.710556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:34.710556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:34.710556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.710556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:34.710556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:34.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.710809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:34.712189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.712189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:34.712189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:34.712189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:34.712189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:34.712189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:34.712189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.712189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:34.712189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:34.712189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.712189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:34.712189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:34.712189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.712189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:34.712189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:34.712189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:34.712542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:34.712877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.712877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:34.712877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.712877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.712877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:34.712877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.712877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:34.712877 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:34.712877 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:34.713077 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:34.713312 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:34.713727 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:34.714052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.714548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:34.714548 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.714548 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:34.714548 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.714548 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.714548 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:34.714548 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.714548 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:34.715266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.715266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:34.715266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:34.715266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:34.715266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.715266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:34.715266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:34.715266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:34.715266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.715266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:34.715266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:34.715266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:34.715266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:34.715266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:34.715266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:34.715578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:34.715578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:34.715578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.715578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:34.715578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.715578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.715578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:34.715578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.715578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:34.716327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.716327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:34.716327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:34.716327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:34.716327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.716327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:34.716327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:34.716327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:34.716327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:34.716327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.716327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:34.716594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:34.716594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:34.716594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.716594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:34.716594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:34.716594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:34.716594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:34.716594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:34.716594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:34.716594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:34.716594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:34.716594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.716594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:34.716594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.716866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.716866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:34.716866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.716866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.717313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:34.717699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.718034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.718034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:34.718034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.718034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:34.719630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:34.719630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:34.719630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:34.719795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:34.720145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:34.720402 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:34.720545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.721012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:34.721012 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.721012 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:34.721012 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.721012 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.721012 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:34.721012 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.721012 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:34.721899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.721899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:34.721899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:34.721899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:34.721899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.721899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:34.721899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:34.721899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.721899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:34.721899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:34.721899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:34.721899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.722314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:34.722314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:34.722314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:34.722314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:34.722314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:34.722314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:34.722314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:34.722314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:34.722314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.722314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:34.722314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.722314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.722314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:34.722726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.722726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:34.722922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.722922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:34.722922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:34.722922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:34.722922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:34.722922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:34.722922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.722922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:34.722922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:34.722922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.722922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:34.722922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:34.722922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.722922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:34.722922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:34.722922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:34.723421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:34.723969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:34.723969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:34.723969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:39.532478 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:39.533268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:39.533268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:39.534626 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:39.572393 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:39.572564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.573025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:39.573025 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.573025 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:39.573025 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.573025 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.573025 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:39.573025 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.573025 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:39.573702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.573702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:39.573702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:39.573702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:39.573702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.573702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:39.573702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:39.573702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.573702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:39.573702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:39.573702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:39.573702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.574184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:39.574184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:39.574184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:39.574184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:39.574184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:39.574184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:39.574184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:39.574184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:39.574184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.574184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:39.574184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.574184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.574184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:39.574610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.574610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:39.574610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.574610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:39.574610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:39.574610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:39.574610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:39.574610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:39.574610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.574610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:39.574610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:39.574610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.574610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:39.574610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:39.574610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:39.575120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.575874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:39.575874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.575874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.575874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:39.575874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.575874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:39.684492 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:39.685108 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:39.685339 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:39.686256 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:39.686580 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:39.686814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.687681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:39.687681 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.687681 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:39.687681 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.687681 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.687681 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:39.687681 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.687681 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:39.689676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.689676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:39.689676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:39.689676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:39.689676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.689676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:39.689676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:39.689676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.689676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:39.689676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:39.689676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:39.689676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.690278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:39.690278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:39.690278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:39.690278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:39.690278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:39.690278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:39.690278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:39.690278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:39.690278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.690278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:39.690278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.690278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.690278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:39.690644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.690644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:39.691482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.691482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:39.691482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:39.691482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:39.691482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:39.691482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:39.691482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.691482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:39.691482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:39.691482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.691482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:39.691482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:39.691482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.691482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:39.691482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:39.691482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.691962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.692510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:39.692510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.692510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:39.705239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:39.705595 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:39.705688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:39.705818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:34:39.706067 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:39.706245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.707005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:39.707005 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.707005 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:39.707005 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.707005 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.707005 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:39.707005 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.707005 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:39.708588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.708588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:39.708588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:39.708588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:39.708588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.708588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:39.708588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:39.708588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:39.708588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.708588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:39.708588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:39.708588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:39.708588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:39.708588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:39.708588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:39.709278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:39.709278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:39.709278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.709278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:39.709278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.709278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.709278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:39.709278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.709278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:39.710181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.710181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:39.710181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:39.710181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:39.710181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.710181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:39.710181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:39.710181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:34:39.710181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:39.710181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:39.710181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.710181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:39.710785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:39.710785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:39.710785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.710785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:39.710785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:39.710785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:39.710785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:39.710785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:39.710785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:39.710785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:39.710785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:39.710785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.710785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:39.710785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.711384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.711384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:39.711384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.711384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:39.712466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.712466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:39.712466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:39.712466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:39.712466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:39.712466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:39.712466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.712466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:39.712466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:39.712466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.712466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:39.712466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:39.712466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.712466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:39.712466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:39.712466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:39.713207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:39.714031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.714031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:39.714031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.714031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.714031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:39.714031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.714031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:39.714031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:39.714031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:39.714031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:39.714551 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:39.714551 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:39.714819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.715697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:39.715697 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.715697 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:39.715697 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.715697 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.715697 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:39.715697 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.715697 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:39.716703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.716703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:39.716703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:39.716703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:39.716703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.716703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:39.716703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:39.716703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:39.716703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.716703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:39.716703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:39.716703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:39.716703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:39.716703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:39.716703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:39.717162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:39.717162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:39.717162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.717162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:39.717162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.717162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.717162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:39.717162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.717162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:39.717534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.717534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:39.717534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:39.717534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:39.717534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.717534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:39.717534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:39.717534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:39.717534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:39.717534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.717534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:39.718012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:39.718012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:39.718012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.718012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:39.718012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:39.718012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:39.718012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:39.718012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:39.718012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:39.718012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:39.718012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:39.718012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.718012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:39.718012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.718422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.718422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:39.718422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.718422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.718547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:39.719037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:39.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:39.720892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:39.721255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:39.721350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:39.721496 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:39.721705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:39.721879 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:39.722008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.722340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:39.722340 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.722340 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:39.722340 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.722340 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.722340 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:39.722340 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.722340 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:39.723069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.723069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:39.723069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:39.723069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:39.723069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.723069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:39.723069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:39.723069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.723069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:39.723069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:39.723069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:39.723069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.723462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:39.723462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:39.723462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:39.723462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:39.723462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:39.723462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:39.723462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:39.723462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:39.723462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.723462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:39.723462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.723462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.723462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:39.723883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.723883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:39.724072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.724072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:39.724072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:39.724072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:39.724072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:39.724072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:39.724072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.724072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:39.724072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:39.724072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.724072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:39.724072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:39.724072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.724072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:39.724072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:39.724072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:39.724585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:39.725108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:39.725108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:39.725108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:44.533058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:44.533935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:44.533935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:44.534478 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:44.569535 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:44.569754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.570103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:44.570103 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.570103 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:44.570103 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.570103 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.570103 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:44.570103 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.570103 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:44.570778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.570778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:44.570778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:44.570778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:44.570778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.570778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:44.570778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:44.570778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.570778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:44.570778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:44.570778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:44.570778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.571324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:44.571324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:44.571324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:44.571324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:44.571324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:44.571324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:44.571324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:44.571324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:44.571324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.571324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:44.571324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.571324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.571324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:44.571886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.571886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:44.571886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.571886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:44.571886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:44.571886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:44.571886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:44.571886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:44.571886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.571886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:44.571886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:44.571886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.571886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:44.571886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:44.571886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:44.572481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.573144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:44.573144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.573144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.573144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:44.573144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.573144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:44.685168 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:44.686161 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:44.686386 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:44.687308 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:44.687620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:44.687852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.688876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:44.688876 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.688876 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:44.688876 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.688876 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.688876 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:44.688876 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.688876 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:44.690730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.690730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:44.690730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:44.690730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:44.690730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.690730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:44.690730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:44.690730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.690730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:44.690730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:44.690730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:44.690730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.691457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:44.691457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:44.691457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:44.691457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:44.691457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:44.691457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:44.691457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:44.691457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:44.691457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.691457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:44.691457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.691457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.691457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:44.692273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.692273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:44.692904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.692904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:44.692904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:44.692904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:44.692904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:44.692904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:44.692904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.692904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:44.692904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:44.692904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.692904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:44.692904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:44.692904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.692904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:44.692904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:44.692904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.693607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.694446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:44.694446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.694446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:44.705707 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:44.706101 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:44.706263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:44.706533 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:34:44.706968 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:44.707206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.707886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:44.707886 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.707886 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:44.707886 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.707886 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.707886 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:44.707886 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.707886 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:44.709028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.709028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:44.709028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:44.709028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:44.709028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.709028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:44.709028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:44.709028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:44.709028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.709028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:44.709028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:44.709028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:44.709028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:44.709028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:44.709028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:44.709795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:44.709795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:44.709795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.709795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:44.709795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.709795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.709795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:44.709795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.709795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:44.710204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.710204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:44.710204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:44.710204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:44.710204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.710204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:44.710204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:44.710204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:34:44.710204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:44.710204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:44.710204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.710204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:44.710744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:44.710744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:44.710744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.710744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:44.710744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:44.710744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:44.710744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:44.710744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:44.710744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:44.710744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:44.710744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:44.710744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.710744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:44.710744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.711469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.711469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:44.711469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.711469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:44.711734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.711734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:44.711734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:44.711734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:44.711734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:44.711734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:44.711734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.711734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:44.711734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:44.711734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.711734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:44.711734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:44.711734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.711734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:44.711734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:44.711734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:44.713275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:44.714011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.714011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:44.714011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.714011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.714011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:44.714011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.714011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:44.714011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:44.714011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:44.714299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:44.714377 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:44.714757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:44.715074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.715693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:44.715693 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.715693 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:44.715693 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.715693 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.715693 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:44.715693 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.715693 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:44.716720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.716720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:44.716720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:44.716720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:44.716720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.716720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:44.716720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:44.716720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:44.716720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.716720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:44.716720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:44.716720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:44.716720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:44.716720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:44.716720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:44.717158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:44.717158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:44.717158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.717158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:44.717158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.717158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.717158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:44.717158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.717158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:44.718017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.718017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:44.718017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:44.718017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:44.718017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.718017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:44.718017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:44.718017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:44.718017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:44.718017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.718017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:44.718434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:44.718434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:44.718434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.718434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:44.718434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:44.718434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:44.718434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:44.718434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:44.718434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:44.718434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:44.718434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:44.718434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.718434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:44.718434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.718857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.718857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:44.718857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.718857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.719079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:44.719593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.720119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.720119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:44.720119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.720119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:44.721429 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:44.721860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:44.721946 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:44.722115 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:44.722540 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:44.722860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:44.723643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.723643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:44.723643 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.723643 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:44.723643 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.723643 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.723643 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:44.723643 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.723643 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:44.724318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.724318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:44.724318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:44.724318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:44.724318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.724318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:44.724318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:44.724318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.724318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:44.724318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:44.724318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:44.724318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.724692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:44.724692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:44.724692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:44.724692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:44.724692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:44.724692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:44.724692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:44.724692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:44.724692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.724692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:44.724692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.724692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.724692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:44.725051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.725051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:44.725689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.725689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:44.725689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:44.725689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:44.725689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:44.725689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:44.725689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.725689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:44.725689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:44.725689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.725689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:44.725689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:44.725689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.725689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:44.725689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:44.725689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:44.726227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:44.726789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:44.726789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:44.726789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:49.533653 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:49.534953 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:49.535023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:49.535665 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:49.570572 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:49.570823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.571588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:49.571588 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.571588 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:49.571588 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.571588 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.571588 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:49.571588 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.571588 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:49.572928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.572928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:49.572928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:49.572928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:49.572928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.572928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:49.572928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:49.572928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.572928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:49.572928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:49.572928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:49.572928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.573648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:49.573648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:49.573648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:49.573648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:49.573648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:49.573648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:49.573648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:49.573648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:49.573648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.573648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:49.573648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.573648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.573648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:49.574173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.574173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:49.574697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.574697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:49.574697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:49.574697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:49.574697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:49.574697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:49.574697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.574697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:49.574697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:49.574697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.574697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:49.574697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:49.574697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.574697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:49.574697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:49.574697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.576067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.577665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:49.577665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.577665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:49.685842 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:49.686267 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:49.686549 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:49.687695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:49.688056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:49.688295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.690015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:49.690015 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.690015 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:49.690015 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.690015 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.690015 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:49.690015 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.690015 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:49.690948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.690948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:49.690948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:49.690948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:49.690948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.690948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:49.690948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:49.690948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.690948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:49.690948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:49.690948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:49.690948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.691386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:49.691386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:49.691386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:49.691386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:49.691386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:49.691386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:49.691386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:49.691386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:49.691386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.691386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:49.691386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.691386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.691386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:49.691824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.691824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:49.692049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.692049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:49.692049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:49.692049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:49.692049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:49.692049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:49.692049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.692049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:49.692049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:49.692049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.692049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:49.692049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:49.692049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.692049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:49.692049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:49.692049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.693711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.694591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:49.694591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.694591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:49.706121 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:49.706424 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:49.706424 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:49.706568 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:34:49.707102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:49.707460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.708235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:49.708235 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.708235 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:49.708235 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.708235 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.708235 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:49.708235 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.708235 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:49.708784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.708784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:49.708784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:49.708784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:49.708784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.708784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:49.708784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:49.708784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:49.708784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.708784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:49.708784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:49.708784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:49.708784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:49.708784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:49.708784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:49.709427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:49.709427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:49.709427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.709427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:49.709427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.709427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.709427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:49.709427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.709427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:49.709886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.709886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:49.709886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:49.709886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:49.709886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.709886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:49.709886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:49.709886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:34:49.709886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:49.709886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:49.709886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.709886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:49.710761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:49.710761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:49.710761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.710761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:49.710761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:49.710761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:49.710761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:49.710761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:49.710761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:49.710761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:49.710761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:49.710761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.710761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:49.710761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.711244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.711244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:49.711244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.711244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:49.712615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.712615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:49.712615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:49.712615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:49.712615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:49.712615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:49.712615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.712615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:49.712615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:49.712615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.712615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:49.712615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:49.712615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.712615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:49.712615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:49.712615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:49.713942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:49.715173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.715173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:49.715173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.715173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.715173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:49.715173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.715173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:49.715173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:49.715173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:49.715173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:49.715664 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:49.715664 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:49.715664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.716382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:49.716382 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.716382 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:49.716382 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.716382 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.716382 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:49.716382 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.716382 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:49.717520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.717520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:49.717520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:49.717520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:49.717520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.717520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:49.717520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:49.717520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:49.717520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.717520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:49.717520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:49.717520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:49.717520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:49.717520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:49.717520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:49.718428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:49.718428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:49.718428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.718428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:49.718428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.718428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.718428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:49.718428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.718428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:49.718957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.718957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:49.718957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:49.718957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:49.718957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.718957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:49.718957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:49.718957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:49.718957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:49.718957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.718957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:49.719277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:49.719277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:49.719277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.719277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:49.719277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:49.719277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:49.719277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:49.719277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:49.719277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:49.719277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:49.719277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:49.719277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.719277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:49.719277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.719657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.719657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:49.719657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.719657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.719913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:49.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.721807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.721807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:49.721807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.721807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:49.721916 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:49.722265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:49.722356 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:49.722504 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:49.722934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:49.723295 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:49.723574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.724290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:49.724290 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.724290 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:49.724290 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.724290 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.724290 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:49.724290 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.724290 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:49.725145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.725145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:49.725145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:49.725145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:49.725145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.725145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:49.725145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:49.725145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.725145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:49.725145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:49.725145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:49.725145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.725758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:49.725758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:49.725758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:49.725758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:49.725758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:49.725758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:49.725758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:49.725758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:49.725758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.725758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:49.725758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.725758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.725758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:49.726089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.726089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:49.726089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.726089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:49.726089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:49.726089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:49.726089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:49.726089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:49.726089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.726089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:49.726089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:49.726089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.726089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:49.726089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:49.726089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:49.726555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:49.727028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:49.727028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:49.727028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:49.727028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:49.727028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:49.727028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:54.535321 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:54.536475 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:54.536475 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:54.537537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:54.539930 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:34:54.574638 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:54.575315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.576588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:54.576588 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.576588 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:54.576588 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.576588 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.576588 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:54.576588 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.576588 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:54.577556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.577556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:54.577556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:54.577556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:54.577556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.577556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:54.577556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:54.577556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.577556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:54.577556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:54.577556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:54.577556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.578137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:54.578137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:54.578137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:54.578137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:54.578137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:54.578137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:54.578137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:54.578137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:54.578137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.578137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:54.578137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.578137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.578137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:54.578871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.578871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:54.578871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.578871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:54.578871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:54.578871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:54.578871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:54.578871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:54.578871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.578871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:54.578871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:54.578871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.578871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:54.578871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:54.578871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:54.579553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.580123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:54.580123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.580123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.580123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:54.580123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.580123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:54.686636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:54.687351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:54.687697 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:54.688642 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:54.688814 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:54.688966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.689802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:54.689802 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.689802 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:54.689802 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.689802 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.689802 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:54.689802 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.689802 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:54.691136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.691136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:54.691136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:54.691136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:54.691136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.691136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:54.691136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:54.691136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.691136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:54.691136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:54.691136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:54.691136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.691531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:54.691531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:54.691531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:54.691531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:54.691531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:54.691531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:54.691531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:54.691531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:54.691531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.691531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:54.691531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.691531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.691531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:54.691880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.691880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:54.692939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.692939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:54.692939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:54.692939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:54.692939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:54.692939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:54.692939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.692939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:54.692939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:54.692939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.692939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:54.692939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:54.692939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.692939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:54.692939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:54.692939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.693881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.694430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:54.694430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.694430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:54.706766 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:54.707298 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:54.707434 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:54.707660 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:34:54.708340 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:54.708638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.709388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:54.709388 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.709388 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:54.709388 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.709388 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.709388 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:54.709388 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.709388 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:54.710813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.710813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:54.710813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:54.710813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:54.710813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.710813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:54.710813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:54.710813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:54.710813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.710813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:54.710813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:54.710813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:54.710813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:54.710813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:54.710813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:54.711544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:54.711544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:54.711544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.711544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:54.711544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.711544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.711544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:54.711544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.711544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:54.712480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.712480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:54.712480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:54.712480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:54.712480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.712480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:54.712480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:54.712480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:34:54.712480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:54.712480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:54.712480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.712480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:54.714096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:54.714096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:54.714096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.714096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:54.714096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:54.714096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:54.714096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:54.714096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:54.714096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:54.714096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:54.714096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:54.714096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.714096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:54.714096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.715445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.715445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:54.715445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.715445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:54.715445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.715445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:54.715445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:54.715445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:54.715445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:54.715445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:54.715445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.715445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:54.715445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:54.715445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:54.715916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:54.716909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:54.716909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:54.716909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:54.716909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:54.716909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:54.716909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.716909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:54.716909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.716909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.716909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:54.716909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.716909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:54.716909 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:54.716909 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:54.717929 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:54.717929 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:54.717929 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:54.717929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.717929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:54.717929 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.717929 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:54.717929 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.717929 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.717929 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:54.717929 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.717929 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:54.718835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.718835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:54.718835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:54.718835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:54.718835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.718835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:54.718835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:54.718835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:54.718835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.718835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:54.718835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:54.718835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:54.718835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:54.718835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:54.718835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:54.719499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:54.719499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:54.719499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.719499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:54.719499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.719499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.719499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:54.719499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.719499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:54.719499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.719499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:54.719499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:54.719499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:54.719499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.719866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:54.719866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:54.719866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:54.719866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:54.719866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.719866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:54.719866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:54.719866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:54.719866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.719866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:54.719866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:54.719866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:54.719866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:54.720186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:54.720186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:54.720186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:54.720186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:54.720186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.720186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:54.720186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.720186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.720186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:54.720186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.720186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:54.720186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:54.720713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.721161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:54.722468 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:54.722796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:54.722882 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:54.723047 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:54.723505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:54.723759 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:54.723903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.724462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:54.724462 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.724462 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:54.724462 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.724462 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.724462 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:54.724462 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.724462 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:54.725239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.725239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:54.725239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:54.725239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:54.725239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.725239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:54.725239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:54.725239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.725239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:54.725239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:54.725239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:54.725239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.725905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:54.725905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:54.725905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:54.725905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:54.725905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:54.725905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:54.725905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:54.725905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:54.725905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.725905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:54.725905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.725905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.725905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:54.726319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.726319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:54.726403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.726403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:54.726403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:54.726403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:54.726403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:54.726403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:54.726403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.726403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:54.726403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:54.726403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.726403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:54.726403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:54.726403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.726403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:54.726403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:54.726403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:54.726811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:54.727240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:54.727240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:54.727240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:59.535842 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:59.536799 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:59.536934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:59.537997 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:59.578173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:59.578798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.579772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:59.579772 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.579772 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:59.579772 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.579772 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.579772 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:59.579772 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.579772 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:59.580972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.580972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:59.580972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:59.580972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:59.580972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.580972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:59.580972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:59.580972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.580972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:59.580972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:59.580972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:59.580972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.581240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:59.581240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:59.581240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:59.581240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:59.581240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:59.581240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:59.581240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:59.581240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:59.581240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.581240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:59.581240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.581240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.581240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:59.581493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.581493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:59.581966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.581966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:59.581966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:59.581966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:59.581966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:59.581966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:59.581966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.581966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:59.581966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:59.581966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.581966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:59.581966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:59.581966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.581966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:59.581966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:59.581966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.582278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.582669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:59.582669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.582669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:59.687293 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:59.687816 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:59.688088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:59.689396 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:59.689779 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:59.690137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.691269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:59.691269 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.691269 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:59.691269 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.691269 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.691269 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:59.691269 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.691269 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:59.693232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.693232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:59.693232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:59.693232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:59.693232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.693232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:59.693232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:59.693232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.693232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:59.693232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:59.693232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:59.693232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.693627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:59.693627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:59.693627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:59.693627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:59.693627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:59.693627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:59.693627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:59.693627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:59.693627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.693627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:59.693627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.693627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.693627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:59.693946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.693946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:59.695038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.695038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:59.695038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:59.695038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:59.695038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:59.695038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:59.695038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.695038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:59.695038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:59.695038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.695038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:59.695038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:59.695038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.695038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:59.695038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:59.695038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.695506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.695967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:59.695967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.695967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:59.707178 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:59.707503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:59.707619 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:59.707737 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:34:59.708545 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:59.709038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.709881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:59.709881 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.709881 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:59.709881 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.709881 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.709881 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:59.709881 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.709881 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:59.710914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.710914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:59.710914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:59.710914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:59.710914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.710914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:59.710914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:59.710914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:59.710914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.710914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:59.710914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:59.710914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:59.710914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:59.710914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:59.710914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:59.711902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:59.711902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:59.711902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.711902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:59.711902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.711902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.711902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:59.711902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.711902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:59.712455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.712455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:59.712455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:59.712455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:59.712455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.712455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:59.712455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:59.712455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:34:59.712455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:59.712455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:59.712455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.712455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:59.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:59.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:59.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:59.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:59.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:59.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:59.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:59.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:59.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:59.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:59.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:59.712975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.713790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.713790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:59.713790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.713790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:59.713790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.713790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:59.713790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:59.713790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:59.713790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:59.713790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:59.713790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.713790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:59.713790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:59.713790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:59.714951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:59.715859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:59.715859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:59.715859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:59.715859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:59.715859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:59.715859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.715859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:59.715859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.715859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.715859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:59.715859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.715859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:59.715859 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:59.715859 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:59.716471 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:59.716471 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:59.716471 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:59.717013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.718059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:59.718059 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.718059 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:59.718059 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.718059 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.718059 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:59.718059 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.718059 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:59.719346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.719346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:34:59.719346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:59.719346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:59.719346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.719346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:59.719346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:59.719346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:59.719346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.719346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:34:59.719346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:59.719346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:34:59.719346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:59.719346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:34:59.719346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:34:59.720057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:59.720057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:34:59.720057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.720057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:34:59.720057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.720057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.720057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:34:59.720057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.720057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:34:59.720731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.720731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:59.720731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:59.720731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:59.720731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.720731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:59.720731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:59.720731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:59.720731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:59.720731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.720731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:59.721264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:59.721264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:59.721264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.721264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:59.721264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:59.721264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:59.721264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:59.721264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:59.721264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:59.721264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:59.721264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:59.721264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.721264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:59.721264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.721985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.721985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:59.721985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.721985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:59.721985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.721985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:59.721985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:59.721985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:59.721985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:59.721985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:59.721985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.721985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:59.721985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:59.721985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:59.722713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:59.723244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:59.723244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:59.723244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:59.723244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:59.723244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.723244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:59.723244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.723244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.723244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:59.723244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.723244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:34:59.723244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:34:59.723244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:34:59.723637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:34:59.723637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:34:59.724090 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:59.724512 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:34:59.724740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.725464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:34:59.725464 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.725464 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:34:59.725464 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.725464 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.725464 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:34:59.725464 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.725464 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:34:59.726580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.726580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:34:59.726580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:59.726580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:34:59.726580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.726580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:59.726580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:59.726580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.726580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:59.726580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:59.726580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:59.726580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.726951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:34:59.726951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:59.726951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:34:59.726951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:59.726951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:34:59.726951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:34:59.726951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:59.726951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:34:59.726951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.726951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:34:59.726951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.726951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.726951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:34:59.727290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.727290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:34:59.727711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.727711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:34:59.727711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:34:59.727711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:34:59.727711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:34:59.727711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:34:59.727711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.727711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:34:59.727711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:34:59.727711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.727711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:34:59.727711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:34:59.727711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.727711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:34:59.727711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:34:59.727711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:34:59.728137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:34:59.728640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:34:59.728640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:34:59.728640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:03.773187 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:03.773838 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_for_inconsistencies {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:03.774038 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Checking Neutron and OVN revision consistency. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:03.782265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:440}}
Apr 24 10:35:03.782428 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=106381) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:419}}
Apr 24 10:35:03.782529 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 412fe0fb-d3c8-41ef-b742-c7e091bf5e56 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:35:03.823614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, resource={'id': '412fe0fb-d3c8-41ef-b742-c7e091bf5e56', 'name': 'private', 'tenant_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'project_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['bedea127-581a-4245-bdcf-823b49c82996', 'd98dd98c-3740-4b7b-9054-95b7f384275a'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:19:49Z', 'updated_at': '2026-04-24T10:19:53Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 21598}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:03.823968 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:03.824490 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-d9e6c44e-2c1f-4e1c-97fa-3abe15d536c8, external_ids_update=None, columns={'tag': 21598}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:03.824660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.825539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:03.825539 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:03.825539 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:03.825539 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:03.825539 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:03.825539 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:03.825539 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.825539 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:03.826485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 412fe0fb-d3c8-41ef-b742-c7e091bf5e56 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.826485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:03.826485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:35:03.826485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:35:03.826485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:35:03.826485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:35:03.826485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:35:03.826485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:03.826485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:03.826485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:03.826485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:03.827223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:03.827223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:03.827223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:03.827223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:03.827223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:03.827223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:03.827223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:03.827223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:03.827223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:03.827223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:03.827223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:03.827223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:03.827223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:03.827223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:03.828120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:03.828120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.828120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:03.828120 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 86c46bc9-7739-46e7-9c49-62d2723e0d83 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:35:03.855534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, resource={'id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'name': 'public', 'tenant_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'project_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['4daf396b-50dc-4100-9154-fd24fc0e5f1d', '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-24T10:19:55Z', 'updated_at': '2026-04-24T10:20:05Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:03.855893 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:03.856647 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-b792be55-4fbf-4e4f-a9dc-10cee932ceea, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:03.857054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.858150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:03.858150 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:03.858150 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:03.858150 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:03.858150 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:03.858150 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:03.858150 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.858150 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:03.859345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 86c46bc9-7739-46e7-9c49-62d2723e0d83 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.859345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:03.859345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:35:03.859345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:35:03.859345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:35:03.859345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:35:03.859345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:35:03.859345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:03.859345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:03.859345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:03.859345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:03.859736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:03.859736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:03.859736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:03.859736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:03.859736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:03.859736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:03.859736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:03.859736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:03.859736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:03.859736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:03.859736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:03.859736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:03.859736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:03.859736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:03.860101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:03.860101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.860101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:03.860101 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 64c3f969-5120-406a-afc1-20f8f45b7533 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:35:03.894040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-64c3f969-5120-406a-afc1-20f8f45b7533, resource={'id': '64c3f969-5120-406a-afc1-20f8f45b7533', 'name': 'admin_net', 'tenant_id': '91bc93878b40449c8fd1c9924d8a3e8b', 'project_id': '91bc93878b40449c8fd1c9924d8a3e8b', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['18db2f65-6ba9-4ddd-8ab7-55370a16debc'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:23:22Z', 'updated_at': '2026-04-24T10:23:23Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 10837}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:03.894335 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-64c3f969-5120-406a-afc1-20f8f45b7533, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:03.894971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-a26d15c8-ce05-4e3e-84bc-9aa33edf96fe, external_ids_update=None, columns={'tag': 10837}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:03.895193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.896397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:03.896397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:03.896397 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:03.896397 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:03.896397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:03.896397 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:03.896397 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.896397 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:03.897720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 64c3f969-5120-406a-afc1-20f8f45b7533 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.897720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:03.897720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:35:03.897720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:35:03.897720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:35:03.897720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:35:03.897720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:35:03.897720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:03.897720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:03.897720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:03.897720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:03.898326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:03.898326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:03.898326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:03.898326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:03.898326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:03.898326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:03.898326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:03.898326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:03.898326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:03.898326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:03.898326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:03.898326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:03.898326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:03.898326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:03.899088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:03.899088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.899088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:03.899088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource b30b34a1-477c-4ef7-aea4-d9540988f10a (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:35:03.929233 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a, resource={'id': 'b30b34a1-477c-4ef7-aea4-d9540988f10a', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'tenant_id': '277dd31c279b430f90665727a827242c', 'project_id': '277dd31c279b430f90665727a827242c', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['a3090689-5a84-48d5-9685-f418bb1fd559'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:24:04Z', 'updated_at': '2026-04-24T10:24:05Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 23713}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:03.929452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:03.929737 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-6d5b7906-0378-49b8-88fc-e9fa642055e4, external_ids_update=None, columns={'tag': 23713}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:03.930582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.930582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:03.930582 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:03.930582 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:03.930582 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:03.930582 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:03.930582 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:03.930582 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.930582 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:03.931593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource b30b34a1-477c-4ef7-aea4-d9540988f10a (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.931593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:03.931593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:35:03.931593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:35:03.931593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:35:03.931593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:35:03.931593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:35:03.931593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:03.931593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:03.931593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:03.931593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:03.931914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:03.931914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:03.931914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:03.931914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:03.931914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:03.931914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:03.931914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:03.931914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:03.931914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:03.931914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:03.931914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:03.931914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:03.931914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:03.931914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:03.932265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:03.932265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.932265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:03.932265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 931f18d3-b7f8-4874-928b-3c06d4d5d355 (type: routers) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:35:03.997628 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, resource={'id': '931f18d3-b7f8-4874-928b-3c06d4d5d355', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'project_id': '277dd31c279b430f90665727a827242c', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'external_fixed_ips': [{'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7', 'ip_address': '172.24.5.167'}, {'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'ip_address': '2001:db8::1b3'}], 'enable_snat': True}, 'gw_port_id': '77659748-a2b4-448f-aa2d-e166be8f2be9', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-7ytfi', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'external_fixed_ips': [{'ip_address': '172.24.5.167', 'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7'}, {'ip_address': '2001:db8::1b3', 'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-24T10:24:05Z', 'updated_at': '2026-04-24T10:24:08Z', 'revision_number': 3, 'tenant_id': '277dd31c279b430f90665727a827242c'}, resource_type=routers, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:03.998060 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:03.998129 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "77659748-a2b4-448f-aa2d-e166be8f2be9"')], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:03.998247 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "77659748-a2b4-448f-aa2d-e166be8f2be9"')], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:03.998373 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.999100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:03.999100 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:03.999100 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:03.999100 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:03.999100 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:03.999100 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:03.999100 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:03.999100 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:03.999353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Unable to update router 931f18d3-b7f8-4874-928b-3c06d4d5d355. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.001059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 931f18d3-b7f8-4874-928b-3c06d4d5d355 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.001059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:04.001059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:35:04.001059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:35:04.001059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:35:04.001059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:35:04.001059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1634, in update_router
Apr 24 10:35:04.001059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 24 10:35:04.001059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
Apr 24 10:35:04.001059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 24 10:35:04.001059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 24 10:35:04.001409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 24 10:35:04.001409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1568, in update_router
Apr 24 10:35:04.001409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:04.001409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.001409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:04.001409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:04.001409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:04.001409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.001409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:04.001409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:04.001409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:04.001409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:04.001409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:04.001409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:04.001778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:04.001778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:04.001778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.001778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:04.001778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.001778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.001778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:04.001778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.001778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:04.001778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 77659748-a2b4-448f-aa2d-e166be8f2be9 (type: router_ports) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:35:04.109052 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, resource={'id': '77659748-a2b4-448f-aa2d-e166be8f2be9', 'name': '', 'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'project_id': '', 'mac_address': 'fa:16:3e:fa:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '931f18d3-b7f8-4874-928b-3c06d4d5d355', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7', 'ip_address': '172.24.5.167'}, {'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'ip_address': '2001:db8::1b3'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000170011', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-24T10:24:06Z', 'updated_at': '2026-04-24T10:24:07Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:04.109621 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7 4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'neutron:network_name': 'neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.167/24', '2001:db8::1b3/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:04.109942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=77659748-a2b4-448f-aa2d-e166be8f2be9, lrouter_port=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:04.110355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.111517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:04.111517 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.111517 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:04.111517 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.111517 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.111517 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:04.111517 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.111517 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:04.112194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 77659748-a2b4-448f-aa2d-e166be8f2be9 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.112194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:04.112194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:35:04.112194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:35:04.112194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:35:04.112194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:35:04.112194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1971, in update_router_port
Apr 24 10:35:04.112194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:04.112194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.112194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:04.112194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:04.112780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:04.112780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.112780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:04.112780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:04.112780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:04.112780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:04.112780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:04.112780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:04.112780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:04.112780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:04.112780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.112780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:04.112780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.112780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.113622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:04.113622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.113622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:04.113622 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_for_inconsistencies finished in 0.338 seconds
Apr 24 10:35:04.536744 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:04.537340 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:04.537533 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:04.538442 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:04.579089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:04.579547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.580513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:04.580513 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.580513 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:04.580513 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.580513 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.580513 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:04.580513 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.580513 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:04.581639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.581639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:04.581639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:04.581639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:04.581639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.581639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:04.581639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:04.581639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.581639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:04.581639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:04.581639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:04.581639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.582093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:04.582093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:04.582093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:04.582093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:04.582093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:04.582093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:04.582093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:04.582093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:04.582093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.582093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:04.582093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.582093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.582093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:04.582477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.582477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:04.582744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.582744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:04.582744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:04.582744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:04.582744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:04.582744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:04.582744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.582744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:04.582744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:04.582744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.582744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:04.582744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:04.582744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.582744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:04.582744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:04.582744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.583534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.584470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:04.584470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.584470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:04.687995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:04.688543 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:04.688768 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:04.689941 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:04.690351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:04.690670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.691581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:04.691581 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.691581 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:04.691581 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.691581 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.691581 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:04.691581 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.691581 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:04.693558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.693558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:04.693558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:04.693558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:04.693558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.693558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:04.693558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:04.693558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.693558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:04.693558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:04.693558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:04.693558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.694149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:04.694149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:04.694149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:04.694149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:04.694149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:04.694149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:04.694149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:04.694149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:04.694149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.694149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:04.694149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.694149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.694149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:04.694869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.694869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:04.695478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.695478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:04.695478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:04.695478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:04.695478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:04.695478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:04.695478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.695478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:04.695478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:04.695478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.695478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:04.695478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:04.695478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.695478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:04.695478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:04.695478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.696118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.696662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:04.696662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.696662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:04.707579 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:04.707827 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:04.707937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:04.708203 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:35:04.708624 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:04.708953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.709715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:04.709715 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.709715 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:04.709715 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.709715 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.709715 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:04.709715 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.709715 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:04.711183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.711183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:04.711183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:04.711183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:04.711183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.711183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:04.711183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:04.711183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:04.711183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.711183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:04.711183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:04.711183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:04.711183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:04.711183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:04.711183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:04.711993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:04.711993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:04.711993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.711993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:04.711993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.711993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.711993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:04.711993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.711993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:04.713827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.713827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:04.713827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:04.713827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:04.713827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.713827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:04.713827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:04.713827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:35:04.713827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:04.713827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:04.713827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.713827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:04.714288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:04.714288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:04.714288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.714288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:04.714288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:04.714288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:04.714288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:04.714288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:04.714288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:04.714288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:04.714288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:04.714288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.714288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:04.714288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.714676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.714676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:04.714676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.714676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:04.715920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.715920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:04.715920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:04.715920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:04.715920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:04.715920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:04.715920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.715920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:04.715920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:04.715920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.715920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:04.715920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:04.715920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.715920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:04.715920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:04.715920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:04.716355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:04.716835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.716835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:04.716835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.716835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.716835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:04.716835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.716835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:04.716835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:04.716835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:04.717180 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:04.717180 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:04.717678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:04.718071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.718812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:04.718812 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.718812 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:04.718812 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.718812 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.718812 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:04.718812 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.718812 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:04.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:04.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:04.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:04.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:04.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:04.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:04.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:04.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:04.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:04.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:04.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:04.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:04.720088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:04.720088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:04.720088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.720088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:04.720088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.720088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.720088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:04.720088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.720088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:04.720727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.720727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:04.720727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:04.720727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:04.720727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.720727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:04.720727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:04.720727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:04.720727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:04.720727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.720727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:04.721059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:04.721059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:04.721059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.721059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:04.721059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:04.721059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:04.721059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:04.721059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:04.721059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:04.721059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:04.721059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:04.721059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.721059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:04.721059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.721446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.721446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:04.721446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.721446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.722174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:04.722855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.723562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.723562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:04.723562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.723562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:04.723887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:04.724211 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:04.724394 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:04.724582 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:04.725002 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:04.725360 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:04.725642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.726443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:04.726443 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.726443 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:04.726443 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.726443 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.726443 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:04.726443 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.726443 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:04.727385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.727385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:04.727385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:04.727385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:04.727385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.727385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:04.727385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:04.727385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.727385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:04.727385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:04.727385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:04.727385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.727888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:04.727888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:04.727888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:04.727888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:04.727888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:04.727888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:04.727888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:04.727888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:04.727888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.727888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:04.727888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.727888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.727888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:04.728417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.728417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:04.728768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.728768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:04.728768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:04.728768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:04.728768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:04.728768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:04.728768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.728768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:04.728768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:04.728768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.728768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:04.728768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:04.728768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.728768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:04.728768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:04.728768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:04.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:04.729756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:04.729756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:04.729756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:09.537678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:09.538499 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:09.538769 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:09.540450 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:09.574412 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:09.574802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.575667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:09.575667 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.575667 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:09.575667 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.575667 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.575667 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:09.575667 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.575667 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:09.576913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.576913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:09.576913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:09.576913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:09.576913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.576913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:09.576913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:09.576913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.576913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:09.576913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:09.576913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:09.576913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.577511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:09.577511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:09.577511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:09.577511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:09.577511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:09.577511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:09.577511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:09.577511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:09.577511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.577511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:09.577511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.577511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.577511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:09.578064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.578064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:09.578064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.578064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:09.578064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:09.578064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:09.578064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:09.578064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:09.578064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.578064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:09.578064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:09.578064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.578064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:09.578064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:09.578064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:09.578736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.579547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:09.579547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.579547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.579547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:09.579547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.579547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:09.688831 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:09.689300 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:09.689505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:09.690500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:09.690789 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:09.691018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.692146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:09.692146 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.692146 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:09.692146 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.692146 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.692146 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:09.692146 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.692146 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:09.694193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.694193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:09.694193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:09.694193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:09.694193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.694193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:09.694193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:09.694193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.694193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:09.694193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:09.694193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:09.694193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.695237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:09.695237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:09.695237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:09.695237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:09.695237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:09.695237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:09.695237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:09.695237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:09.695237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.695237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:09.695237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.695237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.695237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:09.695849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.695849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:09.696518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.696518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:09.696518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:09.696518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:09.696518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:09.696518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:09.696518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.696518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:09.696518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:09.696518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.696518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:09.696518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:09.696518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.696518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:09.696518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:09.696518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.697313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.698270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:09.698270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.698270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:09.708074 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:09.708545 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:09.708892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:09.709206 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:35:09.709843 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:09.710257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.711213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:09.711213 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.711213 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:09.711213 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.711213 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.711213 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:09.711213 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.711213 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:09.712617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.712617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:09.712617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:09.712617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:09.712617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.712617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:09.712617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:09.712617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:09.712617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.712617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:09.712617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:09.712617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:09.712617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:09.712617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:09.712617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:09.713528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:09.713528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:09.713528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.713528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:09.713528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.713528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.713528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:09.713528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.713528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:09.714561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.714561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:09.714561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:09.714561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:09.714561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.714561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:09.714561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:09.714561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:35:09.714561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:09.714561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:09.714561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.714561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.715910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.715910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:09.715910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.715910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:09.716563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.716563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:09.716563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:09.716563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:09.716563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:09.716563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:09.716563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.716563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:09.716563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:09.716563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.716563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:09.716563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:09.716563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.716563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:09.716563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:09.716563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:09.717230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:09.717795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.717795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:09.717795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.717795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.717795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:09.717795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.717795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:09.717795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:09.717795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:09.717795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:09.718115 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:09.718212 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:09.718665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.719508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:09.719508 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.719508 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:09.719508 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.719508 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.719508 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:09.719508 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.719508 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:09.720338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.720338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:09.720338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:09.720338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:09.720338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.720338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:09.720338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:09.720338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:09.720338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.720338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:09.720338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:09.720338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:09.720338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:09.720338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:09.720338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:09.721086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:09.721086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:09.721086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.721086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:09.721086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.721086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.721086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:09.721086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.721086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:09.721478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.721478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:09.721478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:09.721478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:09.721478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.721478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:09.721478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:09.721478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:09.721478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:09.721478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.721478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:09.721832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:09.721832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:09.721832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.721832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:09.721832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:09.721832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:09.721832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:09.721832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:09.721832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:09.721832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:09.721832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:09.721832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.721832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:09.721832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.722252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.722252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:09.722252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.722252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.722813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:09.723299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.723855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.723855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:09.723855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.723855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:09.724233 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:09.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:09.724696 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:09.724938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:09.725454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:09.725863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:09.726116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.726892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:09.726892 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.726892 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:09.726892 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.726892 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.726892 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:09.726892 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.726892 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:09.727807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.727807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:09.727807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:09.727807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:09.727807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.727807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:09.727807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:09.727807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.727807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:09.727807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:09.727807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:09.727807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.728147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:09.728147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:09.728147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:09.728147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:09.728147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:09.728147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:09.728147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:09.728147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:09.728147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.728147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:09.728147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.728147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.728147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:09.728559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.728559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:09.729062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.729062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:09.729062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:09.729062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:09.729062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:09.729062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:09.729062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.729062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:09.729062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:09.729062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.729062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:09.729062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:09.729062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.729062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:09.729062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:09.729062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:09.729554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:09.730068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:09.730068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:09.730068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:14.538244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:14.579987 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:14.580211 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:14.580998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:14.612982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:14.613455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.614312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:14.614312 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.614312 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:14.614312 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.614312 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.614312 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:14.614312 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.614312 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:14.615079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.615079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:14.615079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:14.615079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:14.615079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.615079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:14.615079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:14.615079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.615079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:14.615079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:14.615079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:14.615079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.615812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:14.615812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:14.615812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:14.615812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:14.615812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:14.615812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:14.615812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:14.615812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:14.615812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.615812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:14.615812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.615812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.615812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:14.616571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.616571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:14.616571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.616571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:14.616571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:14.616571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:14.616571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:14.616571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:14.616571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.616571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:14.616571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:14.616571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.616571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:14.616571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:14.616571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:14.617311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.618346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:14.618346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.618346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.618346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:14.618346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.618346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:14.689416 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:14.689800 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:14.689897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:14.690878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:14.691247 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:14.691562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.692399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:14.692399 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.692399 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:14.692399 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.692399 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.692399 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:14.692399 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.692399 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:14.693504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.693504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:14.693504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:14.693504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:14.693504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.693504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:14.693504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:14.693504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.693504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:14.693504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:14.693504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:14.693504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.694155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:14.694155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:14.694155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:14.694155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:14.694155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:14.694155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:14.694155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:14.694155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:14.694155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.694155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:14.694155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.694155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.694155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:14.695074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.695074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:14.695074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.695074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:14.695074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:14.695074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:14.695074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:14.695074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:14.695074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.695074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:14.695074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:14.695074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.695074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:14.695074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:14.695074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:14.695886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.696689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:14.696689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.696689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.696689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:14.696689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.696689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:14.708541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:14.708815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:14.708916 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:14.709043 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:35:14.709556 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:14.709953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.710887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:14.710887 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.710887 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:14.710887 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.710887 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.710887 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:14.710887 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.710887 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:14.711629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.711629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:14.711629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:14.711629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:14.711629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.711629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:14.711629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:14.711629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:14.711629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.711629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:14.711629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:14.711629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:14.711629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:14.711629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:14.711629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:14.712432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:14.712432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:14.712432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.712432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:14.712432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.712432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.712432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:14.712432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.712432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:14.712432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.712432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:14.712432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:14.712432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:14.712432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.713111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:14.713111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:14.713111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:35:14.713111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:14.713111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:14.713111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.713111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:14.713111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:14.713111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:14.713111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.713111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:14.713111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:14.713111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:14.713741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:14.713741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:14.713741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:14.713741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:14.713741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:14.713741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.713741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:14.713741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.713741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.713741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:14.713741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.713741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:14.714284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.714284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:14.714284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:14.714284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:14.714284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:14.714284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:14.714284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.714284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:14.714284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:14.714284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.714284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:14.714284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:14.714284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.714284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:14.714284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:14.714284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:14.715067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:14.716075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.716075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:14.716075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.716075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.716075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:14.716075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.716075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:14.717275 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:14.717496 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:14.717604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:14.717733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:14.718582 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:14.718582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.719275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:14.719275 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.719275 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:14.719275 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.719275 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.719275 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:14.719275 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.719275 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:14.720019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.720019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:14.720019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:14.720019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:14.720019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.720019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:14.720019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:14.720019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:14.720019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.720019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:14.720019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:14.720019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:14.720019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:14.720019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:14.720019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:14.720487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:14.720487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:14.720487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.720487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:14.720487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.720487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.720487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:14.720487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.720487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:14.720883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.720883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:14.720883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:14.720883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:14.720883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.720883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:14.720883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:14.720883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:14.720883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:14.720883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.720883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:14.721249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:14.721249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:14.721249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.721249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:14.721249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:14.721249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:14.721249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:14.721249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:14.721249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:14.721249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:14.721249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:14.721249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.721249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:14.721249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.721636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.721636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:14.721636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.721636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.721900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:14.722424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.723091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.723091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:14.723091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.723091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:14.724578 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:14.724762 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:14.724867 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:14.725010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:14.725439 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:14.725797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:14.726028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.726743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:14.726743 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.726743 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:14.726743 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.726743 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.726743 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:14.726743 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.726743 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:14.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:14.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:14.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:14.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:14.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:14.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:14.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:14.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:14.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.727927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:14.727927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:14.727927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:14.727927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:14.727927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:14.727927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:14.727927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:14.727927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:14.727927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.727927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:14.727927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.727927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.727927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:14.728284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.728284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:14.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:14.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:14.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:14.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:14.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:14.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:14.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:14.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:14.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:14.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:14.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:14.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:14.729012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:14.729555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:14.729555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:14.729555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:19.580701 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:19.581621 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:19.581621 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:19.582236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:19.657268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:19.657733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.658668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:19.658668 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.658668 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:19.658668 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.658668 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.658668 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:19.658668 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.658668 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:19.659501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.077 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.659501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:19.659501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:19.659501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:19.659501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.659501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:19.659501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:19.659501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.659501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:19.659501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:19.659501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:19.659501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.660286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:19.660286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:19.660286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:19.660286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:19.660286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:19.660286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:19.660286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:19.660286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:19.660286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.660286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:19.660286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.660286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.660286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:19.661078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.661078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:19.661078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.661078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:19.661078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:19.661078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:19.661078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:19.661078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:19.661078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.661078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:19.661078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:19.661078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.661078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:19.661078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:19.661078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:19.661910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.662883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:19.662883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.662883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.662883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:19.662883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.662883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:19.690073 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:19.690673 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:19.691004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:19.691801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:19.692275 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:19.692647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.693491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:19.693491 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.693491 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:19.693491 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.693491 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.693491 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:19.693491 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.693491 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:19.695593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.695593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:19.695593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:19.695593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:19.695593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.695593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:19.695593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:19.695593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.695593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:19.695593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:19.695593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:19.695593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.696127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:19.696127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:19.696127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:19.696127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:19.696127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:19.696127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:19.696127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:19.696127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:19.696127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.696127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:19.696127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.696127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.696127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:19.696468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.696468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:19.697783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.697783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:19.697783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:19.697783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:19.697783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:19.697783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:19.697783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.697783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:19.697783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:19.697783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.697783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:19.697783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:19.697783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.697783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:19.697783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:19.697783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.698210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.698815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:19.698815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.698815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:19.709137 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:19.709524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:19.709643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:19.709764 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:35:19.710109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:19.710341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.710896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:19.710896 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.710896 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:19.710896 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.710896 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.710896 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:19.710896 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.710896 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:19.711676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.711676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:19.711676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:19.711676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:19.711676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.711676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:19.711676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:19.711676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:19.711676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.711676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:19.711676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:19.711676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:19.711676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:19.711676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:19.711676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:19.712650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:19.712650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:19.712650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.712650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:19.712650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.712650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.712650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:19.712650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.712650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:19.712650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.712650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:19.712650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:19.712650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:19.712650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.713410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:19.713410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:19.713410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:35:19.713410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:19.713410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:19.713410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.713410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:19.713410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:19.713410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:19.713410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.713410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:19.713410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:19.713410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:19.714395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:19.714395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:19.714395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:19.714395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:19.714395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:19.714395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.714395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:19.714395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.714395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.714395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:19.714395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.714395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:19.714988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.714988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:19.714988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:19.714988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:19.714988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:19.714988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:19.714988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.714988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:19.714988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:19.714988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.714988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:19.714988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:19.714988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.714988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:19.714988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:19.714988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:19.715829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:19.716889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.716889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:19.716889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.716889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.716889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:19.716889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.716889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:19.717747 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:19.718188 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:19.718433 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:19.718644 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:19.719008 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:19.719228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.719728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:19.719728 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.719728 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:19.719728 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.719728 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.719728 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:19.719728 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.719728 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:19.720495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.720495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:19.720495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:19.720495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:19.720495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.720495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:19.720495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:19.720495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:19.720495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.720495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:19.720495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:19.720495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:19.720495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:19.720495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:19.720495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:19.720764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:19.720764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:19.720764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.720764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:19.720764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.720764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.720764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:19.720764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.720764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:19.721406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.721406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:19.721406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:19.721406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:19.721406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.721406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:19.721406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:19.721406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:19.721406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:19.721406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.721406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:19.721628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:19.721628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:19.721628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.721628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:19.721628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:19.721628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:19.721628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:19.721628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:19.721628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:19.721628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:19.721628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:19.721628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.721628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:19.721628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.721865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.721865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:19.721865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.721865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.722646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:19.722960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.723292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.723292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:19.723292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.723292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:19.725038 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:19.725339 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:19.725483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:19.725625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:19.726100 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:19.726537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:19.726933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.727664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:19.727664 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.727664 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:19.727664 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.727664 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.727664 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:19.727664 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.727664 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:19.728606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.728606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:19.728606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:19.728606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:19.728606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.728606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:19.728606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:19.728606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.728606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:19.728606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:19.728606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:19.728606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.729072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:19.729072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:19.729072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:19.729072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:19.729072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:19.729072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:19.729072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:19.729072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:19.729072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.729072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:19.729072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.729072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.729072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:19.729455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.729455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:19.729871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.729871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:19.729871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:19.729871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:19.729871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:19.729871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:19.729871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.729871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:19.729871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:19.729871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.729871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:19.729871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:19.729871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.729871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:19.729871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:19.729871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:19.730467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:19.730988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:19.730988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:19.730988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:24.581599 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:24.582701 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:24.582701 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:24.583701 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:24.615637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:24.616282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.616917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:24.616917 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.616917 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:24.616917 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.616917 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.616917 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:24.616917 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.616917 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:24.617958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.617958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:24.617958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:24.617958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:24.617958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.617958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:24.617958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:24.617958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.617958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:24.617958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:24.617958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:24.617958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.618889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:24.618889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:24.618889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:24.618889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:24.618889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:24.618889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:24.618889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:24.618889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:24.618889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.618889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:24.618889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.618889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.618889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:24.619836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.619836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:24.619836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.619836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:24.619836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:24.619836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:24.619836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:24.619836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:24.619836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.619836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:24.619836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:24.619836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.619836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:24.619836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:24.619836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:24.620914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.622206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:24.622206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.622206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.622206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:24.622206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.622206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:24.690771 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:24.691268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:24.691486 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:24.692498 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:24.692761 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:24.693268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.694099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:24.694099 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.694099 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:24.694099 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.694099 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.694099 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:24.694099 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.694099 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:24.695728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.695728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:24.695728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:24.695728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:24.695728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.695728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:24.695728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:24.695728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.695728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:24.695728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:24.695728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:24.695728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.696249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:24.696249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:24.696249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:24.696249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:24.696249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:24.696249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:24.696249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:24.696249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:24.696249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.696249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:24.696249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.696249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.696249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:24.696723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.696723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:24.697604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.697604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:24.697604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:24.697604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:24.697604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:24.697604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:24.697604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.697604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:24.697604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:24.697604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.697604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:24.697604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:24.697604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.697604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:24.697604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:24.697604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.698057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.698547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:24.698547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.698547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:24.709549 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:24.709805 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:24.709917 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:24.710032 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:35:24.710429 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:24.710679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.711149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:24.711149 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.711149 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:24.711149 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.711149 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.711149 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:24.711149 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.711149 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:24.711859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.711859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:24.711859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:24.711859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:24.711859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.711859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:24.711859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:24.711859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:24.711859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.711859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:24.711859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:24.711859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:24.711859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:24.711859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:24.711859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:24.712400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:24.712400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:24.712400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.712400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:24.712400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.712400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.712400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:24.712400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.712400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:24.712687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.712687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:24.712687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:24.712687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:24.712687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.712687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:24.712687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:24.712687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:35:24.712687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:24.712687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:24.712687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.712687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:24.713153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:24.713153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:24.713153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.713153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:24.713153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:24.713153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:24.713153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:24.713153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:24.713153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:24.713153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:24.713153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:24.713153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.713153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:24.713153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.713539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.713539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:24.713539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.713539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:24.713816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.713816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:24.713816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:24.713816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:24.713816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:24.713816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:24.713816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.713816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:24.713816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:24.713816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.713816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:24.713816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:24.713816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.713816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:24.713816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:24.713816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:24.714418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:24.715305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.715305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:24.715305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.715305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.715305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:24.715305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.715305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:24.718068 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:24.718329 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:24.718461 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:24.718602 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:24.718899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:24.719154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.719667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:24.719667 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.719667 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:24.719667 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.719667 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.719667 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:24.719667 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.719667 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:24.720457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.720457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:24.720457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:24.720457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:24.720457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.720457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:24.720457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:24.720457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:24.720457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.720457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:24.720457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:24.720457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:24.720457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:24.720457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:24.720457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:24.721213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:24.721213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:24.721213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.721213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:24.721213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.721213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.721213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:24.721213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.721213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:24.721659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.721659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:24.721659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:24.721659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:24.721659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.721659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:24.721659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:24.721659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:24.721659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:24.721659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.721659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:24.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:24.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:24.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:24.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:24.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:24.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:24.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:24.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:24.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:24.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:24.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:24.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.722583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.722583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:24.722583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.722583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.722734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:24.723286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.723810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.723810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:24.723810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.723810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:24.725387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:24.725634 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:24.725736 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:24.725893 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:24.726175 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:24.726483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:24.726643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.727134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:24.727134 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.727134 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:24.727134 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.727134 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.727134 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:24.727134 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.727134 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:24.728026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.728026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:24.728026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:24.728026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:24.728026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.728026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:24.728026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:24.728026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.728026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:24.728026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:24.728026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:24.728026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.728520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:24.728520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:24.728520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:24.728520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:24.728520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:24.728520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:24.728520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:24.728520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:24.728520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.728520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:24.728520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.728520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.728520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:24.729087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.729087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:24.729179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.729179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:24.729179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:24.729179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:24.729179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:24.729179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:24.729179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.729179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:24.729179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:24.729179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.729179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:24.729179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:24.729179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.729179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:24.729179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:24.729179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:24.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:24.730544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:24.730544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:24.730544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:29.582199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:29.583022 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:29.583022 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:29.584553 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:29.620302 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:29.620887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.621484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:29.621484 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.621484 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:29.621484 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.621484 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.621484 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:29.621484 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.621484 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:29.622360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.622360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:29.622360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:29.622360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:29.622360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.622360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:29.622360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:29.622360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.622360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:29.622360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:29.622360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:29.622360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.622827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:29.622827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:29.622827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:29.622827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:29.622827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:29.622827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:29.622827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:29.622827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:29.622827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.622827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:29.622827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.622827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.622827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:29.623176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.623176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:29.623356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.623356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:29.623356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:29.623356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:29.623356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:29.623356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:29.623356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.623356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:29.623356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:29.623356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.623356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:29.623356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:29.623356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.623356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:29.623356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:29.623356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.624009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.624572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:29.624572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.624572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:29.691574 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:29.692130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:29.692320 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:29.693241 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:29.693550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:29.693773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.694556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:29.694556 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.694556 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:29.694556 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.694556 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.694556 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:29.694556 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.694556 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:29.695988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.695988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:29.695988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:29.695988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:29.695988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.695988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:29.695988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:29.695988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.695988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:29.695988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:29.695988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:29.695988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.696626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:29.696626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:29.696626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:29.696626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:29.696626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:29.696626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:29.696626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:29.696626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:29.696626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.696626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:29.696626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.696626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.696626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:29.697161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.697161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:29.697161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.697161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:29.697161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:29.697161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:29.697161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:29.697161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:29.697161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.697161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:29.697161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:29.697161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.697161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:29.697161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:29.697161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:29.697803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.698570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:29.698570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.698570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.698570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:29.698570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.698570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:29.710031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:29.710450 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:29.710694 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:29.710810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:35:29.711300 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:29.711660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.712579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:29.712579 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.712579 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:29.712579 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.712579 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.712579 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:29.712579 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.712579 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:29.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:29.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:29.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:29.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:29.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:29.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:29.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:29.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:29.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:29.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:29.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:29.713955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:29.714935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:29.714935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:29.714935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.714935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:29.714935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.714935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.714935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:29.714935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.714935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:29.716003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.716003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:29.716003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:29.716003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:29.716003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.716003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:29.716003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:29.716003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:35:29.716003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:29.716003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:29.716003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.716003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:29.716743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:29.716743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:29.716743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.716743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:29.716743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:29.716743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:29.716743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:29.716743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:29.716743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:29.716743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:29.716743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:29.716743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.716743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:29.716743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.717327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.717327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:29.717327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.717327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:29.717663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.717663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:29.717663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:29.717663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:29.717663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:29.717663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:29.717663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.717663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:29.717663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:29.717663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.717663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:29.717663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:29.717663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.717663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:29.717663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:29.717663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:29.718193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:29.718782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.718782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:29.718782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.718782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.718782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:29.718782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.718782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:29.718782 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:29.719131 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:29.719131 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:29.719249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:29.719720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:29.720150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.720761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:29.720761 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.720761 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:29.720761 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.720761 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.720761 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:29.720761 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.720761 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:29.721672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.721672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:29.721672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:29.721672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:29.721672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.721672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:29.721672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:29.721672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:29.721672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.721672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:29.721672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:29.721672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:29.721672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:29.721672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:29.721672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:29.722252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:29.722252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:29.722252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.722252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:29.722252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.722252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.722252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:29.722252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.722252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:29.722864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.722864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:29.722864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:29.722864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:29.722864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.722864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:29.722864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:29.722864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:29.722864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:29.722864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.722864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:29.723321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:29.723321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:29.723321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.723321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:29.723321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:29.723321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:29.723321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:29.723321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:29.723321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:29.723321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:29.723321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:29.723321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.723321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:29.723321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.723904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.723904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:29.723904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.723904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.724392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:29.724916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.725520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.725520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:29.725520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.725520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:29.725791 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:29.726099 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:29.726251 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:29.726487 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:29.726746 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:29.726950 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:29.727081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.727542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:29.727542 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.727542 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:29.727542 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.727542 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.727542 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:29.727542 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.727542 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:29.728542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.728542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:29.728542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:29.728542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:29.728542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.728542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:29.728542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:29.728542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.728542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:29.728542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:29.728542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:29.728542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.729044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:29.729044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:29.729044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:29.729044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:29.729044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:29.729044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:29.729044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:29.729044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:29.729044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.729044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:29.729044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.729044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.729044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:29.729643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.729643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:29.729888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.729888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:29.729888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:29.729888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:29.729888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:29.729888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:29.729888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.729888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:29.729888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:29.729888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.729888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:29.729888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:29.729888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.729888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:29.729888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:29.729888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:29.730386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:29.730907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:29.730907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:29.730907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:34.583130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:34.583923 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:34.583923 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:34.584895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:34.616874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:34.617276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.618217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:34.618217 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.618217 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:34.618217 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.618217 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.618217 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:34.618217 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.618217 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:34.619177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.619177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:34.619177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:34.619177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:34.619177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.619177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:34.619177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:34.619177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.619177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:34.619177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:34.619177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:34.619177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.619590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:34.619590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:34.619590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:34.619590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:34.619590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:34.619590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:34.619590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:34.619590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:34.619590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.619590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:34.619590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.619590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.619590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:34.619994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.619994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:34.619994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.619994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:34.619994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:34.619994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:34.619994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:34.619994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:34.619994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.619994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:34.619994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:34.619994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.619994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:34.619994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:34.619994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:34.620463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.621011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:34.621011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.621011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.621011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:34.621011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.621011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:34.692251 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:34.692714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:34.692979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:34.694028 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:34.694391 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:34.694827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.695525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:34.695525 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.695525 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:34.695525 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.695525 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.695525 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:34.695525 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.695525 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:34.696511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.696511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:34.696511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:34.696511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:34.696511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.696511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:34.696511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:34.696511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.696511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:34.696511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:34.696511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:34.696511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.697166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:34.697166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:34.697166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:34.697166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:34.697166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:34.697166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:34.697166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:34.697166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:34.697166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.697166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:34.697166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.697166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.697166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:34.697815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.697815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:34.697815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.697815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:34.697815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:34.697815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:34.697815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:34.697815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:34.697815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.697815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:34.697815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:34.697815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.697815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:34.697815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:34.697815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:34.698645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.699281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:34.699281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.699281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.699281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:34.699281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.699281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:34.710778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:34.711395 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:34.711685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:34.711935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:35:34.712442 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:34.712739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.713803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:34.713803 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.713803 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:34.713803 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.713803 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.713803 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:34.713803 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.713803 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:34.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:34.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:34.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:34.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:34.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:34.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:34.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:34.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:34.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:34.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:34.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:34.714649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:34.715513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:34.715513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:34.715513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.715513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:34.715513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.715513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.715513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:34.715513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.715513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:34.715513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.715513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:34.715513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:34.715513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:34.715513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.716236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:34.716236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:34.716236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:35:34.716236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:34.716236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:34.716236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.716236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:34.716236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:34.716236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:34.716236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.716236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:34.716236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:34.716236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:34.716903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:34.716903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:34.716903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:34.716903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:34.716903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:34.716903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.716903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:34.716903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.716903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.716903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:34.716903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.716903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:34.717510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.717510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:34.717510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:34.717510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:34.717510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:34.717510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:34.717510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.717510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:34.717510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:34.717510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.717510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:34.717510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:34.717510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.717510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:34.717510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:34.717510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:34.718243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:34.719135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.719135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:34.719135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.719135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.719135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:34.719135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.719135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:34.719135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:34.719465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:34.719639 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:34.719809 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:34.720273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:34.720661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.721398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:34.721398 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.721398 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:34.721398 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.721398 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.721398 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:34.721398 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.721398 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:34.722102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.722102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:34.722102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:34.722102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:34.722102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.722102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:34.722102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:34.722102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:34.722102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.722102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:34.722102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:34.722102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:34.722102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:34.722102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:34.722102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:34.722526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:34.722526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:34.722526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.722526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:34.722526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.722526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.722526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:34.722526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.722526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:34.723036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.723036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:34.723036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:34.723036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:34.723036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.723036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:34.723036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:34.723036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:34.723036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:34.723036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.723036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:34.723343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:34.723343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:34.723343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.723343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:34.723343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:34.723343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:34.723343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:34.723343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:34.723343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:34.723343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:34.723343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:34.723343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.723343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:34.723343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.723723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.723723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:34.723723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.723723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.724080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:34.724553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.725027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.725027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:34.725027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.725027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:34.726165 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:34.726486 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:34.726637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:34.726786 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:34.727215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:34.727600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:34.727819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.728515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:34.728515 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.728515 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:34.728515 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.728515 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.728515 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:34.728515 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.728515 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:34.729379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.729379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:34.729379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:34.729379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:34.729379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.729379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:34.729379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:34.729379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.729379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:34.729379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:34.729379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:34.729379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.729725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:34.729725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:34.729725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:34.729725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:34.729725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:34.729725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:34.729725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:34.729725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:34.729725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.729725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:34.729725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.729725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.729725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:34.730038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.730038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:34.730334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.730334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:34.730334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:34.730334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:34.730334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:34.730334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:34.730334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.730334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:34.730334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:34.730334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.730334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:34.730334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:34.730334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.730334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:34.730334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:34.730334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:34.730810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:34.731299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:34.731299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:34.731299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:39.583939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:39.584975 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:39.585178 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:39.586332 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:39.625355 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:39.625355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.626036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:39.626036 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.626036 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:39.626036 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.626036 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.626036 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:39.626036 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.626036 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:39.626882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.626882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:39.626882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:39.626882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:39.626882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.626882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:39.626882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:39.626882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.626882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:39.626882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:39.626882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:39.626882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.627516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:39.627516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:39.627516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:39.627516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:39.627516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:39.627516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:39.627516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:39.627516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:39.627516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.627516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:39.627516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.627516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.627516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:39.628104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.628104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:39.628104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.628104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:39.628104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:39.628104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:39.628104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:39.628104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:39.628104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.628104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:39.628104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:39.628104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.628104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:39.628104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:39.628104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:39.628872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.629725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:39.629725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.629725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.629725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:39.629725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.629725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:39.693142 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:39.693856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:39.693953 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:39.695632 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:39.695632 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:39.695632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.696449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:39.696449 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.696449 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:39.696449 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.696449 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.696449 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:39.696449 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.696449 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:39.697603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.697603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:39.697603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:39.697603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:39.697603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.697603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:39.697603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:39.697603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.697603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:39.697603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:39.697603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:39.697603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.698215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:39.698215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:39.698215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:39.698215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:39.698215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:39.698215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:39.698215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:39.698215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:39.698215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.698215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:39.698215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.698215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.698215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:39.698753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.698753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:39.698753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.698753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:39.698753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:39.698753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:39.698753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:39.698753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:39.698753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.698753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:39.698753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:39.698753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.698753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:39.698753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:39.698753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:39.700245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.702459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:39.702459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.702459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.702459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:39.702459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.702459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:39.711751 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:39.712175 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:39.712261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:39.712429 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:35:39.713129 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:39.713525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.714472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:39.714472 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.714472 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:39.714472 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.714472 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.714472 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:39.714472 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.714472 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:39.715259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.715259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:39.715259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:39.715259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:39.715259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.715259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:39.715259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:39.715259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:39.715259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.715259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:39.715259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:39.715259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:39.715259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:39.715259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:39.715259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:39.716101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:39.716101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:39.716101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.716101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:39.716101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.716101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.716101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:39.716101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.716101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:39.716101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.716101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:39.716101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:39.716101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:39.716101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.716841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:39.716841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:39.716841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:35:39.716841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:39.716841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:39.716841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.716841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:39.716841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:39.716841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:39.716841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.716841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:39.716841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:39.716841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:39.717444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:39.717444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:39.717444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:39.717444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:39.717444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:39.717444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.717444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:39.717444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.717444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.717444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:39.717444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.717444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:39.717966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.717966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:39.717966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:39.717966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:39.717966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:39.717966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:39.717966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.717966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:39.717966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:39.717966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.717966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:39.717966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:39.717966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.717966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:39.717966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:39.717966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:39.718889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:39.719474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.719474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:39.719474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.719474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.719474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:39.719474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.719474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:39.719650 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:39.719994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:39.720097 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:39.720223 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:39.720811 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:39.721232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.722042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:39.722042 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.722042 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:39.722042 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.722042 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.722042 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:39.722042 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.722042 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:39.722823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.722823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:39.722823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:39.722823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:39.722823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.722823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:39.722823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:39.722823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:39.722823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.722823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:39.722823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:39.722823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:39.722823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:39.722823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:39.722823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:39.723207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:39.723207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:39.723207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.723207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:39.723207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.723207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.723207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:39.723207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.723207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:39.723682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.723682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:39.723682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:39.723682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:39.723682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.723682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:39.723682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:39.723682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:39.723682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:39.723682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.723682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:39.724008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:39.724008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:39.724008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.724008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:39.724008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:39.724008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:39.724008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:39.724008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:39.724008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:39.724008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:39.724008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:39.724008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.724008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:39.724008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.724389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.724389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:39.724389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.724389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.724724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:39.725197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.725715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.725715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:39.725715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.725715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:39.726603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:39.726877 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:39.726984 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:39.727135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:39.727645 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:39.728005 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:39.728244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.728978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:39.728978 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.728978 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:39.728978 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.728978 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.728978 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:39.728978 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.728978 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:39.729814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.729814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:39.729814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:39.729814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:39.729814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.729814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:39.729814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:39.729814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.729814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:39.729814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:39.729814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:39.729814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.730188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:39.730188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:39.730188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:39.730188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:39.730188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:39.730188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:39.730188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:39.730188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:39.730188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.730188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:39.730188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.730188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.730188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:39.730563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.730563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:39.730805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.730805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:39.730805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:39.730805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:39.730805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:39.730805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:39.730805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.730805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:39.730805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:39.730805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.730805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:39.730805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:39.730805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.730805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:39.730805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:39.730805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:39.731269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:39.731940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:39.731940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:39.731940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:44.584730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:44.585820 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:44.585820 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:44.586262 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:44.617500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:44.617922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.618852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:44.618852 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.618852 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:44.618852 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.618852 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.618852 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:44.618852 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.618852 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:44.619630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.619630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:44.619630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:44.619630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:44.619630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.619630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:44.619630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:44.619630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.619630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:44.619630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:44.619630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:44.619630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.620653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:44.620653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:44.620653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:44.620653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:44.620653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:44.620653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:44.620653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:44.620653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:44.620653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.620653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:44.620653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.620653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.620653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:44.621683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.621683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:44.621683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.621683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:44.621683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:44.621683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:44.621683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:44.621683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:44.621683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.621683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:44.621683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:44.621683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.621683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:44.621683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:44.621683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:44.622791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.623772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:44.623772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.623772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.623772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:44.623772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.623772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:44.693743 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:44.694188 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:44.694345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:44.695708 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:44.696074 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:44.696383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.697574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:44.697574 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.697574 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:44.697574 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.697574 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.697574 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:44.697574 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.697574 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:44.699150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.699150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:44.699150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:44.699150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:44.699150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.699150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:44.699150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:44.699150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.699150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:44.699150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:44.699150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:44.699150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.699540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:44.699540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:44.699540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:44.699540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:44.699540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:44.699540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:44.699540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:44.699540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:44.699540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.699540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:44.699540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.699540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.699540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:44.699970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.699970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:44.701213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.701213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:44.701213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:44.701213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:44.701213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:44.701213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:44.701213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.701213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:44.701213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:44.701213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.701213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:44.701213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:44.701213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.701213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:44.701213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:44.701213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.701706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:44.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:44.712203 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:44.712574 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:44.712758 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:44.712945 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:35:44.713623 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:44.713998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.714876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:44.714876 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.714876 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:44.714876 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.714876 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.714876 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:44.714876 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.714876 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:44.716137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.716137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:44.716137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:44.716137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:44.716137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.716137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:44.716137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:44.716137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:44.716137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.716137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:44.716137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:44.716137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:44.716137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:44.716137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:44.716137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:44.716878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:44.716878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:44.716878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.716878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:44.716878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.716878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.716878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:44.716878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.716878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:44.717603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.717603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:44.717603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:44.717603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:44.717603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.717603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:44.717603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:44.717603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:35:44.717603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:44.717603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:44.717603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.717603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:44.718238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:44.718238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:44.718238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.718238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:44.718238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:44.718238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:44.718238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:44.718238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:44.718238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:44.718238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:44.718238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:44.718238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.718238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:44.718238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.718948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.718948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:44.718948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.718948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:44.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:44.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:44.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:44.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:44.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:44.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:44.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:44.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:44.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:44.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:44.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:44.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:44.719833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:44.720697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.720697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:44.720697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.720697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.720697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:44.720697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.720697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:44.720697 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:44.720697 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:44.720697 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:44.721168 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:44.721168 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:44.721360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.722142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:44.722142 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.722142 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:44.722142 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.722142 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.722142 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:44.722142 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.722142 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:44.722897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.722897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:44.722897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:44.722897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:44.722897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.722897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:44.722897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:44.722897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:44.722897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.722897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:44.722897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:44.722897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:44.722897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:44.722897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:44.722897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:44.723305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:44.723305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:44.723305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.723305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:44.723305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.723305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.723305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:44.723305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.723305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:44.723810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.723810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:44.723810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:44.723810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:44.723810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.723810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:44.723810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:44.723810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:44.723810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:44.723810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.723810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:44.724149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:44.724149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:44.724149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.724149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:44.724149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:44.724149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:44.724149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:44.724149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:44.724149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:44.724149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:44.724149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:44.724149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.724149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:44.724149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.724547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.724547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:44.724547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.724547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.724923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:44.725446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.725934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.725934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:44.725934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.725934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:44.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:44.727353 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:44.727485 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:44.727634 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:44.728091 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:44.728544 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:44.728810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.729613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:44.729613 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.729613 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:44.729613 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.729613 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.729613 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:44.729613 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.729613 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:44.730425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.730425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:44.730425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:44.730425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:44.730425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.730425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:44.730425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:44.730425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.730425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:44.730425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:44.730425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:44.730425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.730770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:44.730770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:44.730770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:44.730770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:44.730770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:44.730770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:44.730770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:44.730770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:44.730770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.730770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:44.730770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.730770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.730770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:44.731133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.731133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:44.731432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.731432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:44.731432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:44.731432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:44.731432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:44.731432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:44.731432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.731432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:44.731432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:44.731432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.731432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:44.731432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:44.731432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.731432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:44.731432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:44.731432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:44.732027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:44.732538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:44.732538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:44.732538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:49.585360 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:49.586193 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:49.586283 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:49.587637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:49.621163 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:49.622109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.622246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:49.622246 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.622246 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:49.622246 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.622246 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.622246 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:49.622246 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.622246 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:49.623513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.623513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:49.623513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:49.623513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:49.623513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.623513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:49.623513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:49.623513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.623513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:49.623513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:49.623513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:49.623513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.623943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:49.623943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:49.623943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:49.623943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:49.623943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:49.623943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:49.623943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:49.623943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:49.623943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.623943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:49.623943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.623943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.623943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:49.624289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.624289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:49.624723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.624723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:49.624723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:49.624723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:49.624723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:49.624723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:49.624723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.624723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:49.624723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:49.624723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.624723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:49.624723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:49.624723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.624723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:49.624723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:49.624723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.625580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.626500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:49.626500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.626500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:49.694410 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:49.695041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:49.695246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:49.696596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:49.697016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:49.697294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.698171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:49.698171 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.698171 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:49.698171 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.698171 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.698171 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:49.698171 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.698171 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:49.699847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.699847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:49.699847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:49.699847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:49.699847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.699847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:49.699847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:49.699847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.699847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:49.699847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:49.699847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:49.699847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.700499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:49.700499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:49.700499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:49.700499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:49.700499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:49.700499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:49.700499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:49.700499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:49.700499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.700499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:49.700499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.700499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.700499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:49.701142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.701142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:49.701754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.701754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:49.701754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:49.701754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:49.701754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:49.701754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:49.701754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.701754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:49.701754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:49.701754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.701754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:49.701754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:49.701754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.701754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:49.701754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:49.701754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.702639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.703645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:49.703645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.703645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:49.712618 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:49.713000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:49.713136 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:49.713246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:35:49.713838 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:49.714135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.714902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:49.714902 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.714902 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:49.714902 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.714902 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.714902 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:49.714902 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.714902 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:49.716258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.716258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:49.716258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:49.716258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:49.716258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.716258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:49.716258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:49.716258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:49.716258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.716258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:49.716258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:49.716258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:49.716258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:49.716258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:49.716258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:49.717020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:49.717020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:49.717020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.717020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:49.717020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.717020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.717020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:49.717020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.717020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:49.718089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.718089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:49.718089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:49.718089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:49.718089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.718089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:49.718089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:49.718089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:35:49.718089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:49.718089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:49.718089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.718089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:49.719230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:49.719230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:49.719230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.719230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:49.719230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:49.719230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:49.719230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:49.719230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:49.719230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:49.719230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:49.719230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:49.719230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.719230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:49.719230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.719809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.719809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:49.719809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.719809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:49.719809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.719809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:49.719809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:49.719809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:49.719809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:49.719809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:49.719809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.719809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:49.719809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:49.719809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:49.720419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:49.721267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:49.721267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:49.721267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:49.721267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:49.721267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:49.721267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.721267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:49.721267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.721267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.721267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:49.721267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.721267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:49.721267 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:49.721267 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:49.721792 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:49.721792 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:49.721792 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:49.721884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.722452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:49.722452 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.722452 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:49.722452 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.722452 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.722452 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:49.722452 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.722452 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:49.723174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.723174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:49.723174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:49.723174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:49.723174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.723174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:49.723174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:49.723174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:49.723174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.723174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:49.723174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:49.723174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:49.723174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:49.723174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:49.723174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:49.723726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:49.723726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:49.723726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.723726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:49.723726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.723726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.723726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:49.723726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.723726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:49.724232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.724232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:49.724232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:49.724232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:49.724232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.724232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:49.724232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:49.724232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:49.724232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:49.724232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.724232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:49.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:49.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:49.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:49.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:49.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:49.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:49.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:49.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:49.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:49.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:49.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:49.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.724961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.724961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:49.724961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.724961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.725351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:49.725795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.726247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.726247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:49.726247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.726247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:49.727540 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:49.727825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:49.727965 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:49.728123 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:49.728587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:49.728919 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:49.729187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.729877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:49.729877 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.729877 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:49.729877 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.729877 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.729877 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:49.729877 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.729877 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:49.730722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.730722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:49.730722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:49.730722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:49.730722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.730722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:49.730722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:49.730722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.730722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:49.730722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:49.730722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:49.730722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.731052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:49.731052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:49.731052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:49.731052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:49.731052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:49.731052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:49.731052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:49.731052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:49.731052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.731052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:49.731052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.731052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.731052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:49.731431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.731431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:49.731693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.731693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:49.731693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:49.731693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:49.731693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:49.731693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:49.731693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.731693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:49.731693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:49.731693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.731693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:49.731693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:49.731693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.731693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:49.731693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:49.731693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:49.732124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:49.732674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:49.732674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:49.732674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:54.586191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:54.587204 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:54.587527 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:54.589499 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:54.592229 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=434 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:35:54.630563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:54.630814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.631576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:54.631576 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.631576 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:54.631576 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.631576 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.631576 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:54.631576 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.631576 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:54.632858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.044 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.632858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:54.632858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:54.632858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:54.632858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.632858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:54.632858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:54.632858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.632858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:54.632858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:54.632858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:54.632858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.633725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:54.633725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:54.633725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:54.633725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:54.633725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:54.633725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:54.633725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:54.633725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:54.633725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.633725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:54.633725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.633725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.633725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:54.634552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.634552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:54.634552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.634552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:54.634552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:54.634552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:54.634552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:54.634552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:54.634552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.634552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:54.634552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:54.634552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.634552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:54.634552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:54.634552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:54.635230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.636411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:54.636411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.636411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.636411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:54.636411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.636411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:54.695322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:54.696152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:54.696343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:54.697589 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:54.697895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:54.698140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.699129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:54.699129 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.699129 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:54.699129 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.699129 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.699129 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:54.699129 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.699129 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:54.700213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.700213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:54.700213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:54.700213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:54.700213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.700213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:54.700213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:54.700213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.700213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:54.700213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:54.700213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:54.700213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.700845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:54.700845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:54.700845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:54.700845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:54.700845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:54.700845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:54.700845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:54.700845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:54.700845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.700845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:54.700845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.700845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.700845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:54.701525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.701525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:54.701525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.701525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:54.701525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:54.701525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:54.701525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:54.701525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:54.701525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.701525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:54.701525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:54.701525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.701525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:54.701525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:54.701525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:54.702216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.703064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:54.703064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.703064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.703064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:54.703064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.703064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:54.716733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:54.717421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:54.717733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:54.718007 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:35:54.718949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:54.719243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.720106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:54.720106 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.720106 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:54.720106 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.720106 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.720106 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:54.720106 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.720106 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:54.721352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.721352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:54.721352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:54.721352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:54.721352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.721352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:54.721352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:54.721352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:54.721352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.721352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:54.721352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:54.721352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:54.721352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:54.721352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:54.721352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:54.722050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:54.722050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:54.722050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.722050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:54.722050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.722050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.722050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:54.722050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.722050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:54.722768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.722768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:54.722768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:54.722768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:54.722768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.722768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:54.722768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:54.722768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:35:54.722768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:54.722768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:54.722768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.722768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:54.723204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:54.723204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:54.723204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.723204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:54.723204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:54.723204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:54.723204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:54.723204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:54.723204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:54.723204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:54.723204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:54.723204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.723204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:54.723204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.723643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.723643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:54.723643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.723643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:54.724506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.724506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:54.724506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:54.724506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:54.724506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:54.724506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:54.724506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.724506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:54.724506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:54.724506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.724506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:54.724506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:54.724506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.724506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:54.724506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:54.724506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:54.725042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:54.725644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.725644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:54.725644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.725644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.725644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:54.725644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.725644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:54.725644 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:54.725644 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:54.725644 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:54.725986 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:54.726085 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:54.726314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.726829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:54.726829 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.726829 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:54.726829 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.726829 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.726829 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:54.726829 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.726829 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:54.727625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.727625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:54.727625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:54.727625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:54.727625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.727625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:54.727625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:54.727625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:54.727625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.727625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:54.727625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:54.727625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:54.727625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:54.727625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:54.727625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:54.728345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:54.728345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:54.728345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.728345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:54.728345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.728345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.728345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:54.728345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.728345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:54.728976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.728976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:54.728976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:54.728976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:54.728976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.728976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:54.728976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:54.728976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:54.728976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:54.728976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.728976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:54.729570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:54.729570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:54.729570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.729570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:54.729570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:54.729570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:54.729570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:54.729570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:54.729570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:54.729570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:54.729570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:54.729570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.729570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:54.729570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:54.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:54.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.730676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:54.731172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.731712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.731712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:54.731712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.731712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:54.731712 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:54.731712 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:54.731712 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:54.731712 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:54.731953 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:54.731953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.732319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:54.732319 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.732319 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:54.732319 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.732319 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.732319 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:54.732319 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.732319 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:54.733181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.733181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:54.733181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:54.733181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:54.733181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.733181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:54.733181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:54.733181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.733181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:54.733181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:54.733181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:54.733181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.733579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:54.733579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:54.733579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:54.733579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:54.733579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:54.733579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:54.733579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:54.733579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:54.733579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.733579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:54.733579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.733579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.733579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:54.734033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.734033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:54.734120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.734120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:54.734120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:54.734120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:54.734120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:54.734120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:54.734120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.734120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:54.734120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:54.734120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.734120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:54.734120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:54.734120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.734120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:54.734120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:54.734120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:54.734604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:54.735126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:54.735126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:54.735126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:59.586842 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:59.588420 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:59.588943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:59.591266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:59.626132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:59.626605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.627356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:59.627356 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.627356 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:59.627356 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.627356 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.627356 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:59.627356 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.627356 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:59.628011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.628011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:59.628011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:59.628011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:59.628011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.628011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:59.628011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:59.628011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.628011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:59.628011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:59.628011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:59.628011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.628682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:59.628682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:59.628682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:59.628682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:59.628682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:59.628682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:59.628682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:59.628682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:59.628682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.628682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:59.628682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.628682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.628682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:59.629363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.629363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:59.629363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.629363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:59.629363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:59.629363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:59.629363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:59.629363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:59.629363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.629363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:59.629363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:59.629363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.629363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:59.629363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:59.629363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:59.630189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.630853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:59.630853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.630853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.630853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:59.630853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.630853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:59.696170 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:59.696727 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:59.696895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:59.697856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:59.698169 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:59.698396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.699229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:59.699229 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.699229 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:59.699229 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.699229 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.699229 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:59.699229 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.699229 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:59.700620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.700620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:59.700620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:59.700620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:59.700620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.700620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:59.700620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:59.700620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.700620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:59.700620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:59.700620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:59.700620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.701177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:59.701177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:59.701177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:59.701177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:59.701177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:59.701177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:59.701177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:59.701177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:59.701177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.701177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:59.701177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.701177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.701177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:59.701773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.701773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:59.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:59.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:59.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:59.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:59.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:59.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:59.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:59.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:59.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:59.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:59.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:59.702274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.702791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.703483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:59.703483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.703483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:59.717359 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:59.717779 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:59.718077 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:59.718296 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:35:59.718816 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:59.719159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.719979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:59.719979 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.719979 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:59.719979 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.719979 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.719979 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:59.719979 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.719979 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:59.721099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.721099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:59.721099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:59.721099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:59.721099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.721099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:59.721099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:59.721099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:59.721099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.721099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:59.721099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:59.721099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:59.721099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:59.721099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:59.721099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:59.721890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:59.721890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:59.721890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.721890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:59.721890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.721890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.721890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:59.721890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.721890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:59.722438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.722438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:59.722438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:59.722438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:59.722438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.722438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:59.722438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:59.722438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:35:59.722438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:59.722438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:59.722438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.722438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:59.723060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:59.723060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:59.723060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.723060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:59.723060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:59.723060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:59.723060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:59.723060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:59.723060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:59.723060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:59.723060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:59.723060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.723060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:59.723060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.723762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.723762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:59.723762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.723762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:59.723762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.723762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:59.723762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:59.723762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:59.723762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:59.723762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:59.723762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.723762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:59.723762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:59.723762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:59.724477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:59.725348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:59.725348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:59.725348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:59.725348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:59.725348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:59.725348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.725348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:59.725348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.725348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.725348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:59.725348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.725348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:59.726490 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:59.726490 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:59.726490 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:59.726490 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:59.726858 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:59.727237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.728020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:59.728020 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.728020 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:59.728020 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.728020 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.728020 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:59.728020 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.728020 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:59.728711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.728711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:35:59.728711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:59.728711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:59.728711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.728711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:59.728711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:59.728711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:59.728711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.728711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:35:59.728711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:59.728711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:35:59.728711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:59.728711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:35:59.728711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:35:59.729131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:59.729131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:35:59.729131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.729131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:35:59.729131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.729131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.729131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:35:59.729131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.729131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:35:59.729628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.729628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:59.729628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:59.729628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:59.729628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.729628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:59.729628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:59.729628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:59.729628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:59.729628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.729628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:59.729983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:59.729983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:59.729983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.729983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:59.729983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:59.729983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:59.729983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:59.729983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:59.729983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:59.729983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:59.729983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:59.729983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.729983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:59.729983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.730353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.730353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:59.730353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.730353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.730769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:59.731236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.731913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.731913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:59.731913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.731913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:35:59.731913 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:35:59.731913 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:35:59.731913 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:35:59.731913 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:35:59.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:59.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:35:59.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.732806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:35:59.732806 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.732806 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:35:59.732806 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.732806 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.732806 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:35:59.732806 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.732806 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:35:59.733637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.733637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:35:59.733637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:59.733637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:35:59.733637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.733637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:59.733637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:59.733637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.733637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:59.733637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:59.733637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:59.733637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.734047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:35:59.734047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:59.734047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:35:59.734047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:59.734047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:35:59.734047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:35:59.734047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:59.734047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:35:59.734047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.734047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:35:59.734047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.734047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.734047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:35:59.734419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.734419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:35:59.734640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.734640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:35:59.734640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:35:59.734640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:35:59.734640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:35:59.734640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:35:59.734640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.734640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:35:59.734640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:35:59.734640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.734640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:35:59.734640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:35:59.734640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.734640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:35:59.734640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:35:59.734640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:35:59.735051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:35:59.735575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:35:59.735575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:35:59.735575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:04.590967 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:04.591717 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:04.591772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:04.592772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:04.632942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:04.633143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.634519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:04.634519 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.634519 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:04.634519 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.634519 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.634519 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:04.634519 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.634519 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:04.634916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.634916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:04.634916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:04.634916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:04.634916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.634916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:04.634916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:04.634916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.634916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:04.634916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:04.634916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:04.634916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.635274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:04.635274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:04.635274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:04.635274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:04.635274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:04.635274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:04.635274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:04.635274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:04.635274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.635274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:04.635274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.635274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.635274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:04.635671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.635671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:04.635671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.635671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:04.635671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:04.635671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:04.635671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:04.635671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:04.635671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.635671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:04.635671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:04.635671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.635671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:04.635671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:04.635671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:04.636170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.636790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:04.636790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.636790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.636790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:04.636790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.636790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:04.696794 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:04.697423 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:04.697643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:04.699872 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:04.700161 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:04.700281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.701454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:04.701454 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.701454 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:04.701454 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.701454 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.701454 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:04.701454 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.701454 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:04.702884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.702884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:04.702884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:04.702884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:04.702884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.702884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:04.702884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:04.702884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.702884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:04.702884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:04.702884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:04.702884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.703289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:04.703289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:04.703289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:04.703289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:04.703289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:04.703289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:04.703289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:04.703289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:04.703289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.703289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:04.703289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.703289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.703289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:04.703708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.703708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:04.706419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.706419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:04.706419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:04.706419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:04.706419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:04.706419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:04.706419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.706419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:04.706419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:04.706419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.706419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:04.706419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:04.706419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.706419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:04.706419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:04.706419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.706839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.707321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:04.707321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.707321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:04.717946 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:04.718964 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:04.719613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:04.719847 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:36:04.721173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:04.721483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.722227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:04.722227 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.722227 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:04.722227 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.722227 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.722227 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:04.722227 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.722227 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:04.723625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.723625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:04.723625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:04.723625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:04.723625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.723625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:04.723625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:04.723625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:04.723625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.723625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:04.723625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:04.723625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:04.723625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:04.723625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:04.723625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:04.724081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:04.724081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:04.724081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.724081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:04.724081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.724081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.724081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:04.724081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.724081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:04.724767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.724767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:04.724767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:04.724767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:04.724767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.724767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:04.724767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:04.724767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:36:04.724767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:04.724767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:04.724767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.724767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:04.725119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:04.725119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:04.725119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.725119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:04.725119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:04.725119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:04.725119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:04.725119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:04.725119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:04.725119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:04.725119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:04.725119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.725119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:04.725119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.725551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.725551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:04.725551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.725551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:04.726510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.726510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:04.726510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:04.726510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:04.726510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:04.726510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:04.726510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.726510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:04.726510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:04.726510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.726510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:04.726510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:04.726510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.726510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:04.726510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:04.726510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:04.726958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:04.727466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.727466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:04.727466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.727466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.727466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:04.727466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.727466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:04.727466 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:04.727466 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:04.727466 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:04.727846 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:04.728130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:04.728589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.729402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:04.729402 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.729402 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:04.729402 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.729402 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.729402 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:04.729402 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.729402 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:04.730175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.730175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:04.730175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:04.730175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:04.730175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.730175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:04.730175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:04.730175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:04.730175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.730175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:04.730175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:04.730175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:04.730175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:04.730175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:04.730175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:04.730603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:04.730603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:04.730603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.730603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:04.730603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.730603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.730603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:04.730603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.730603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:04.731061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.731061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:04.731061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:04.731061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:04.731061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.731061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:04.731061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:04.731061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:04.731061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:04.731061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.731061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:04.731389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:04.731389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:04.731389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.731389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:04.731389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:04.731389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:04.731389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:04.731389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:04.731389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:04.731389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:04.731389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:04.731389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.731389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:04.731389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.731750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.731750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:04.731750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.731750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.732387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:04.732808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.733261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.733261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:04.733261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.733261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:04.733261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:04.733261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:04.733261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:04.733261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:04.733712 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:04.734048 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:04.734286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.735037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:04.735037 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.735037 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:04.735037 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.735037 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.735037 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:04.735037 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.735037 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:04.735845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.735845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:04.735845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:04.735845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:04.735845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.735845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:04.735845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:04.735845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.735845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:04.735845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:04.735845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:04.735845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.736193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:04.736193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:04.736193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:04.736193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:04.736193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:04.736193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:04.736193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:04.736193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:04.736193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.736193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:04.736193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.736193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.736193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:04.736550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.736550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:04.736852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.736852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:04.736852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:04.736852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:04.736852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:04.736852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:04.736852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.736852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:04.736852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:04.736852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.736852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:04.736852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:04.736852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.736852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:04.736852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:04.736852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:04.737270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:04.737760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:04.737760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:04.737760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:09.591988 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:09.592848 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:09.592848 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:09.594012 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:09.632576 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:09.632576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.632851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:09.632851 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.632851 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:09.632851 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.632851 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.632851 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:09.632851 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.632851 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:09.633354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.633354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:09.633354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:09.633354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:09.633354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.633354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:09.633354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:09.633354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.633354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:09.633354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:09.633354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:09.633354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.634137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:09.634137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:09.634137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:09.634137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:09.634137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:09.634137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:09.634137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:09.634137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:09.634137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.634137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:09.634137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.634137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.634137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:09.635066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.635066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:09.635066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.635066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:09.635066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:09.635066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:09.635066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:09.635066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:09.635066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.635066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:09.635066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:09.635066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.635066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:09.635066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:09.635066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:09.636092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.637186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:09.637186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.637186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.637186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:09.637186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.637186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:09.697720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:09.698250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:09.698490 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:09.700558 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:09.700558 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:09.700558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.700966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:09.700966 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.700966 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:09.700966 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.700966 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.700966 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:09.700966 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.700966 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:09.702211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.702211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:09.702211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:09.702211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:09.702211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.702211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:09.702211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:09.702211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.702211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:09.702211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:09.702211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:09.702211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.703222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:09.703222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:09.703222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:09.703222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:09.703222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:09.703222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:09.703222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:09.703222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:09.703222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.703222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:09.703222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.703222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.703222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:09.704155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.704155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:09.704155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.704155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:09.704155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:09.704155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:09.704155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:09.704155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:09.704155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.704155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:09.704155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:09.704155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.704155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:09.704155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:09.704155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:09.705290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.706879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:09.706879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.706879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.706879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:09.706879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.706879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:09.718590 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:09.719636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:09.719636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:09.719636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:36:09.721173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:09.721173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:09.721270 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.721270 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:09.721270 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.721270 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.721270 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:09.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.721270 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:09.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:09.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:09.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:09.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:09.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:09.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:09.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:09.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:09.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:09.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:09.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:09.722194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:09.722990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:09.722990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:09.722990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.722990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:09.722990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.722990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.722990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:09.722990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.722990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:09.723710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.723710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:09.723710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:09.723710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:09.723710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.723710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:09.723710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:09.723710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:36:09.723710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:09.723710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:09.723710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.723710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:09.725235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:09.725235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:09.725235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.725235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:09.725235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:09.725235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:09.725235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:09.725235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:09.725235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:09.725235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:09.725235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:09.725235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.725235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:09.725235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.726219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.726219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:09.726219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.726219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:09.726219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.726219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:09.726219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:09.726219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:09.726219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:09.726219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:09.726219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.726219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:09.726219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:09.726219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:09.726837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:09.727333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:09.727333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:09.727333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:09.727333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:09.727333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:09.727333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.727333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:09.727333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.727333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.727333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:09.727333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.727333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:09.727333 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:09.727706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:09.727896 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:09.728103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:09.729048 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:09.729048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.729354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:09.729354 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.729354 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:09.729354 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.729354 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.729354 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:09.729354 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.729354 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:09.730292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.730292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:09.730292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:09.730292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:09.730292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.730292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:09.730292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:09.730292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:09.730292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.730292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:09.730292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:09.730292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:09.730292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:09.730292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:09.730292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:09.730756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:09.730756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:09.730756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.730756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:09.730756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.730756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.730756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:09.730756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.730756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:09.731195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.731195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:09.731195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:09.731195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:09.731195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.731195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:09.731195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:09.731195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:09.731195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:09.731195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.731195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:09.731575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:09.731575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:09.731575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.731575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:09.731575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:09.731575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:09.731575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:09.731575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:09.731575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:09.731575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:09.731575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:09.731575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.731575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:09.731575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.731936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.731936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:09.731936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.731936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.732248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:09.732704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.733254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.733254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:09.733254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.733254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:09.733254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:09.733438 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:09.733511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:09.733671 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:09.734005 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:09.734334 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:09.734617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.735228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:09.735228 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.735228 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:09.735228 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.735228 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.735228 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:09.735228 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.735228 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:09.736065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.736065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:09.736065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:09.736065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:09.736065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.736065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:09.736065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:09.736065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.736065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:09.736065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:09.736065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:09.736065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.736477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:09.736477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:09.736477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:09.736477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:09.736477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:09.736477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:09.736477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:09.736477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:09.736477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.736477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:09.736477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.736477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.736477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:09.736809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.736809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:09.737053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.737053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:09.737053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:09.737053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:09.737053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:09.737053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:09.737053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.737053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:09.737053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:09.737053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.737053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:09.737053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:09.737053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.737053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:09.737053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:09.737053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:09.737546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:09.738075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:09.738075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:09.738075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:14.592765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:14.593888 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:14.593888 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:14.594108 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:14.637165 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:14.637496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.638502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:14.638502 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.638502 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:14.638502 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.638502 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.638502 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:14.638502 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.638502 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:14.639557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.045 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.639557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:14.639557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:14.639557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:14.639557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.639557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:14.639557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:14.639557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.639557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:14.639557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:14.639557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:14.639557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.640151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:14.640151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:14.640151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:14.640151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:14.640151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:14.640151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:14.640151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:14.640151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:14.640151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.640151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:14.640151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.640151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.640151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:14.640771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.640771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:14.640771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.640771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:14.640771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:14.640771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:14.640771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:14.640771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:14.640771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.640771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:14.640771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:14.640771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.640771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:14.640771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:14.640771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:14.641630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.642727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:14.642727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.642727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.642727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:14.642727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.642727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:14.698579 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:14.699242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:14.699472 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:14.700404 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:14.700835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:14.701127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.701716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:14.701716 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.701716 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:14.701716 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.701716 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.701716 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:14.701716 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.701716 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:14.702680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.702680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:14.702680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:14.702680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:14.702680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.702680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:14.702680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:14.702680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.702680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:14.702680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:14.702680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:14.702680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.703018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:14.703018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:14.703018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:14.703018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:14.703018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:14.703018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:14.703018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:14.703018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:14.703018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.703018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:14.703018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.703018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.703018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:14.703575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.703575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:14.703869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.703869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:14.703869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:14.703869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:14.703869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:14.703869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:14.703869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.703869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:14.703869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:14.703869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.703869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:14.703869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:14.703869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.703869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:14.703869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:14.703869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.704645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.705548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:14.705548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.705548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:14.719097 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:14.719491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:14.719690 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:14.719886 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:36:14.720406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:14.720775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.721608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:14.721608 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.721608 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:14.721608 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.721608 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.721608 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:14.721608 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.721608 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:14.722915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.722915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:14.722915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:14.722915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:14.722915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.722915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:14.722915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:14.722915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:14.722915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.722915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:14.722915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:14.722915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:14.722915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:14.722915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:14.722915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:14.723387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:14.723387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:14.723387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.723387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:14.723387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.723387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.723387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:14.723387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.723387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:14.724537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.724537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:14.724537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:14.724537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:14.724537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.724537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:14.724537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:14.724537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:36:14.724537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:14.724537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:14.724537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.724537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:14.724899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:14.724899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:14.724899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.724899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:14.724899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:14.724899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:14.724899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:14.724899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:14.724899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:14.724899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:14.724899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:14.724899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.724899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:14.724899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.725285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.725285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:14.725285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.725285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:14.726462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.726462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:14.726462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:14.726462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:14.726462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:14.726462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:14.726462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.726462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:14.726462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:14.726462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.726462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:14.726462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:14.726462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.726462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:14.726462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:14.726462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:14.726976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:14.727497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.727497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:14.727497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.727497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.727497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:14.727497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.727497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:14.727690 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:14.727959 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:14.728066 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:14.728178 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:14.728511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:14.728740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.729204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:14.729204 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.729204 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:14.729204 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.729204 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.729204 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:14.729204 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.729204 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:14.729960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.729960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:14.729960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:14.729960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:14.729960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.729960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:14.729960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:14.729960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:14.729960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.729960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:14.729960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:14.729960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:14.729960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:14.729960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:14.729960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:14.730439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:14.730439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:14.730439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.730439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:14.730439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.730439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.730439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:14.730439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.730439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:14.730880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.730880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:14.730880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:14.730880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:14.730880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.730880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:14.730880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:14.730880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:14.730880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:14.730880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.730880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:14.731276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:14.731276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:14.731276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.731276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:14.731276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:14.731276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:14.731276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:14.731276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:14.731276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:14.731276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:14.731276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:14.731276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.731276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:14.731276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.731686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.731686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:14.731686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.731686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.731922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:14.732666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.733312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.733312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:14.733312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.733312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:14.733487 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:14.733784 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:14.733891 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:14.734039 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:14.734303 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:14.734588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:14.734761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.735424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:14.735424 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.735424 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:14.735424 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.735424 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.735424 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:14.735424 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.735424 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:14.736191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.736191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:14.736191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:14.736191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:14.736191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.736191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:14.736191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:14.736191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.736191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:14.736191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:14.736191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:14.736191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.736582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:14.736582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:14.736582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:14.736582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:14.736582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:14.736582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:14.736582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:14.736582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:14.736582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.736582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:14.736582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.736582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.736582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:14.736938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.736938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:14.737195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.737195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:14.737195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:14.737195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:14.737195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:14.737195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:14.737195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.737195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:14.737195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:14.737195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.737195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:14.737195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:14.737195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.737195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:14.737195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:14.737195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:14.737715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:14.738223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:14.738223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:14.738223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:19.593331 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:19.594104 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:19.594104 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:19.594952 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:19.629069 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:19.629542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.630525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:19.630525 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.630525 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:19.630525 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.630525 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.630525 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:19.630525 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.630525 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:19.631796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.631796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:19.631796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:19.631796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:19.631796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.631796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:19.631796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:19.631796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.631796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:19.631796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:19.631796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:19.631796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.632540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:19.632540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:19.632540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:19.632540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:19.632540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:19.632540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:19.632540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:19.632540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:19.632540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.632540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:19.632540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.632540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.632540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:19.633222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.633222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:19.633222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.633222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:19.633222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:19.633222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:19.633222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:19.633222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:19.633222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.633222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:19.633222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:19.633222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.633222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:19.633222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:19.633222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:19.634020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.635010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:19.635010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.635010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.635010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:19.635010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.635010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:19.699249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:19.699907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:19.700098 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:19.701249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:19.701654 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:19.701911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.702960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:19.702960 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.702960 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:19.702960 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.702960 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.702960 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:19.702960 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.702960 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:19.704563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.704563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:19.704563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:19.704563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:19.704563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.704563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:19.704563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:19.704563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.704563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:19.704563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:19.704563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:19.704563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.704928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:19.704928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:19.704928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:19.704928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:19.704928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:19.704928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:19.704928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:19.704928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:19.704928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.704928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:19.704928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.704928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.704928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:19.705306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.705306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:19.706579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.706579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:19.706579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:19.706579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:19.706579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:19.706579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:19.706579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.706579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:19.706579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:19.706579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.706579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:19.706579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:19.706579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.706579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:19.706579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:19.706579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.707617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.708792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:19.708792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.708792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:19.719672 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:19.720147 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:19.720342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:19.720568 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:36:19.721303 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:19.721801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.722927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:19.722927 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.722927 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:19.722927 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.722927 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.722927 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:19.722927 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.722927 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:19.724249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.724249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:19.724249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:19.724249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:19.724249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.724249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:19.724249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:19.724249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:19.724249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.724249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:19.724249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:19.724249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:19.724249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:19.724249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:19.724249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:19.725113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:19.725113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:19.725113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.725113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:19.725113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.725113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.725113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:19.725113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.725113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:19.725772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.725772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:19.725772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:19.725772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:19.725772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.725772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:19.725772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:19.725772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:36:19.725772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:19.725772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:19.725772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.725772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:19.726604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:19.726604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:19.726604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.726604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:19.726604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:19.726604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:19.726604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:19.726604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:19.726604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:19.726604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:19.726604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:19.726604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.726604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:19.726604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.727239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.727239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:19.727239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.727239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:19.727239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.727239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:19.727239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:19.727239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:19.727239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:19.727239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:19.727239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.727239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:19.727239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:19.727239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:19.728034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:19.728997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:19.728997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:19.728997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:19.728997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:19.728997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:19.728997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.728997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:19.728997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.728997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.728997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:19.728997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.728997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:19.728997 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:19.728997 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:19.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:19.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:19.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:19.729793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.730657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:19.730657 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.730657 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:19.730657 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.730657 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.730657 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:19.730657 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.730657 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:19.731341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.731341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:19.731341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:19.731341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:19.731341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.731341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:19.731341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:19.731341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:19.731341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.731341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:19.731341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:19.731341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:19.731341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:19.731341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:19.731341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:19.731915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:19.731915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:19.731915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.731915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:19.731915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.731915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.731915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:19.731915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.731915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:19.732215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.732215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:19.732215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:19.732215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:19.732215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.732215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:19.732215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:19.732215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:19.732215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:19.732215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.732215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:19.732564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:19.732564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:19.732564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.732564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:19.732564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:19.732564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:19.732564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:19.732564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:19.732564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:19.732564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:19.732564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:19.732564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.732564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:19.732564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.732922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.732922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:19.732922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.732922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.733390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:19.733956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.734585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.734585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:19.734585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.734585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:19.734585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:19.734585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:19.734585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:19.734585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:19.734855 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:19.735131 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:19.735286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.735784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:19.735784 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.735784 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:19.735784 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.735784 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.735784 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:19.735784 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.735784 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:19.736598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.736598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:19.736598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:19.736598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:19.736598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.736598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:19.736598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:19.736598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.736598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:19.736598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:19.736598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:19.736598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.736970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:19.736970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:19.736970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:19.736970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:19.736970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:19.736970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:19.736970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:19.736970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:19.736970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.736970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:19.736970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.736970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.736970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:19.737416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.737416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:19.737538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.737538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:19.737538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:19.737538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:19.737538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:19.737538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:19.737538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.737538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:19.737538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:19.737538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.737538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:19.737538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:19.737538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.737538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:19.737538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:19.737538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:19.737965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:19.738603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:19.738603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:19.738603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:24.594268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:24.594917 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:24.595550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:24.596508 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:24.628649 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:24.629065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.629998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:24.629998 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.629998 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:24.629998 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.629998 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.629998 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:24.629998 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.629998 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:24.630799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.630799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:24.630799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:24.630799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:24.630799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.630799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:24.630799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:24.630799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.630799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:24.630799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:24.630799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:24.630799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.631553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:24.631553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:24.631553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:24.631553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:24.631553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:24.631553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:24.631553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:24.631553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:24.631553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.631553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:24.631553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.631553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.631553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:24.632201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.632201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:24.632201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.632201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:24.632201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:24.632201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:24.632201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:24.632201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:24.632201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.632201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:24.632201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:24.632201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.632201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:24.632201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:24.632201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:24.633010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.633944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:24.633944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.633944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.633944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:24.633944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.633944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:24.700147 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:24.701302 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:24.701302 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:24.702653 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:24.703088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:24.703429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.704423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:24.704423 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.704423 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:24.704423 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.704423 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.704423 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:24.704423 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.704423 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:24.705944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.705944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:24.705944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:24.705944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:24.705944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.705944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:24.705944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:24.705944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.705944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:24.705944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:24.705944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:24.705944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.706706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:24.706706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:24.706706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:24.706706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:24.706706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:24.706706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:24.706706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:24.706706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:24.706706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.706706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:24.706706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.706706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.706706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:24.707173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.707173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:24.707825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.707825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:24.707825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:24.707825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:24.707825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:24.707825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:24.707825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.707825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:24.707825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:24.707825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.707825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:24.707825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:24.707825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.707825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:24.707825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:24.707825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.708492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.709153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:24.709153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.709153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:24.720192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:24.720463 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:24.720563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:24.720698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:36:24.721316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:24.721575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.722356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:24.722356 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.722356 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:24.722356 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.722356 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.722356 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:24.722356 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.722356 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:24.723521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.723521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:24.723521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:24.723521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:24.723521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.723521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:24.723521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:24.723521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:24.723521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.723521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:24.723521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:24.723521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:24.723521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:24.723521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:24.723521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:24.724206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:24.724206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:24.724206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.724206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:24.724206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.724206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.724206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:24.724206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.724206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:24.724930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.724930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:24.724930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:24.724930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:24.724930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.724930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:24.724930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:24.724930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:36:24.724930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:24.724930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:24.724930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.724930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:24.725460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:24.725460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:24.725460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.725460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:24.725460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:24.725460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:24.725460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:24.725460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:24.725460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:24.725460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:24.725460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:24.725460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.725460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:24.725460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.725957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.725957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:24.725957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.725957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:24.726655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.726655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:24.726655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:24.726655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:24.726655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:24.726655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:24.726655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.726655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:24.726655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:24.726655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.726655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:24.726655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:24.726655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.726655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:24.726655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:24.726655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:24.727116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:24.727628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.727628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:24.727628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.727628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.727628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:24.727628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.727628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:24.728826 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:24.729227 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:24.729436 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:24.729629 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:24.730114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:24.730510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.731163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:24.731163 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.731163 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:24.731163 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.731163 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.731163 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:24.731163 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.731163 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:24.731921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.731921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:24.731921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:24.731921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:24.731921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.731921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:24.731921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:24.731921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:24.731921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.731921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:24.731921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:24.731921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:24.731921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:24.731921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:24.731921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:24.732480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:24.732480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:24.732480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.732480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:24.732480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.732480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.732480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:24.732480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.732480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:24.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:24.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:24.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:24.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:24.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:24.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:24.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:24.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:24.733229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:24.733229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:24.733229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.733229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:24.733229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:24.733229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:24.733229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:24.733229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:24.733229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:24.733229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:24.733229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:24.733229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.733229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:24.733229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.733744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.733744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:24.733744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.733744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.733923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:24.734635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.735309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.735309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:24.735309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.735309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:24.735309 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:24.735309 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:24.735309 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:24.735309 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:24.735660 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:24.735716 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:24.735974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.736792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:24.736792 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.736792 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:24.736792 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.736792 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.736792 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:24.736792 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.736792 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:24.737614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.737614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:24.737614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:24.737614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:24.737614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.737614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:24.737614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:24.737614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.737614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:24.737614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:24.737614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:24.737614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.738102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:24.738102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:24.738102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:24.738102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:24.738102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:24.738102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:24.738102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:24.738102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:24.738102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.738102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:24.738102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.738102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.738102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:24.738595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.738595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:24.738595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.738595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:24.738595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:24.738595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:24.738595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:24.738595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:24.738595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.738595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:24.738595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:24.738595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.738595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:24.738595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:24.738595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:24.739138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:24.739869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:24.739869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:24.739869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:24.739869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:24.739869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:24.739869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:29.594977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:29.595876 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:29.595876 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:29.596518 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:29.635621 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:29.636174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.637027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:29.637027 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.637027 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:29.637027 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.637027 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.637027 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:29.637027 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.637027 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:29.638250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.638250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:29.638250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:29.638250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:29.638250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.638250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:29.638250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:29.638250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.638250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:29.638250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:29.638250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:29.638250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.639043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:29.639043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:29.639043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:29.639043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:29.639043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:29.639043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:29.639043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:29.639043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:29.639043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.639043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:29.639043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.639043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.639043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:29.639858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.639858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:29.639858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.639858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:29.639858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:29.639858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:29.639858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:29.639858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:29.639858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.639858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:29.639858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:29.639858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.639858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:29.639858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:29.639858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:29.640770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.641749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:29.641749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.641749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.641749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:29.641749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.641749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:29.700917 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:29.701433 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:29.701612 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:29.703026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:29.703361 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:29.703596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.704450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:29.704450 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.704450 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:29.704450 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.704450 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.704450 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:29.704450 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.704450 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:29.705527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.705527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:29.705527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:29.705527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:29.705527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.705527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:29.705527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:29.705527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.705527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:29.705527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:29.705527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:29.705527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.706258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:29.706258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:29.706258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:29.706258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:29.706258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:29.706258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:29.706258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:29.706258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:29.706258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.706258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:29.706258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.706258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.706258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:29.707054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.707054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:29.707054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.707054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:29.707054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:29.707054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:29.707054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:29.707054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:29.707054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.707054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:29.707054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:29.707054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.707054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:29.707054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:29.707054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:29.707876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.708963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:29.708963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.708963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.708963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:29.708963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.708963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:29.720747 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:29.721228 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:29.721423 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:29.721646 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:36:29.722120 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:29.722349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.723022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:29.723022 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.723022 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:29.723022 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.723022 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.723022 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:29.723022 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.723022 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:29.724396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.724396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:29.724396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:29.724396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:29.724396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.724396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:29.724396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:29.724396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:29.724396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.724396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:29.724396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:29.724396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:29.724396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:29.724396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:29.724396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:29.725213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:29.725213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:29.725213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.725213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:29.725213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.725213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.725213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:29.725213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.725213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:29.725701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.725701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:29.725701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:29.725701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:29.725701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.725701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:29.725701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:29.725701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:36:29.725701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:29.725701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:29.725701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.725701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:29.726322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:29.726322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:29.726322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.726322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:29.726322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:29.726322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:29.726322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:29.726322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:29.726322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:29.726322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:29.726322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:29.726322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.726322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:29.726322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.726975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.726975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:29.726975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.726975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:29.726975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.726975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:29.726975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:29.726975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:29.726975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:29.726975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:29.726975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.726975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:29.726975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:29.726975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:29.727679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:29.729092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:29.729092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:29.729092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:29.729092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:29.729092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:29.729092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.729092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:29.729092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.729092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.729092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:29.729092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.729092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:29.729651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:29.729651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:29.729798 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:29.729867 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:29.730230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:29.730495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.731013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:29.731013 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.731013 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:29.731013 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.731013 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.731013 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:29.731013 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.731013 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:29.731775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.731775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:29.731775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:29.731775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:29.731775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.731775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:29.731775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:29.731775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:29.731775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.731775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:29.731775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:29.731775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:29.731775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:29.731775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:29.731775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:29.732580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:29.732580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:29.732580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.732580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:29.732580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.732580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.732580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:29.732580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.732580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:29.732954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.732954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:29.732954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:29.732954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:29.732954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.732954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:29.732954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:29.732954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:29.732954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:29.732954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.732954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:29.733202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:29.733202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:29.733202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.733202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:29.733202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:29.733202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:29.733202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:29.733202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:29.733202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:29.733202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:29.733202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:29.733202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.733202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:29.733202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.733512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.733512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:29.733512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.733512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.733908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:29.734279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.734667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.734667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:29.734667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.734667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:29.734791 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:29.734993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:29.735128 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:29.735295 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:29.735680 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:29.735899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:29.736049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.736707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:29.736707 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.736707 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:29.736707 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.736707 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.736707 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:29.736707 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.736707 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:29.737660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.737660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:29.737660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:29.737660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:29.737660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.737660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:29.737660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:29.737660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.737660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:29.737660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:29.737660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:29.737660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.737956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:29.737956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:29.737956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:29.737956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:29.737956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:29.737956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:29.737956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:29.737956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:29.737956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.737956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:29.737956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.737956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.737956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:29.738211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.738211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:29.738662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.738662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:29.738662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:29.738662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:29.738662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:29.738662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:29.738662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.738662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:29.738662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:29.738662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.738662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:29.738662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:29.738662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.738662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:29.738662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:29.738662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:29.739042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:29.739455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:29.739455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:29.739455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:34.596132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:34.596748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:34.596748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:34.597420 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:34.625529 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:34.625928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.628559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:34.628559 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.628559 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:34.628559 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.628559 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.628559 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:34.628559 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.628559 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:34.628559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.030 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.628559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:34.628559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:34.628559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:34.628559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.628559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:34.628559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:34.629598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.629598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:34.629598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:34.629598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:34.629598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.629598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:34.629598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:34.629598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:34.629598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:34.629598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:34.629598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:34.629598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:34.629598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:34.629598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.630480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:34.630480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.630480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.630480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:34.630480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.630480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:34.630480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.630480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:34.630480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:34.630480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:34.630480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:34.630480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:34.630480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.630480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:34.631150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:34.632323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:34.632323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:34.632323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.632323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:34.632323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.632323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.632323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:34.632323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.632323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:34.701553 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:34.701880 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:34.702002 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:34.703058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:34.703513 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:34.703807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.704860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:34.704860 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.704860 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:34.704860 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.704860 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.704860 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:34.704860 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.704860 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:34.705842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.705842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:34.705842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:34.705842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:34.705842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.705842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:34.705842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:34.705842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.705842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:34.705842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:34.705842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:34.705842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.706162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:34.706162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:34.706162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:34.706162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:34.706162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:34.706162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:34.706162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:34.706162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:34.706162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.706162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:34.706162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.706162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.706162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:34.706533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.706533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:34.706853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.706853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:34.706853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:34.706853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:34.706853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:34.706853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:34.706853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.706853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:34.706853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:34.706853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.706853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:34.706853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:34.706853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.706853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:34.706853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:34.706853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.707242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.707743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:34.707743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.707743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:34.721252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:34.721678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:34.721855 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:34.722036 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:36:34.722773 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:34.723135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.724044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:34.724044 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.724044 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:34.724044 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.724044 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.724044 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:34.724044 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.724044 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:34.725289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.725289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:34.725289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:34.725289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:34.725289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.725289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:34.725289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:34.725289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:34.725289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.725289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:34.725289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:34.725289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:34.725289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:34.725289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:34.725289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:34.726192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:34.726192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:34.726192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.726192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:34.726192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.726192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.726192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:34.726192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.726192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:34.726783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.726783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:34.726783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:34.726783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:34.726783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.726783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:34.726783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:34.726783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:36:34.726783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:34.726783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:34.726783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.726783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:34.727481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:34.727481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:34.727481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.727481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:34.727481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:34.727481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:34.727481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:34.727481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:34.727481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:34.727481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:34.727481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:34.727481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.727481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:34.727481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.728167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.728167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:34.728167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.728167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:34.728476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.728476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:34.728476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:34.728476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:34.728476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:34.728476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:34.728476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.728476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:34.728476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:34.728476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.728476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:34.728476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:34.728476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.728476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:34.728476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:34.728476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:34.729485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:34.730214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.730214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:34.730214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.730214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.730214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:34.730214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.730214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:34.730214 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:34.730214 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:34.730641 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:34.730641 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:34.731125 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:34.731506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.732280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:34.732280 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.732280 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:34.732280 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.732280 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.732280 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:34.732280 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.732280 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:34.733629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.733629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:34.733629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:34.733629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:34.733629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.733629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:34.733629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:34.733629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:34.733629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.733629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:34.733629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:34.733629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:34.733629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:34.733629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:34.733629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:34.733918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:34.733918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:34.733918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.733918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:34.733918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.733918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.733918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:34.733918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.733918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:34.735145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.735145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:34.735145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:34.735145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:34.735145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.735145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:34.735145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:34.735145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:34.735145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:34.735145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.735145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:34.735409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:34.735409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:34.735409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.735409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:34.735409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:34.735409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:34.735409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:34.735409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:34.735409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:34.735409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:34.735409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:34.735409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.735409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:34.735409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.735719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.735719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:34.735719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.735719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:34.735719 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.736983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:34.737411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.737751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.737751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:34.737751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.737751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:34.737751 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:34.737751 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:34.737751 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:34.737751 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:34.737990 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:34.738143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.739064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:34.739064 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.739064 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:34.739064 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.739064 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.739064 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:34.739064 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.739064 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:34.739983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.739983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:34.739983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:34.739983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:34.739983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.739983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:34.739983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:34.739983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.739983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:34.739983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:34.739983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:34.739983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.740351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:34.740351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:34.740351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:34.740351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:34.740351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:34.740351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:34.740351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:34.740351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:34.740351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.740351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:34.740351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.740351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.740351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:34.740731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.740731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:34.740954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.740954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:34.740954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:34.740954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:34.740954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:34.740954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:34.740954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.740954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:34.740954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:34.740954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.740954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:34.740954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:34.740954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.740954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:34.740954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:34.740954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:34.741393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:34.741895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:34.741895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:34.741895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:39.596808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:39.597791 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:39.597791 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:39.598962 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:39.632482 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:39.632767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.633562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:39.633562 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.633562 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:39.633562 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.633562 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.633562 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:39.633562 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.633562 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:39.634357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.634357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:39.634357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:39.634357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:39.634357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.634357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:39.634357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:39.634357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.634357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:39.634357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:39.634357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:39.634357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.634945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:39.634945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:39.634945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:39.634945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:39.634945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:39.634945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:39.634945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:39.634945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:39.634945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.634945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:39.634945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.634945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.634945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:39.635552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.635552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:39.635552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.635552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:39.635552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:39.635552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:39.635552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:39.635552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:39.635552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.635552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:39.635552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:39.635552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.635552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:39.635552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:39.635552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:39.636398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.638516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:39.638516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.638516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.638516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:39.638516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.638516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:39.702187 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:39.702756 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:39.702894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:39.703805 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:39.704158 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:39.704481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.706165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:39.706165 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.706165 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:39.706165 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.706165 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.706165 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:39.706165 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.706165 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:39.707786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.707786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:39.707786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:39.707786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:39.707786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.707786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:39.707786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:39.707786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.707786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:39.707786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:39.707786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:39.707786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.708459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:39.708459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:39.708459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:39.708459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:39.708459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:39.708459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:39.708459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:39.708459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:39.708459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.708459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:39.708459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.708459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.708459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:39.709118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.709118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:39.709118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.709118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:39.709118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:39.709118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:39.709118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:39.709118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:39.709118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.709118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:39.709118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:39.709118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.709118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:39.709118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:39.709118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:39.709782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.710245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:39.710245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.710245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.710245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:39.710245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.710245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:39.722875 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:39.723189 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:39.723331 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:39.723474 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:36:39.723757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:39.723954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.724454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:39.724454 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.724454 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:39.724454 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.724454 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.724454 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:39.724454 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.724454 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:39.725278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.725278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:39.725278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:39.725278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:39.725278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.725278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:39.725278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:39.725278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:39.725278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.725278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:39.725278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:39.725278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:39.725278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:39.725278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:39.725278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:39.726926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:39.726926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:39.726926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.726926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:39.726926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.726926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.726926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:39.726926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.726926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:39.726926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.726926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:39.726926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:39.726926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:39.726926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.728647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:39.728647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:39.728647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:36:39.728647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:39.728647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:39.728647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.728647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:39.728647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:39.728647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:39.728647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.728647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:39.728647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:39.728647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:39.729345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:39.729345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:39.729345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:39.729345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:39.729345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:39.729345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.729345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:39.729345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.729345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.729345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:39.729345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.729345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:39.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:39.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:39.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:39.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:39.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:39.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:39.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:39.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:39.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:39.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:39.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:39.729828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:39.730240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:39.730745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.730745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:39.730745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.730745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.730745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:39.730745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.730745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:39.730745 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:39.730745 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:39.730745 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:39.731044 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:39.731258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:39.731647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.732397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:39.732397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.732397 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:39.732397 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.732397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.732397 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:39.732397 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.732397 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:39.733389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.733389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:39.733389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:39.733389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:39.733389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.733389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:39.733389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:39.733389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:39.733389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.733389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:39.733389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:39.733389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:39.733389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:39.733389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:39.733389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:39.733849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:39.733849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:39.733849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.733849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:39.733849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.733849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.733849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:39.733849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.733849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:39.734393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.734393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:39.734393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:39.734393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:39.734393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.734393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:39.734393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:39.734393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:39.734393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:39.734393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.734393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:39.734794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:39.734794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:39.734794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.734794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:39.734794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:39.734794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:39.734794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:39.734794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:39.734794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:39.734794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:39.734794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:39.734794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.734794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:39.734794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.735255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.735255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:39.735255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.735255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.735753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:39.736269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.736902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.736902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:39.736902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.736902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:39.737382 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:39.737751 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:39.737901 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:39.738086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:39.738439 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:39.738682 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:39.738856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.739449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:39.739449 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.739449 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:39.739449 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.739449 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.739449 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:39.739449 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.739449 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:39.740451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.740451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:39.740451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:39.740451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:39.740451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.740451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:39.740451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:39.740451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.740451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:39.740451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:39.740451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:39.740451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.740873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:39.740873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:39.740873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:39.740873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:39.740873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:39.740873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:39.740873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:39.740873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:39.740873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.740873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:39.740873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.740873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.740873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:39.741325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.741325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:39.741760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.741760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:39.741760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:39.741760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:39.741760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:39.741760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:39.741760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.741760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:39.741760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:39.741760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.741760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:39.741760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:39.741760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.741760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:39.741760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:39.741760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:39.742339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:39.742995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:39.742995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:39.742995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:44.597476 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:44.598134 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:44.598255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:44.599587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:44.627875 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:44.628152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.629076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:44.629076 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.629076 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:44.629076 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.629076 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.629076 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:44.629076 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.629076 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:44.629845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.031 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.629845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:44.629845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:44.629845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:44.629845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.629845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:44.629845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:44.629845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.629845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:44.629845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:44.629845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:44.629845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.630505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:44.630505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:44.630505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:44.630505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:44.630505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:44.630505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:44.630505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:44.630505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:44.630505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.630505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:44.630505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.630505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.630505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:44.631127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.631127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:44.631127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.631127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:44.631127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:44.631127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:44.631127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:44.631127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:44.631127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.631127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:44.631127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:44.631127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.631127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:44.631127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:44.631127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:44.631904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.632975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:44.632975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.632975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.632975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:44.632975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.632975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:44.702703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:44.703249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:44.703490 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:44.704384 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:44.704783 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:44.705004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.705858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:44.705858 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.705858 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:44.705858 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.705858 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.705858 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:44.705858 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.705858 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:44.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:44.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:44.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:44.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:44.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:44.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:44.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:44.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:44.707402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.708016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:44.708016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:44.708016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:44.708016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:44.708016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:44.708016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:44.708016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:44.708016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:44.708016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.708016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:44.708016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.708016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.708016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:44.708724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.708724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:44.709471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.709471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:44.709471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:44.709471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:44.709471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:44.709471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:44.709471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.709471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:44.709471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:44.709471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.709471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:44.709471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:44.709471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.709471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:44.709471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:44.709471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.710042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.710613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:44.710613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.710613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:44.723711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:44.724119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:44.724226 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:44.724311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:36:44.724960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:44.725253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.726487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:44.726487 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.726487 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:44.726487 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.726487 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.726487 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:44.726487 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.726487 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:44.727751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.727751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:44.727751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:44.727751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:44.727751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.727751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:44.727751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:44.727751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:44.727751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.727751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:44.727751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:44.727751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:44.727751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:44.727751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:44.727751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:44.728656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:44.728656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:44.728656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.728656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:44.728656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.728656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.728656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:44.728656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.728656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:44.729295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.729295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:44.729295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:44.729295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:44.729295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.729295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:44.729295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:44.729295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:36:44.729295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:44.729295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:44.729295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.729295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:44.729892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:44.729892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:44.729892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.729892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:44.729892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:44.729892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:44.729892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:44.729892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:44.729892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:44.729892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:44.729892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:44.729892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.729892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:44.729892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.730508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.730508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:44.730508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.730508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:44.731138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.731138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:44.731138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:44.731138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:44.731138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:44.731138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:44.731138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.731138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:44.731138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:44.731138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.731138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:44.731138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:44.731138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.731138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:44.731138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:44.731138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:44.731802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:44.732905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.732905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:44.732905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.732905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.732905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:44.732905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.732905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:44.732905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:44.732905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:44.732905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:44.733674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:44.733674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:44.733674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.734237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:44.734237 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.734237 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:44.734237 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.734237 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.734237 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:44.734237 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.734237 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:44.734952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.734952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:44.734952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:44.734952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:44.734952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.734952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:44.734952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:44.734952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:44.734952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.734952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:44.734952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:44.734952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:44.734952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:44.734952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:44.734952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:44.735443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:44.735443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:44.735443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.735443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:44.735443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.735443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.735443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:44.735443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.735443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:44.735808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.735808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:44.735808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:44.735808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:44.735808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.735808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:44.735808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:44.735808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:44.735808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:44.735808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.735808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:44.736120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:44.736120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:44.736120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.736120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:44.736120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:44.736120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:44.736120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:44.736120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:44.736120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:44.736120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:44.736120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:44.736120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.736120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:44.736120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.736508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.736508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:44.736508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.736508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.736965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:44.737446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.737938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.737938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:44.737938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.737938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:44.737938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:44.738114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:44.738215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:44.738431 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:44.738783 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:44.739043 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:44.739226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.739796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:44.739796 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.739796 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:44.739796 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.739796 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.739796 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:44.739796 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.739796 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:44.740662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.740662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:44.740662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:44.740662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:44.740662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.740662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:44.740662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:44.740662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.740662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:44.740662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:44.740662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:44.740662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.741009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:44.741009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:44.741009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:44.741009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:44.741009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:44.741009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:44.741009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:44.741009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:44.741009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.741009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:44.741009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.741009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.741009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:44.741349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.741349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:44.741734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.741734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:44.741734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:44.741734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:44.741734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:44.741734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:44.741734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.741734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:44.741734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:44.741734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.741734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:44.741734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:44.741734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.741734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:44.741734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:44.741734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:44.742152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:44.742654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:44.742654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:44.742654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:49.598126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:49.599797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:49.599957 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:49.601145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:49.638941 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:49.639466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.640341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:49.640341 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.640341 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:49.640341 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.640341 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.640341 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:49.640341 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.640341 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:49.642547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.642547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:49.642547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:49.642547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:49.642547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.642547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:49.642547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:49.642547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.642547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:49.642547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:49.642547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:49.642547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.643278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:49.643278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:49.643278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:49.643278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:49.643278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:49.643278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:49.643278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:49.643278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:49.643278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.643278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:49.643278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.643278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.643278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:49.644007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.644007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:49.644007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.644007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:49.644007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:49.644007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:49.644007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:49.644007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:49.644007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.644007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:49.644007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:49.644007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.644007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:49.644007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:49.644007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:49.644808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.645855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:49.645855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.645855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.645855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:49.645855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.645855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:49.703317 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:49.703878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:49.704096 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:49.705109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:49.705682 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:49.705889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.706563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:49.706563 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.706563 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:49.706563 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.706563 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.706563 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:49.706563 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.706563 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:49.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:49.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:49.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:49.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:49.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:49.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:49.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:49.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:49.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.709206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:49.709206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:49.709206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:49.709206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:49.709206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:49.709206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:49.709206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:49.709206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:49.709206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.709206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:49.709206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.709206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.709206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:49.709841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.709841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:49.710705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.710705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:49.710705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:49.710705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:49.710705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:49.710705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:49.710705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.710705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:49.710705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:49.710705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.710705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:49.710705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:49.710705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.710705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:49.710705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:49.710705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.711577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.712500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:49.712500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.712500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:49.724210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:49.724946 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:49.725132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:49.725321 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:36:49.725851 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:49.726064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.726874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:49.726874 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.726874 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:49.726874 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.726874 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.726874 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:49.726874 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.726874 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:49.728193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.728193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:49.728193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:49.728193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:49.728193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.728193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:49.728193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:49.728193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:49.728193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.728193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:49.728193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:49.728193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:49.728193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:49.728193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:49.728193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:49.729088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:49.729088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:49.729088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.729088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:49.729088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.729088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.729088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:49.729088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.729088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:49.729088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.729088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:49.729088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:49.729088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:49.729088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.729810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:49.729810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:49.729810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:36:49.729810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:49.729810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:49.729810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.729810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:49.729810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:49.729810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:49.729810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.729810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:49.729810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:49.729810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:49.730422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:49.730422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:49.730422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:49.730422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:49.730422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:49.730422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.730422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:49.730422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.730422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.730422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:49.730422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.730422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:49.730980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.730980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:49.730980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:49.730980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:49.730980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:49.730980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:49.730980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.730980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:49.730980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:49.730980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.730980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:49.730980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:49.730980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.730980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:49.730980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:49.730980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:49.731910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:49.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:49.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:49.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:49.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:49.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:49.732836 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:49.733548 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:49.734012 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:49.734165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:49.734688 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.734688 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:49.734688 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.734688 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.734688 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:49.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:49.735469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.735469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:49.735469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:49.735469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:49.735469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.735469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:49.735469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:49.735469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:49.735469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.735469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:49.735469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:49.735469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:49.735469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:49.735469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:49.735469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:49.735987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:49.735987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:49.735987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.735987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:49.735987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.735987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.735987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:49.735987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.735987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:49.736479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.736479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:49.736479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:49.736479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:49.736479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.736479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:49.736479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:49.736479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:49.736479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:49.736479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.736479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:49.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:49.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:49.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:49.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:49.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:49.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:49.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:49.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:49.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:49.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:49.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:49.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.738197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.738197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:49.738197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.738197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:49.738197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.738197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:49.738197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:49.738197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:49.738197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:49.738197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:49.738197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.738197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:49.738197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:49.738197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:49.738858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:49.739533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:49.739533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:49.739533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:49.739533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:49.739533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.739533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:49.739533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.739533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.739533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:49.739533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.739533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:49.739533 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:49.739533 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:49.739899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:49.739899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:49.739899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:49.739899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:49.739899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.739899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:49.739899 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.739899 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:49.739899 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.740186 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.740186 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:49.740186 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.740186 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:49.740746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.740746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:49.740746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:49.740746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:49.740746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.740746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:49.740746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:49.740746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.740746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:49.740746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:49.740746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:49.740746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.741127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:49.741127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:49.741127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:49.741127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:49.741127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:49.741127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:49.741127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:49.741127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:49.741127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.741127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:49.741127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.741127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.741127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:49.741495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.741495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:49.741893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.741893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:49.741893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:49.741893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:49.741893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:49.741893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:49.741893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.741893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:49.741893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:49.741893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.741893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:49.741893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:49.741893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.741893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:49.741893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:49.741893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:49.742383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:49.742887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:49.742887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:49.742887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:54.599828 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:54.600591 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:54.600591 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:54.601586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:54.603327 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:36:54.629607 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:54.630108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.631205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:54.631205 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.631205 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:54.631205 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.631205 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.631205 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:54.631205 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.631205 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:54.632286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.031 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.632286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:54.632286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:54.632286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:54.632286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.632286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:54.632286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:54.632286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.632286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:54.632286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:54.632286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:54.632286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.632966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:54.632966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:54.632966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:54.632966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:54.632966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:54.632966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:54.632966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:54.632966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:54.632966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.632966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:54.632966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.632966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.632966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:54.633606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.633606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:54.633606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.633606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:54.633606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:54.633606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:54.633606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:54.633606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:54.633606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.633606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:54.633606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:54.633606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.633606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:54.633606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:54.633606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:54.634361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.635237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:54.635237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.635237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.635237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:54.635237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.635237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:54.703879 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:54.704244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:54.704538 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:54.705800 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:54.706460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:54.706761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.707962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:54.707962 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.707962 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:54.707962 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.707962 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.707962 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:54.707962 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.707962 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:54.709412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.709412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:54.709412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:54.709412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:54.709412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.709412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:54.709412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:54.709412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.709412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:54.709412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:54.709412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:54.709412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.710139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:54.710139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:54.710139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:54.710139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:54.710139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:54.710139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:54.710139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:54.710139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:54.710139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.710139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:54.710139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.710139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.710139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:54.710776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.710776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:54.711190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.711190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:54.711190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:54.711190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:54.711190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:54.711190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:54.711190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.711190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:54.711190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:54.711190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.711190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:54.711190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:54.711190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.711190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:54.711190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:54.711190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.712032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.712924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:54.712924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.712924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:54.724875 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:54.725169 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:54.725284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:54.725431 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:36:54.726027 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:54.726482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.727270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:54.727270 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.727270 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:54.727270 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.727270 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.727270 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:54.727270 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.727270 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:54.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:54.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:54.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:54.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:54.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:54.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:54.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:54.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:54.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:54.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:54.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:54.728500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:54.729177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:54.729177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:54.729177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.729177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:54.729177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.729177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.729177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:54.729177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.729177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:54.729787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.729787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:54.729787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:54.729787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:54.729787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.729787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:54.729787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:54.729787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:36:54.729787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:54.729787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:54.729787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.729787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:54.730338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:54.730338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:54.730338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.730338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:54.730338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:54.730338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:54.730338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:54.730338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:54.730338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:54.730338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:54.730338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:54.730338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.730338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:54.730338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.730937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.730937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:54.730937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.730937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:54.731392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.731392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:54.731392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:54.731392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:54.731392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:54.731392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:54.731392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.731392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:54.731392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:54.731392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.731392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:54.731392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:54.731392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.731392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:54.731392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:54.731392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:54.732299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:54.733201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.733201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:54.733201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.733201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.733201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:54.733201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.733201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:54.733201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:54.733201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:54.733201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:54.733809 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:54.733809 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:54.734068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.734894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:54.734894 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.734894 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:54.734894 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.734894 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.734894 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:54.734894 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.734894 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:54.736171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.736171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:54.736171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:54.736171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:54.736171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.736171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:54.736171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:54.736171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:54.736171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.736171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:54.736171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:54.736171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:54.736171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:54.736171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:54.736171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:54.736722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:54.736722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:54.736722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.736722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:54.736722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.736722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.736722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:54.736722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.736722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:54.737568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.737568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:54.737568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:54.737568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:54.737568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.737568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:54.737568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:54.737568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:54.737568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:54.737568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.737568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:54.737879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:54.737879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:54.737879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.737879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:54.737879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:54.737879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:54.737879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:54.737879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:54.737879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:54.737879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:54.737879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:54.737879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.737879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:54.737879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.738268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.738268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:54.738268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.738268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.739082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:54.739703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.740274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.740274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:54.740274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.740274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:54.740274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:54.740274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:54.740274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:54.740274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:54.740526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:54.740777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:54.741017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.741813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:54.741813 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.741813 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:54.741813 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.741813 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.741813 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:54.741813 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.741813 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:54.742715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.742715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:54.742715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:54.742715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:54.742715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.742715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:54.742715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:54.742715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.742715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:54.742715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:54.742715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:54.742715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.743065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:54.743065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:54.743065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:54.743065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:54.743065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:54.743065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:54.743065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:54.743065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:54.743065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.743065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:54.743065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.743065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.743065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:54.743426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.743426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:54.743651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.743651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:54.743651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:54.743651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:54.743651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:54.743651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:54.743651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.743651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:54.743651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:54.743651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.743651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:54.743651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:54.743651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.743651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:54.743651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:54.743651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:54.744067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:54.744561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:54.744561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:54.744561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:59.600475 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:59.601446 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:59.601446 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:59.602406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:59.637003 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:59.637191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.638148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:59.638148 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.638148 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:59.638148 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.638148 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.638148 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:59.638148 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.638148 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:59.638746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.638746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:59.638746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:59.638746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:59.638746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.638746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:59.638746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:59.638746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.638746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:59.638746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:59.638746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:59.638746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.639382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:59.639382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:59.639382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:59.639382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:59.639382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:59.639382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:59.639382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:59.639382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:59.639382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.639382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:59.639382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.639382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.639382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:59.640010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.640010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:59.640010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.640010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:59.640010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:59.640010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:59.640010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:59.640010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:59.640010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.640010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:59.640010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:59.640010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.640010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:59.640010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:59.640010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:59.640836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.641694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:59.641694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.641694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.641694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:59.641694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.641694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:59.704735 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:59.705207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:59.705317 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:59.706159 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:59.706573 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:59.706887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.707730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:59.707730 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.707730 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:59.707730 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.707730 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.707730 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:59.707730 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.707730 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:59.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:59.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:59.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:59.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:59.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:59.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:59.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:59.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:59.708584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.709235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:59.709235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:59.709235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:59.709235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:59.709235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:59.709235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:59.709235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:59.709235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:59.709235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.709235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:59.709235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.709235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.709235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:59.709842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.709842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:59.709842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.709842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:59.709842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:59.709842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:59.709842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:59.709842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:59.709842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.709842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:59.709842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:59.709842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.709842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:59.709842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:59.709842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:59.710604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.711502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:59.711502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.711502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.711502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:59.711502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.711502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:59.725438 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:59.725751 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:59.725854 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:59.725969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:36:59.726318 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:59.726567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.727271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:59.727271 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.727271 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:59.727271 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.727271 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.727271 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:59.727271 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.727271 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:59.727997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.727997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:59.727997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:59.727997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:59.727997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.727997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:59.727997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:59.727997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:59.727997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.727997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:59.727997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:59.727997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:59.727997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:59.727997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:59.727997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:59.728885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:59.728885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:59.728885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.728885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:59.728885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.728885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.728885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:59.728885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.728885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:59.728885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.728885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:59.728885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:59.728885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:59.728885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.729637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:59.729637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:59.729637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:36:59.729637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:59.729637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:59.729637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.729637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:59.729637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:59.729637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:59.729637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.729637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:59.729637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:59.729637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:59.730282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:59.730282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:59.730282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:59.730282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:59.730282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:59.730282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.730282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:59.730282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.730282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.730282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:59.730282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.730282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:59.730864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.730864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:59.730864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:59.730864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:59.730864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:59.730864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:59.730864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.730864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:59.730864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:59.730864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.730864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:59.730864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:59.730864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.730864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:59.730864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:59.730864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:59.731578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:59.732439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.732439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:59.732439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.732439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.732439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:59.732439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.732439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:59.732851 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:59.733101 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:59.733283 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:59.733536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:59.734072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:59.734547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.735148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:59.735148 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.735148 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:59.735148 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.735148 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.735148 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:59.735148 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.735148 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:59.736301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.736301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:36:59.736301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:59.736301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:59.736301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.736301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:59.736301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:59.736301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:59.736301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.736301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:36:59.736301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:59.736301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:36:59.736301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:59.736301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:36:59.736301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:36:59.736783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:59.736783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:36:59.736783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.736783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:36:59.736783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.736783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.736783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:36:59.736783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.736783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:36:59.737493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.737493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:59.737493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:59.737493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:59.737493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.737493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:59.737493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:59.737493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:59.737493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:59.737493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.737493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:59.737875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:59.737875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:59.737875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.737875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:59.737875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:59.737875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:59.737875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:59.737875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:59.737875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:59.737875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:59.737875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:59.737875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.737875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:59.737875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.738408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.738408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:59.738408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.738408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.738582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:59.739071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.739598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.739598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:59.739598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.739598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:36:59.739816 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:36:59.739974 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:36:59.740081 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:36:59.740231 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:36:59.740556 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:59.740872 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:36:59.741050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.741610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:36:59.741610 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.741610 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:36:59.741610 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.741610 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.741610 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:36:59.741610 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.741610 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:36:59.742382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.742382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:36:59.742382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:59.742382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:36:59.742382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.742382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:59.742382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:59.742382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.742382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:59.742382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:59.742382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:59.742382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.742762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:36:59.742762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:59.742762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:36:59.742762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:59.742762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:36:59.742762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:36:59.742762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:59.742762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:36:59.742762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.742762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:36:59.742762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.742762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.742762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:36:59.743116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.743116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:36:59.743447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.743447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:36:59.743447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:36:59.743447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:36:59.743447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:36:59.743447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:36:59.743447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.743447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:36:59.743447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:36:59.743447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.743447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:36:59.743447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:36:59.743447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.743447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:36:59.743447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:36:59.743447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:36:59.743910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:36:59.744432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:36:59.744432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:36:59.744432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:04.601126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:04.601630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:04.601874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:04.603534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:04.637340 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:04.637677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.638489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:04.638489 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.638489 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:04.638489 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.638489 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.638489 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:04.638489 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.638489 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:04.639283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.639283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:04.639283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:04.639283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:04.639283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.639283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:04.639283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:04.639283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.639283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:04.639283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:04.639283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:04.639283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.639862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:04.639862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:04.639862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:04.639862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:04.639862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:04.639862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:04.639862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:04.639862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:04.639862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.639862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:04.639862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.639862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.639862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:04.640567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.640567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:04.640567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.640567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:04.640567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:04.640567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:04.640567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:04.640567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:04.640567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.640567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:04.640567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:04.640567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.640567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:04.640567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:04.640567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:04.641335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.642191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:04.642191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.642191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.642191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:04.642191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.642191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:04.705497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:04.706316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:04.706316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:04.707088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:04.707481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:04.707777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.708668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:04.708668 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.708668 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:04.708668 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.708668 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.708668 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:04.708668 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.708668 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:04.709809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.709809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:04.709809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:04.709809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:04.709809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.709809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:04.709809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:04.709809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.709809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:04.709809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:04.709809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:04.709809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.710637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:04.710637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:04.710637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:04.710637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:04.710637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:04.710637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:04.710637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:04.710637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:04.710637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.710637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:04.710637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.710637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.710637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:04.711531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.711531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:04.711531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.711531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:04.711531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:04.711531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:04.711531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:04.711531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:04.711531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.711531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:04.711531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:04.711531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.711531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:04.711531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:04.711531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:04.712607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.714034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:04.714034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.714034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.714034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:04.714034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.714034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:04.726205 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:04.726390 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:04.726563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:04.726723 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:37:04.727350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:04.727617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.728999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:04.728999 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.728999 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:04.728999 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.728999 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.728999 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:04.728999 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.728999 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:04.731023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.731023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:04.731023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:04.731023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:04.731023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.731023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:04.731023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:04.731023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:04.731023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.731023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:04.731023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:04.731023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:04.731023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:04.731023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:04.731023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:04.731986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:04.731986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:04.731986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.731986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:04.731986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.731986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.731986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:04.731986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.731986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:04.732478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.732478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:04.732478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:04.732478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:04.732478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.732478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:04.732478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:04.732478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:37:04.732478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:04.732478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:04.732478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.732478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:04.732990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:04.732990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:04.732990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.732990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:04.732990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:04.732990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:04.732990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:04.732990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:04.732990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:04.732990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:04.732990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:04.732990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.732990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:04.732990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.733538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.733538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:04.733538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.733538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:04.733538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.733538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:04.733538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:04.733538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:04.733538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:04.733538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:04.733538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.733538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:04.733538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:04.733538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:04.734285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:04.735048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:04.735048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:04.735048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:04.735048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:04.735048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:04.735048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.735048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:04.735048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.735048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.735048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:04.735048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.735048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:04.735048 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:04.735048 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:04.735685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:04.735685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:04.735685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:04.735685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.735854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:04.735854 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.735854 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:04.735854 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.735854 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.735854 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:04.735854 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.735854 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:04.736532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.736532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:04.736532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:04.736532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:04.736532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.736532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:04.736532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:04.736532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:04.736532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.736532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:04.736532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:04.736532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:04.736532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:04.736532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:04.736532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:04.737062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:04.737062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:04.737062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.737062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:04.737062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.737062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.737062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:04.737062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.737062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:04.737410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.737410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:04.737410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:04.737410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:04.737410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.737410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:04.737410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:04.737410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:04.737410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:04.737410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.737410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:04.737948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:04.737948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:04.737948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.737948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:04.737948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:04.737948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:04.737948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:04.737948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:04.737948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:04.737948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:04.737948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:04.737948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.737948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:04.737948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.738488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.738488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:04.738488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.738488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:04.738488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.738488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:04.738488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:04.738488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:04.738488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:04.738488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:04.738488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.738488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:04.738488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:04.738488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:04.739036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:04.739901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:04.739901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:04.739901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:04.739901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:04.739901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.739901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:04.739901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.739901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.739901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:04.739901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.739901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:04.740210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:04.740659 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:04.740659 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:04.740785 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:04.741112 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:04.741343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:04.741526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.742141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:04.742141 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.742141 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:04.742141 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.742141 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.742141 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:04.742141 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.742141 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:04.742955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.742955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:04.742955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:04.742955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:04.742955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.742955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:04.742955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:04.742955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.742955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:04.742955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:04.742955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:04.742955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.743194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:04.743194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:04.743194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:04.743194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:04.743194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:04.743194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:04.743194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:04.743194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:04.743194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.743194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:04.743194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.743194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.743194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:04.743467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.743467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:04.743947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.743947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:04.743947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:04.743947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:04.743947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:04.743947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:04.743947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.743947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:04.743947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:04.743947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.743947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:04.743947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:04.743947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.743947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:04.743947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:04.743947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:04.744241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:04.744599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:04.744599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:04.744599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:09.601754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:09.602576 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:09.602576 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:09.603298 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:09.638454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:09.638854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.640605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:09.640605 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.640605 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:09.640605 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.640605 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.640605 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:09.640605 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.640605 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:09.641833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.641833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:09.641833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:09.641833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:09.641833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.641833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:09.641833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:09.641833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.641833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:09.641833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:09.641833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:09.641833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.642679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:09.642679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:09.642679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:09.642679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:09.642679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:09.642679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:09.642679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:09.642679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:09.642679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.642679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:09.642679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.642679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.642679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:09.643315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.643315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:09.643315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.643315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:09.643315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:09.643315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:09.643315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:09.643315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:09.643315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.643315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:09.643315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:09.643315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.643315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:09.643315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:09.643315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:09.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.644914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:09.644914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.644914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.644914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:09.644914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.644914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:09.706124 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:09.706779 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:09.706779 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:09.708488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:09.708488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:09.708488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.709236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:09.709236 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.709236 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:09.709236 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.709236 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.709236 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:09.709236 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.709236 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:09.711167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.711167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:09.711167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:09.711167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:09.711167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.711167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:09.711167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:09.711167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.711167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:09.711167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:09.711167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:09.711167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.712060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:09.712060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:09.712060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:09.712060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:09.712060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:09.712060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:09.712060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:09.712060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:09.712060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.712060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:09.712060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.712060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.712060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:09.712908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.712908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:09.712908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.712908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:09.712908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:09.712908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:09.712908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:09.712908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:09.712908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.712908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:09.712908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:09.712908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.712908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:09.712908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:09.712908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:09.713923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.715209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:09.726804 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:09.727211 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:09.727339 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:09.727506 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:37:09.728079 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:09.728257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.728822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:09.728822 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.728822 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:09.728822 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.728822 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.728822 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:09.728822 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.728822 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:09.729614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.729614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:09.729614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:09.729614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:09.729614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.729614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:09.729614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:09.729614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:09.729614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.729614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:09.729614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:09.729614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:09.729614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:09.729614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:09.729614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:09.730734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:09.730734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:09.730734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.730734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:09.730734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.730734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.730734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:09.730734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.730734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:09.730734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.730734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:09.730734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:09.730734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:09.730734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.731697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:09.731697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:09.731697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:37:09.731697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:09.731697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:09.731697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.731697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:09.731697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:09.731697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:09.731697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.731697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:09.731697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:09.731697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:09.732596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:09.732596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:09.732596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:09.732596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:09.732596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:09.732596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.732596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:09.732596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.732596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.732596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:09.732596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.732596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:09.733314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.733314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:09.733314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:09.733314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:09.733314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:09.733314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:09.733314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.733314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:09.733314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:09.733314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.733314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:09.733314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:09.733314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.733314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:09.733314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:09.733314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:09.734284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:09.735276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.735276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:09.735276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.735276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.735276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:09.735276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.735276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:09.735276 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:09.735276 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:09.735276 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:09.735725 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:09.735725 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:09.735725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.736044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:09.736044 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.736044 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:09.736044 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.736044 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.736044 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:09.736044 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.736044 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:09.736826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.736826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:09.736826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:09.736826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:09.736826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.736826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:09.736826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:09.736826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:09.736826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.736826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:09.736826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:09.736826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:09.736826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:09.736826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:09.736826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:09.737329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:09.737329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:09.737329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.737329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:09.737329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.737329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.737329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:09.737329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.737329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:09.737739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.737739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:09.737739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:09.737739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:09.737739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.737739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:09.737739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:09.737739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:09.737739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:09.737739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.737739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:09.738085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:09.738085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:09.738085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.738085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:09.738085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:09.738085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:09.738085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:09.738085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:09.738085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:09.738085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:09.738085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:09.738085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.738085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:09.738085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.738545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.738545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:09.738545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.738545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.738897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:09.739392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.739920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.739920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:09.739920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.739920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:09.740535 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:09.740810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:09.740925 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:09.741076 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:09.741515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:09.741856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:09.742135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.742785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:09.742785 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.742785 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:09.742785 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.742785 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.742785 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:09.742785 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.742785 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:09.743679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.743679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:09.743679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:09.743679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:09.743679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.743679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:09.743679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:09.743679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.743679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:09.743679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:09.743679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:09.743679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.744046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:09.744046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:09.744046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:09.744046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:09.744046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:09.744046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:09.744046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:09.744046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:09.744046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.744046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:09.744046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.744046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.744046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:09.744439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.744439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:09.744726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.744726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:09.744726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:09.744726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:09.744726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:09.744726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:09.744726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.744726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:09.744726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:09.744726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.744726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:09.744726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:09.744726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.744726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:09.744726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:09.744726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:09.745169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:09.745924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:09.745924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:09.745924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:14.602530 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:14.603334 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:14.603521 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:14.604868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:14.647914 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:14.647914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.647914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:14.647914 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.647914 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:14.647914 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.647914 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.647914 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:14.647914 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.647914 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:14.649186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.044 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.649186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:14.649186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:14.649186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:14.649186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.649186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:14.649186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:14.649186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.649186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:14.649186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:14.649186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:14.649186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.649867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:14.649867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:14.649867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:14.649867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:14.649867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:14.649867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:14.649867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:14.649867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:14.649867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.649867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:14.649867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.649867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.649867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:14.650518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.650518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:14.650518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.650518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:14.650518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:14.650518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:14.650518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:14.650518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:14.650518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.650518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:14.650518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:14.650518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.650518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:14.650518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:14.650518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:14.651226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.652177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:14.652177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.652177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.652177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:14.652177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.652177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:14.707009 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:14.707773 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:14.707900 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:14.709241 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:14.709651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:14.709845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.711029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:14.711029 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.711029 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:14.711029 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.711029 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.711029 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:14.711029 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.711029 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:14.712444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.712444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:14.712444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:14.712444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:14.712444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.712444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:14.712444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:14.712444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.712444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:14.712444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:14.712444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:14.712444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.713208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:14.713208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:14.713208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:14.713208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:14.713208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:14.713208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:14.713208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:14.713208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:14.713208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.713208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:14.713208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.713208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.713208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:14.713884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.713884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:14.714023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.714023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:14.714023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:14.714023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:14.714023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:14.714023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:14.714023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.714023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:14.714023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:14.714023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.714023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:14.714023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:14.714023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.714023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:14.714023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:14.714023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.714916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.715977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:14.715977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.715977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:14.727566 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:14.728133 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:14.728251 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:14.728443 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:37:14.729178 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:14.729581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.730552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:14.730552 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.730552 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:14.730552 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.730552 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.730552 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:14.730552 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.730552 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:14.731629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.731629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:14.731629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:14.731629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:14.731629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.731629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:14.731629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:14.731629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:14.731629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.731629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:14.731629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:14.731629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:14.731629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:14.731629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:14.731629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:14.732414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:14.732414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:14.732414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.732414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:14.732414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.732414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.732414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:14.732414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.732414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:14.732414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.732414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:14.732414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:14.732414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:14.732414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.733221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:14.733221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:14.733221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:37:14.733221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:14.733221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:14.733221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.733221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:14.733221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:14.733221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:14.733221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.733221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:14.733221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:14.733221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:14.733920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:14.733920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:14.733920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:14.733920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:14.733920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:14.733920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.733920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:14.733920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.733920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.733920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:14.733920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.733920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:14.734600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.734600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:14.734600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:14.734600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:14.734600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:14.734600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:14.734600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.734600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:14.734600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:14.734600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.734600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:14.734600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:14.734600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.734600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:14.734600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:14.734600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:14.735448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:14.736543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.736543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:14.736543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.736543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.736543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:14.736543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.736543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:14.736543 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:14.736543 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:14.736543 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:14.737132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:14.737132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:14.737132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.737132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:14.737132 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.737132 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:14.737132 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.737132 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.737132 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:14.737132 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.737132 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:14.737610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.737610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:14.737610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:14.737610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:14.737610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.737610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:14.737610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:14.737610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:14.737610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.737610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:14.737610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:14.737610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:14.737610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:14.737610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:14.737610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:14.738024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:14.738024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:14.738024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.738024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:14.738024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.738024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.738024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:14.738024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.738024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:14.738436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.738436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:14.738436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:14.738436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:14.738436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.738436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:14.738436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:14.738436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:14.738436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:14.738436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.738436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:14.738771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:14.738771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:14.738771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.738771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:14.738771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:14.738771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:14.738771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:14.738771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:14.738771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:14.738771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:14.738771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:14.738771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.738771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:14.738771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.739293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.739293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:14.739293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.739293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.739909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:14.740466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.740993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.740993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:14.740993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.740993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:14.740993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:14.741327 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:14.741469 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:14.741643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:14.742200 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:14.742608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:14.742838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.743649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:14.743649 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.743649 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:14.743649 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.743649 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.743649 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:14.743649 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.743649 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:14.744579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.744579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:14.744579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:14.744579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:14.744579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.744579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:14.744579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:14.744579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.744579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:14.744579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:14.744579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:14.744579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.744952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:14.744952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:14.744952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:14.744952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:14.744952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:14.744952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:14.744952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:14.744952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:14.744952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.744952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:14.744952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.744952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.744952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:14.745339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.745339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:14.745538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.745538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:14.745538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:14.745538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:14.745538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:14.745538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:14.745538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.745538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:14.745538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:14.745538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.745538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:14.745538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:14.745538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.745538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:14.745538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:14.745538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:14.746021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:14.746698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:14.746698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:14.746698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:19.603556 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:19.604560 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:19.604560 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:19.605401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:19.706537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:19.706537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.706537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:19.706537 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.706537 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:19.706537 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.706537 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.706537 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:19.706537 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.706537 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:19.706537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.706537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:19.706537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:19.708010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:19.708010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.708010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:19.708010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:19.708010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.708010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:19.708010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:19.708010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:19.708010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.708010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:19.708010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:19.708010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:19.708010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:19.708010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:19.708510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:19.708510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:19.708510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:19.708510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.708510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:19.708510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.708510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.708510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:19.708510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.708510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:19.708510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.708510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:19.709223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:19.709804 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:19.710301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:19.710301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:19.710301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:19.710301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:19.710301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.710301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:19.710301 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.710301 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:19.710301 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.710756 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.710756 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:19.710756 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.710756 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:19.711284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.711284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:19.711284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:19.711284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:19.711284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.711284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:19.711284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:19.711284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.711284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:19.711284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:19.711284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:19.711284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.711550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:19.711550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:19.711550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:19.711550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:19.711550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:19.711550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:19.711550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:19.711550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:19.711550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.711550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:19.711550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.711550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.711550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:19.711783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.711783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:19.712648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.712648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:19.712648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:19.712648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:19.712648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:19.712648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:19.712648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.712648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:19.712648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:19.712648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.712648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:19.712648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:19.712648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.712648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:19.712648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:19.712648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.712995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.713809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:19.713809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.713809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:19.729119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:19.729250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:19.729943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:19.729943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:37:19.730244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:19.730619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.732412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:19.732412 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.732412 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:19.732412 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.732412 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.732412 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:19.732412 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.732412 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:19.732737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.732737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:19.732737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:19.732737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:19.732737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.732737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:19.732737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:19.732737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:19.732737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.732737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:19.732737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:19.732737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:19.732737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:19.732737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:19.732737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:19.733304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:19.733304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:19.733304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.733304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:19.733304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.733304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.733304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:19.733304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.733304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:19.734745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.734745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:19.734745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:19.734745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:19.734745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.734745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:19.734745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:19.734745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:37:19.734745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:19.734745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:19.734745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.734745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:19.735030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:19.735030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:19.735030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.735030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:19.735030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:19.735030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:19.735030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:19.735030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:19.735030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:19.735030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:19.735030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:19.735030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.735030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:19.735030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.735320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.735320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:19.735320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.735320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:19.737088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.737088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:19.737088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:19.737088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:19.737088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:19.737088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:19.737088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.737088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:19.737088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:19.737088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.737088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:19.737088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:19.737088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.737088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:19.737088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:19.737088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:19.737453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:19.738026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.738026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:19.738026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.738026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.738026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:19.738026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.738026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:19.738026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:19.738026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:19.738026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:19.738286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:19.738563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:19.738817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.739440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:19.739440 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.739440 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:19.739440 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.739440 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.739440 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:19.739440 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.739440 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:19.740247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.740247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:19.740247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:19.740247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:19.740247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.740247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:19.740247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:19.740247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:19.740247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.740247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:19.740247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:19.740247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:19.740247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:19.740247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:19.740247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:19.740565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:19.740565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:19.740565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.740565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:19.740565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.740565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.740565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:19.740565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.740565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:19.741210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.741210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:19.741210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:19.741210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:19.741210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.741210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:19.741210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:19.741210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:19.741210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:19.741210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.741210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:19.741456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:19.741456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:19.741456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.741456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:19.741456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:19.741456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:19.741456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:19.741456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:19.741456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:19.741456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:19.741456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:19.741456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.741456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:19.741456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.741729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.741729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:19.741729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.741729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:19.741729 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.742867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:19.743461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.743995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.743995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:19.743995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.743995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:19.743995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:19.743995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:19.743995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:19.743995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:19.744230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:19.744515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.745325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:19.745325 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.745325 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:19.745325 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.745325 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.745325 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:19.745325 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.745325 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:19.746251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.746251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:19.746251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:19.746251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:19.746251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.746251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:19.746251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:19.746251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.746251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:19.746251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:19.746251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:19.746251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.746811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:19.746811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:19.746811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:19.746811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:19.746811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:19.746811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:19.746811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:19.746811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:19.746811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.746811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:19.746811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.746811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.746811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:19.747174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.747174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:19.747377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.747377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:19.747377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:19.747377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:19.747377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:19.747377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:19.747377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.747377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:19.747377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:19.747377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.747377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:19.747377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:19.747377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.747377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:19.747377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:19.747377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:19.747883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:19.748403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:19.748403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:19.748403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:24.604095 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:24.605091 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:24.605091 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:24.606059 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:24.648038 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:24.648554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.649752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:24.649752 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.649752 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:24.649752 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.649752 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.649752 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:24.649752 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.649752 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:24.650943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.045 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.650943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:24.650943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:24.650943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:24.650943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.650943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:24.650943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:24.650943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.650943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:24.650943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:24.650943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:24.650943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.651707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:24.651707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:24.651707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:24.651707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:24.651707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:24.651707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:24.651707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:24.651707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:24.651707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.651707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:24.651707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.651707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.651707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:24.652389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.652389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:24.652389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.652389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:24.652389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:24.652389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:24.652389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:24.652389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:24.652389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.652389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:24.652389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:24.652389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.652389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:24.652389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:24.652389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:24.653265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.654300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:24.654300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.654300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.654300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:24.654300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.654300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:24.708143 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:24.708609 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:24.708820 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:24.709966 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:24.710391 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:24.710770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.729284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:24.736894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:24.736894 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.736894 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:24.736894 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.736894 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.736894 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:24.736894 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.736894 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:24.739464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.028 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.739464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:24.739464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:24.739464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:24.739464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.739464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:24.739464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:24.739464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.739464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:24.739464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:24.739464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:24.739464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.740111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:24.740111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:24.740111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:24.740111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:24.740111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:24.740111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:24.740111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:24.740111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:24.740111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.740111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:24.740111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.740111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.740111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:24.740799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.740799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:24.740910 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:24.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:24.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:24.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:24.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:24.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:24.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:24.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:24.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:24.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:24.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:24.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:24.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.743611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.744505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:24.744505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.744505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:24.744505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:24.744505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:24.744505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:37:24.744505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:24.744899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:24.746104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.746104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:24.746104 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.746104 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:24.746104 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.746104 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.746104 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:24.746104 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.746104 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:24.746669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.746669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:24.746669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:24.746669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:24.746669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.746669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:24.746669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:24.746669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:24.746669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.746669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:24.746669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:24.746669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:24.746669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:24.746669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:24.746669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:24.747158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:24.747158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:24.747158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.747158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:24.747158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.747158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.747158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:24.747158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.747158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:24.747158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.747158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:24.747158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:24.747158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:24.747158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.747623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:24.747623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:24.747623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:37:24.747623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:24.747623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:24.747623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.747623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:24.747623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:24.747623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:24.747623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.747623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:24.747623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:24.747623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:24.748051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:24.748051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:24.748051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:24.748051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:24.748051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:24.748051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.748051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:24.748051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.748051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.748051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:24.748051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.748051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:24.748436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.748436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:24.748436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:24.748436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:24.748436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:24.748436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:24.748436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.748436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:24.748436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:24.748436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.748436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:24.748436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:24.748436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.748436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:24.748436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:24.748436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:24.748845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:24.749339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.749339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:24.749339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.749339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.749339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:24.749339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.749339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:24.749339 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:24.749339 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:24.749339 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:24.749859 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:24.749859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.749941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:24.749941 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.749941 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:24.749941 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.749941 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.749941 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:24.749941 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.749941 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:24.750498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.750498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:24.750498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:24.750498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:24.750498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.750498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:24.750498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:24.750498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:24.750498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.750498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:24.750498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:24.750498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:24.750498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:24.750498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:24.750498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:24.750887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:24.750887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:24.750887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.750887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:24.750887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.750887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.750887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:24.750887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.750887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:24.751521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.751521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:24.751521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:24.751521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:24.751521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.751521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:24.751521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:24.751521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:24.751521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:24.751521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.751521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:24.751849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:24.751849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:24.751849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.751849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:24.751849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:24.751849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:24.751849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:24.751849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:24.751849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:24.751849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:24.751849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:24.751849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.751849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:24.751849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.752261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.752261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:24.752261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.752261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.752821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:24.753409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.754031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.754031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:24.754031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.754031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:24.754031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:24.754031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:24.754031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:24.754317 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:24.754576 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:24.754729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.755255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:24.755255 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.755255 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:24.755255 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.755255 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.755255 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:24.755255 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.755255 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:24.755871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.755871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:24.755871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:24.755871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:24.755871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.755871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:24.755871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:24.755871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.755871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:24.755871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:24.755871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:24.755871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.756154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:24.756154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:24.756154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:24.756154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:24.756154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:24.756154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:24.756154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:24.756154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:24.756154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.756154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:24.756154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.756154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.756154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:24.756425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.756425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:24.756582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.756582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:24.756582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:24.756582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:24.756582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:24.756582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:24.756582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.756582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:24.756582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:24.756582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.756582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:24.756582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:24.756582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.756582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:24.756582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:24.756582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:24.756898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:24.757233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:24.757233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:24.757233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:29.604789 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:29.605863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:29.605863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:29.607167 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:29.644039 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:29.644430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.645294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:29.645294 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.645294 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:29.645294 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.645294 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.645294 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:29.645294 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.645294 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:29.646530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.646530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:29.646530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:29.646530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:29.646530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.646530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:29.646530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:29.646530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.646530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:29.646530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:29.646530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:29.646530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.647585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:29.647585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:29.647585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:29.647585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:29.647585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:29.647585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:29.647585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:29.647585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:29.647585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.647585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:29.647585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.647585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.647585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:29.648264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.648264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:29.648264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.648264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:29.648264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:29.648264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:29.648264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:29.648264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:29.648264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.648264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:29.648264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:29.648264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.648264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:29.648264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:29.648264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:29.649417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.651519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:29.651519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.651519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.651519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:29.651519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.651519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:29.709060 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:29.709764 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:29.709906 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:29.711113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:29.711343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:29.711560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.714702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:29.714702 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.714702 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:29.714702 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.714702 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.714702 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:29.714702 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.714702 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:29.716569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.716569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:29.716569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:29.716569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:29.716569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.716569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:29.716569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:29.716569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.716569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:29.716569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:29.716569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:29.716569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.717048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:29.717048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:29.717048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:29.717048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:29.717048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:29.717048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:29.717048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:29.717048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:29.717048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.717048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:29.717048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.717048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.717048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:29.717928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.717928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:29.718501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.718501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:29.718501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:29.718501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:29.718501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:29.718501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:29.718501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.718501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:29.718501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:29.718501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.718501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:29.718501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:29.718501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.718501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:29.718501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:29.718501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.719140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.719845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:29.719845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.719845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:29.743657 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:29.744233 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:29.744609 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:29.744880 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:37:29.746049 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:29.746049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.746304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:29.746304 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.746304 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:29.746304 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.746304 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.746304 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:29.746304 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.746304 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:29.748035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.748035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:29.748035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:29.748035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:29.748035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.748035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:29.748035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:29.748035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:29.748035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.748035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:29.748035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:29.748035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:29.748035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:29.748035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:29.748035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:29.748546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:29.748546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:29.748546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.748546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:29.748546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.748546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.748546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:29.748546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.748546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:29.750026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.750026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:29.750026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:29.750026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:29.750026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.750026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:29.750026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:29.750026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:37:29.750026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:29.750026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:29.750026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.750026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:29.750558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:29.750558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:29.750558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.750558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:29.750558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:29.750558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:29.750558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:29.750558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:29.750558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:29.750558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:29.750558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:29.750558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.750558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:29.750558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.751064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.751064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:29.751064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.751064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:29.751064 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:29.752230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.752230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:29.752230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:29.752230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:29.752230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:29.752230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:29.752230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.752230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:29.752230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:29.752230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.752230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:29.752230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:29.752230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.752230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:29.752230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:29.752230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:29.752875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:29.753548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.753548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:29.753548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.753548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.753548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:29.753548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.753548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:29.753548 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:29.753548 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:29.753548 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:29.753964 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:29.753964 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:29.753964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.754630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:29.754630 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.754630 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:29.754630 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.754630 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.754630 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:29.754630 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.754630 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:29.755498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.755498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:29.755498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:29.755498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:29.755498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.755498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:29.755498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:29.755498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:29.755498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.755498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:29.755498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:29.755498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:29.755498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:29.755498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:29.755498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:29.755905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:29.755905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:29.755905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.755905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:29.755905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.755905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.755905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:29.755905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.755905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:29.756455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.756455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:29.756455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:29.756455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:29.756455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.756455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:29.756455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:29.756455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:29.756455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:29.756455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.756455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:29.756820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:29.756820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:29.756820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.756820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:29.756820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:29.756820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:29.756820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:29.756820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:29.756820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:29.756820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:29.756820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:29.756820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.756820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:29.756820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.757237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.757237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:29.757237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.757237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:29.758161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.759004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.759004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:29.759004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.759004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:29.759004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:29.759004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:29.759004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:29.759004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:29.759358 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:29.759358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.760116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:29.760116 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.760116 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:29.760116 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.760116 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.760116 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:29.760116 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.760116 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:29.760745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.760745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:29.760745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:29.760745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:29.760745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.760745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:29.760745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:29.760745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.760745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:29.760745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:29.760745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:29.760745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.761134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:29.761134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:29.761134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:29.761134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:29.761134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:29.761134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:29.761134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:29.761134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:29.761134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.761134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:29.761134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.761134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.761134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:29.761563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.761563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:29.761563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.761563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:29.761563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:29.761563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:29.761563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:29.761563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:29.761563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.761563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:29.761563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:29.761563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.761563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:29.761563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:29.761563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:29.762033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:29.762650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:29.762650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:29.762650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:29.762650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:29.762650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:29.762650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:34.605347 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:34.606577 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:34.606577 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:34.606781 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:34.642002 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:34.642461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.643445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:34.643445 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.643445 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:34.643445 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.643445 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.643445 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:34.643445 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.643445 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:34.644220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.644220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:34.644220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:34.644220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:34.644220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.644220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:34.644220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:34.644220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.644220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:34.644220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:34.644220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:34.644220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.645052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:34.645052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:34.645052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:34.645052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:34.645052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:34.645052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:34.645052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:34.645052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:34.645052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.645052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:34.645052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.645052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.645052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:34.645764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.645764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:34.645764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.645764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:34.645764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:34.645764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:34.645764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:34.645764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:34.645764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.645764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:34.645764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:34.645764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.645764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:34.645764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:34.645764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:34.646514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.647257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:34.647257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.647257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.647257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:34.647257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.647257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:34.709715 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:34.710418 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:34.710532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:34.711770 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:34.712117 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:34.712362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.713397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:34.713397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.713397 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:34.713397 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.713397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.713397 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:34.713397 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.713397 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:34.716353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.716353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:34.716353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:34.716353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:34.716353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.716353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:34.716353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:34.716353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.716353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:34.716353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:34.716353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:34.716353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.716735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:34.716735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:34.716735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:34.716735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:34.716735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:34.716735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:34.716735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:34.716735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:34.716735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.716735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:34.716735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.716735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.716735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:34.717086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.717086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:34.717339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.717339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:34.717339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:34.717339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:34.717339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:34.717339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:34.717339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.717339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:34.717339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:34.717339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.717339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:34.717339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:34.717339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.717339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:34.717339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:34.717339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.717865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.718356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:34.718356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.718356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:34.744259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:34.744727 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:34.744928 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:34.745157 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:37:34.745940 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:34.746713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.747289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:34.747289 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.747289 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:34.747289 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.747289 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.747289 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:34.747289 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.747289 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:34.749049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.749049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:34.749049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:34.749049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:34.749049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.749049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:34.749049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:34.749049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:34.749049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.749049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:34.749049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:34.749049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:34.749049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:34.749049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:34.749049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:34.749835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:34.749835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:34.749835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.749835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:34.749835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.749835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.749835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:34.749835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.749835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:34.750396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.750396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:34.750396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:34.750396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:34.750396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.750396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:34.750396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:34.750396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:37:34.750396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:34.750396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:34.750396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.750396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:34.751012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:34.751012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:34.751012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.751012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:34.751012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:34.751012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:34.751012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:34.751012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:34.751012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:34.751012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:34.751012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:34.751012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.751012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:34.751012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.751598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.751598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:34.751598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.751598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:34.751921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.751921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:34.751921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:34.751921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:34.751921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:34.751921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:34.751921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.751921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:34.751921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:34.751921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.751921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:34.751921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:34.751921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.751921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:34.751921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:34.751921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:34.752409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:34.752923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.752923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:34.752923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.752923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.752923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:34.752923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.752923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:34.753451 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:34.753753 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:34.753935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:34.754135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:34.754610 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:34.754853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.755395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:34.755395 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.755395 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:34.755395 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.755395 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.755395 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:34.755395 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.755395 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:34.756131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.756131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:34.756131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:34.756131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:34.756131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.756131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:34.756131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:34.756131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:34.756131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.756131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:34.756131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:34.756131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:34.756131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:34.756131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:34.756131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:34.756770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:34.756770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:34.756770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.756770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:34.756770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.756770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.756770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:34.756770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.756770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:34.757163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.757163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:34.757163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:34.757163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:34.757163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.757163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:34.757163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:34.757163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:34.757163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:34.757163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.757163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:34.757503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:34.757503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:34.757503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.757503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:34.757503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:34.757503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:34.757503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:34.757503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:34.757503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:34.757503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:34.757503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:34.757503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.757503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:34.757503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.757940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.757940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:34.757940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.757940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.758333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:34.758861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.759385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.759385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:34.759385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.759385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:34.759385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:34.759385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:34.759385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:34.759385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:34.759634 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:34.759634 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:34.759634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.760267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:34.760267 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.760267 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:34.760267 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.760267 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.760267 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:34.760267 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.760267 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:34.761096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.761096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:34.761096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:34.761096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:34.761096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.761096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:34.761096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:34.761096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.761096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:34.761096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:34.761096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:34.761096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.761451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:34.761451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:34.761451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:34.761451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:34.761451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:34.761451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:34.761451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:34.761451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:34.761451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.761451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:34.761451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.761451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.761451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:34.761815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.761815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:34.762072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.762072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:34.762072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:34.762072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:34.762072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:34.762072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:34.762072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.762072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:34.762072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:34.762072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.762072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:34.762072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:34.762072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.762072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:34.762072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:34.762072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:34.762630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:34.763130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:34.763130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:34.763130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:39.606275 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:39.607280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:39.607280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:39.609018 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:39.645971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:39.646289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:39.647029 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.647029 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:39.647029 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.647029 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.647029 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:39.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:39.648148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.648148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:39.648148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:39.648148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:39.648148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.648148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:39.648148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:39.648148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.648148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:39.648148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:39.648148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:39.648148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.648638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:39.648638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:39.648638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:39.648638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:39.648638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:39.648638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:39.648638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:39.648638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:39.648638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.648638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:39.648638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.648638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.648638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:39.649050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.649050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:39.649197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.649197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:39.649197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:39.649197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:39.649197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:39.649197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:39.649197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.649197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:39.649197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:39.649197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.649197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:39.649197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:39.649197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.649197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:39.649197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:39.649197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.649803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.650483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:39.650483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.650483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:39.710715 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:39.711359 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:39.711601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:39.712815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:39.713167 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:39.713382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.714781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:39.714781 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.714781 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:39.714781 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.714781 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.714781 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:39.714781 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.714781 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:39.716174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.716174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:39.716174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:39.716174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:39.716174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.716174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:39.716174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:39.716174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.716174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:39.716174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:39.716174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:39.716174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:39.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:39.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:39.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:39.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:39.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:39.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:39.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:39.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:39.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:39.718508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.718508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:39.718508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.718508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:39.718508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:39.718508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:39.718508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:39.718508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:39.718508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.718508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:39.718508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:39.718508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.718508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:39.718508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:39.718508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:39.719834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.720327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:39.720327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.720327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.720327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:39.720327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.720327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:39.745409 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:39.745836 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:39.746136 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:39.746322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:37:39.747186 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:39.747596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.748669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:39.748669 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.748669 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:39.748669 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.748669 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.748669 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:39.748669 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.748669 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:39.750848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.750848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:39.750848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:39.750848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:39.750848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.750848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:39.750848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:39.750848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:39.750848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.750848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:39.750848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:39.750848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:39.750848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:39.750848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:39.750848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:39.751857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:39.751857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:39.751857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.751857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:39.751857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.751857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.751857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:39.751857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.751857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:39.752411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.752411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:39.752411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:39.752411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:39.752411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.752411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:39.752411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:39.752411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:37:39.752411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:39.752411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:39.752411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.752411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:39.753175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:39.753175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:39.753175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.753175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:39.753175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:39.753175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:39.753175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:39.753175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:39.753175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:39.753175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:39.753175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:39.753175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.753175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:39.753175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.753839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.753839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:39.753839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.753839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:39.753839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.753839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:39.753839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:39.753839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:39.753839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:39.753839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:39.753839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.753839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:39.753839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:39.753839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:39.755186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:39.756100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:39.756100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:39.756100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:39.756100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:39.756100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:39.756100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.756100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:39.756100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.756100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.756100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:39.756100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.756100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:39.756100 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:39.756100 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:39.756815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:39.756815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:39.756815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:39.756815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.757321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:39.757321 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.757321 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:39.757321 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.757321 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.757321 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:39.757321 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.757321 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:39.757904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.757904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:39.757904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:39.757904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:39.757904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.757904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:39.757904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:39.757904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:39.757904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.757904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:39.757904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:39.757904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:39.757904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:39.757904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:39.757904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:39.758628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:39.758628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:39.758628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.758628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:39.758628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.758628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.758628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:39.758628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.758628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:39.758628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.758628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:39.758628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:39.758628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:39.758628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.759297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:39.759297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:39.759297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:39.759297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:39.759297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.759297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:39.759297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:39.759297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:39.759297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.759297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:39.759297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:39.759297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:39.759297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:39.759939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:39.759939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:39.759939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:39.759939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:39.759939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.759939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:39.759939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.759939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.759939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:39.759939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.759939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:39.759939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:39.760538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.762203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:39.762688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:39.762688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:39.762688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:39.762688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:39.762688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:39.762688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:39.762853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.763449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:39.763449 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.763449 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:39.763449 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.763449 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.763449 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:39.763449 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.763449 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:39.764447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.764447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:39.764447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:39.764447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:39.764447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.764447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:39.764447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:39.764447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.764447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:39.764447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:39.764447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:39.764447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.764736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:39.764736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:39.764736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:39.764736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:39.764736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:39.764736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:39.764736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:39.764736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:39.764736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.764736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:39.764736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.764736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.764736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:39.765006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.765006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:39.765193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.765193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:39.765193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:39.765193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:39.765193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:39.765193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:39.765193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.765193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:39.765193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:39.765193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.765193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:39.765193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:39.765193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.765193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:39.765193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:39.765193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:39.765629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:39.766057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:39.766057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:39.766057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:44.606799 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:44.607690 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:44.607690 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:44.609138 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:44.646581 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:44.647045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.647970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:44.647970 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.647970 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:44.647970 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.647970 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.647970 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:44.647970 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.647970 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:44.648739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.648739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:44.648739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:44.648739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:44.648739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.648739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:44.648739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:44.648739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.648739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:44.648739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:44.648739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:44.648739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.649548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:44.649548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:44.649548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:44.649548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:44.649548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:44.649548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:44.649548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:44.649548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:44.649548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.649548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:44.649548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.649548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.649548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:44.650280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.650280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:44.650280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.650280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:44.650280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:44.650280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:44.650280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:44.650280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:44.650280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.650280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:44.650280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:44.650280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.650280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:44.650280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:44.650280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:44.651296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.652638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:44.652638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.652638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.652638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:44.652638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.652638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:44.711299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:44.711890 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:44.712108 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:44.713247 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:44.713609 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:44.713854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.714824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:44.714824 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.714824 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:44.714824 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.714824 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.714824 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:44.714824 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.714824 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:44.716284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.716284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:44.716284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:44.716284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:44.716284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.716284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:44.716284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:44.716284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.716284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:44.716284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:44.716284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:44.716284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.717148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:44.717148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:44.717148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:44.717148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:44.717148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:44.717148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:44.717148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:44.717148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:44.717148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.717148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:44.717148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.717148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.717148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:44.717712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.717712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:44.718021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.718021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:44.718021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:44.718021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:44.718021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:44.718021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:44.718021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.718021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:44.718021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:44.718021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.718021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:44.718021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:44.718021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.718021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:44.718021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:44.718021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.718832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.719748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:44.719748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.719748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:44.745655 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:44.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:44.746387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:44.746617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:37:44.747278 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:44.747646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.748660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:44.748660 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.748660 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:44.748660 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.748660 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.748660 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:44.748660 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.748660 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:44.749930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.749930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:44.749930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:44.749930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:44.749930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.749930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:44.749930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:44.749930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:44.749930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.749930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:44.749930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:44.749930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:44.749930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:44.749930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:44.749930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:44.750872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:44.750872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:44.750872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.750872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:44.750872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.750872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.750872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:44.750872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.750872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:44.751423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.751423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:44.751423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:44.751423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:44.751423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.751423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:44.751423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:44.751423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:37:44.751423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:44.751423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:44.751423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.751423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:44.752065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:44.752065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:44.752065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.752065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:44.752065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:44.752065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:44.752065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:44.752065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:44.752065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:44.752065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:44.752065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:44.752065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.752065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:44.752065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.752825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.752825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:44.752825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.752825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:44.753348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.753348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:44.753348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:44.753348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:44.753348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:44.753348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:44.753348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.753348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:44.753348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:44.753348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.753348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:44.753348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:44.753348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.753348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:44.753348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:44.753348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:44.753868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:44.754435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.754435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:44.754435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.754435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.754435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:44.754435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.754435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:44.755346 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:44.755723 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:44.755798 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:44.755905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:44.756507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:44.756930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.757769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:44.757769 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.757769 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:44.757769 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.757769 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.757769 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:44.757769 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.757769 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:44.758657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.758657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:44.758657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:44.758657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:44.758657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.758657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:44.758657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:44.758657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:44.758657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.758657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:44.758657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:44.758657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:44.758657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:44.758657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:44.758657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:44.759087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:44.759087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:44.759087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.759087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:44.759087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.759087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.759087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:44.759087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.759087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:44.759554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.759554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:44.759554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:44.759554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:44.759554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.759554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:44.759554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:44.759554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:44.759554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:44.759554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.759554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:44.759918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:44.759918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:44.759918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.759918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:44.759918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:44.759918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:44.759918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:44.759918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:44.759918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:44.759918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:44.759918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:44.759918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.759918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:44.759918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.760281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.760281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:44.760281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.760281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.760642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:44.761206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.761769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.761769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:44.761769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.761769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:44.761769 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:44.761932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:44.762021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:44.762192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:44.762783 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:44.763265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:44.763645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.764587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:44.764587 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.764587 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:44.764587 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.764587 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.764587 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:44.764587 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.764587 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:44.765504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.765504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:44.765504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:44.765504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:44.765504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.765504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:44.765504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:44.765504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.765504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:44.765504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:44.765504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:44.765504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:44.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:44.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:44.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:44.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:44.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:44.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:44.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:44.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:44.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.765885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:44.766226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.766226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:44.766487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.766487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:44.766487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:44.766487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:44.766487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:44.766487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:44.766487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.766487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:44.766487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:44.766487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.766487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:44.766487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:44.766487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.766487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:44.766487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:44.766487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:44.766961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:44.767530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:44.767530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:44.767530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:49.607420 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:49.608167 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:49.608167 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:49.608896 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:49.645587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:49.645587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.646435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:49.646435 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.646435 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:49.646435 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.646435 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.646435 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:49.646435 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.646435 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:49.647721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.647721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:49.647721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:49.647721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:49.647721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.647721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:49.647721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:49.647721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.647721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:49.647721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:49.647721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:49.647721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.648128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:49.648128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:49.648128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:49.648128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:49.648128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:49.648128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:49.648128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:49.648128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:49.648128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.648128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:49.648128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.648128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.648128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:49.648506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.648506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:49.648506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.648506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:49.648506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:49.648506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:49.648506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:49.648506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:49.648506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.648506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:49.648506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:49.648506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.648506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:49.648506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:49.648506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:49.648895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.649329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:49.649329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.649329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.649329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:49.649329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.649329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:49.712393 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:49.712547 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:49.712706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:49.713896 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:49.714264 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:49.714530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.715614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:49.715614 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.715614 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:49.715614 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.715614 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.715614 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:49.715614 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.715614 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:49.717208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.717208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:49.717208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:49.717208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:49.717208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.717208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:49.717208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:49.717208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.717208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:49.717208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:49.717208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:49.717208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.717547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:49.717547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:49.717547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:49.717547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:49.717547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:49.717547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:49.717547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:49.717547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:49.717547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.717547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:49.717547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.717547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.717547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:49.717800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.717800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:49.720393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.720393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:49.720393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:49.720393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:49.720393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:49.720393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:49.720393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.720393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:49.720393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:49.720393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.720393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:49.720393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:49.720393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.720393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:49.720393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:49.720393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.720781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.721181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:49.721181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.721181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:49.746658 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:49.747840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:49.748010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:49.748129 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:37:49.750098 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:49.750098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.750443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:49.750443 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.750443 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:49.750443 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.750443 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.750443 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:49.750443 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.750443 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:49.751443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.751443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:49.751443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:49.751443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:49.751443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.751443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:49.751443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:49.751443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:49.751443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.751443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:49.751443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:49.751443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:49.751443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:49.751443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:49.751443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:49.751995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:49.751995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:49.751995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.751995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:49.751995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.751995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.751995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:49.751995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.751995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:49.752360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.752360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:49.752360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:49.752360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:49.752360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.752360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:49.752360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:49.752360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:37:49.752360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:49.752360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:49.752360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.752360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:49.753298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:49.753298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:49.753298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.753298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:49.753298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:49.753298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:49.753298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:49.753298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:49.753298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:49.753298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:49.753298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:49.753298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.753298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:49.753298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.753806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.753806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:49.753806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.753806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:49.753806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.753806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:49.753806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:49.753806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:49.753806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:49.753806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:49.753806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.753806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:49.753806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:49.753806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:49.754298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:49.755056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:49.755056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:49.755056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:49.755056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:49.755056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:49.755056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.755056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:49.755056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.755056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.755056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:49.755056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.755056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:49.755887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:49.756118 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:49.756214 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:49.756341 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:49.756911 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:49.757499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.758414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:49.758414 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.758414 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:49.758414 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.758414 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.758414 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:49.758414 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.758414 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:49.759215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.759215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:49.759215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:49.759215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:49.759215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.759215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:49.759215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:49.759215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:49.759215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.759215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:49.759215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:49.759215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:49.759215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:49.759215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:49.759215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:49.759882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:49.759882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:49.759882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.759882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:49.759882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.759882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.759882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:49.759882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.759882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:49.760239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.760239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:49.760239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:49.760239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:49.760239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.760239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:49.760239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:49.760239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:49.760239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:49.760239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.760239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:49.760727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:49.760727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:49.760727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.760727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:49.760727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:49.760727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:49.760727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:49.760727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:49.760727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:49.760727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:49.760727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:49.760727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.760727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:49.760727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.761583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.761583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:49.761583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.761583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:49.761583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.761583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:49.761583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:49.761583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:49.761583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:49.761583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:49.761583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.761583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:49.761583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:49.761583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:49.762160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:49.762966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:49.762966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:49.762966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:49.762966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:49.762966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.762966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:49.762966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.762966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.762966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:49.762966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.762966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:49.762966 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:49.763683 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:49.763683 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:49.763683 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:49.765388 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:49.765388 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:49.765388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.765857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:49.765857 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.765857 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:49.765857 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.765857 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.765857 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:49.765857 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.765857 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:49.767937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.767937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:49.767937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:49.767937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:49.767937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.767937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:49.767937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:49.767937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.767937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:49.767937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:49.767937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:49.767937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.768235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:49.768235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:49.768235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:49.768235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:49.768235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:49.768235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:49.768235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:49.768235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:49.768235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.768235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:49.768235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.768235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.768235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:49.768495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.768495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:49.768495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.768495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:49.768495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:49.768495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:49.768495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:49.768495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:49.768495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.768495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:49.768495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:49.768495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.768495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:49.768495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:49.768495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:49.768788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:49.769141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:49.769141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:49.769141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:49.769141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:49.769141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:49.769141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:54.608193 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:54.608746 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:54.608746 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:54.610920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:54.611008 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:37:54.655043 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:54.655238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.656019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:54.656019 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.656019 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:54.656019 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.656019 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.656019 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:54.656019 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.656019 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:54.658136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.047 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.658136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:54.658136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:54.658136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:54.658136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.658136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:54.658136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:54.658136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.658136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:54.658136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:54.658136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:54.658136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.658702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:54.658702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:54.658702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:54.658702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:54.658702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:54.658702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:54.658702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:54.658702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:54.658702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.658702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:54.658702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.658702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.658702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:54.659175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.659175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:54.659475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.659475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:54.659475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:54.659475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:54.659475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:54.659475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:54.659475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.659475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:54.659475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:54.659475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.659475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:54.659475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:54.659475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.659475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:54.659475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:54.659475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.660141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.660983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:54.660983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.660983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:54.712546 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:54.713091 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:54.713309 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:54.714580 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:54.715082 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:54.715473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.716525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:54.716525 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.716525 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:54.716525 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.716525 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.716525 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:54.716525 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.716525 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:54.718584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.718584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:54.718584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:54.718584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:54.718584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.718584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:54.718584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:54.718584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.718584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:54.718584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:54.718584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:54.718584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.718941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:54.718941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:54.718941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:54.718941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:54.718941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:54.718941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:54.718941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:54.718941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:54.718941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.718941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:54.718941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.718941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.718941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:54.719313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.719313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:54.720040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.720040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:54.720040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:54.720040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:54.720040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:54.720040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:54.720040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.720040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:54.720040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:54.720040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.720040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:54.720040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:54.720040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.720040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:54.720040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:54.720040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.720512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.721007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:54.721007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.721007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:54.747899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:54.748212 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:54.748327 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:54.748494 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:37:54.749135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:54.749616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.750673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:54.750673 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.750673 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:54.750673 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.750673 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.750673 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:54.750673 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.750673 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:54.751935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.751935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:54.751935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:54.751935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:54.751935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.751935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:54.751935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:54.751935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:54.751935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.751935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:54.751935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:54.751935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:54.751935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:54.751935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:54.751935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:54.752683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:54.752683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:54.752683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.752683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:54.752683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.752683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.752683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:54.752683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.752683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:54.753299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.753299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:54.753299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:54.753299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:54.753299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.753299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:54.753299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:54.753299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:37:54.753299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:54.753299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:54.753299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.753299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:54.753960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:54.753960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:54.753960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.753960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:54.753960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:54.753960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:54.753960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:54.753960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:54.753960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:54.753960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:54.753960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:54.753960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.753960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:54.753960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.754643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.754643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:54.754643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.754643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:54.756234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.756234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:54.756234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:54.756234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:54.756234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:54.756234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:54.756234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.756234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:54.756234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:54.756234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.756234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:54.756234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:54.756234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.756234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:54.756234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:54.756234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:54.757155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:54.758205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.758205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:54.758205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.758205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.758205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:54.758205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.758205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:54.758205 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:54.758205 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:54.758205 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:54.758666 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:54.758666 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:54.758666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.758964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:54.758964 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.758964 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:54.758964 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.758964 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.758964 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:54.758964 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.758964 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:54.759495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.759495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:54.759495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:54.759495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:54.759495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.759495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:54.759495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:54.759495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:54.759495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.759495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:54.759495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:54.759495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:54.759495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:54.759495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:54.759495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:54.760150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.760150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:54.760150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:54.760150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:54.760150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.760150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:54.760150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:54.760150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:54.760150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:54.760150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.760150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:54.760469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:54.760469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:54.760469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.760469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:54.760469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:54.760469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:54.760469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:54.760469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:54.760469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:54.760469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:54.760469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:54.760469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.760469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:54.760469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.760959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.760959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:54.760959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.760959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:54.760959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.760959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:54.760959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:54.760959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:54.760959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:54.760959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:54.760959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.760959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:54.760959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:54.760959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:54.761348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:54.761909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:54.761909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:54.761909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:54.761909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:54.761909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.761909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:54.761909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.761909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.761909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:54.761909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.761909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:54.763023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:54.763187 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:54.763255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:54.763387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:54.763690 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:54.763907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:54.764051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.764536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:54.764536 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.764536 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:54.764536 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.764536 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.764536 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:54.764536 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.764536 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:54.765114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.765114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:54.765114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:54.765114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:54.765114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.765114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:54.765114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:54.765114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.765114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:54.765114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:54.765114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:54.765114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.765636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:54.765636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:54.765636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:54.765636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:54.765636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:54.765636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:54.765636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:54.765636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:54.765636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.765636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:54.765636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.765636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.765636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:54.765991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.765991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:54.765991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.765991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:54.765991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:54.765991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:54.765991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:54.765991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:54.765991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.765991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:54.765991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:54.765991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.765991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:54.765991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:54.765991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:54.766418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:54.767244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:54.767244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:54.767244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:54.767244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:54.767244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:54.767244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:59.608977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:59.609861 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:59.609861 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:59.611091 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:59.646966 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:59.647240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.648560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:59.648560 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.648560 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:59.648560 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.648560 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.648560 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:59.648560 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.648560 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:59.650058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.650058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:59.650058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:59.650058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:59.650058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.650058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:59.650058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:59.650058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.650058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:59.650058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:59.650058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:59.650058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.651119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:59.651119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:59.651119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:59.651119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:59.651119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:59.651119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:59.651119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:59.651119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:59.651119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.651119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:59.651119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.651119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.651119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:59.651588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.651588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:59.651672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.651672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:59.651672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:59.651672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:59.651672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:59.651672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:59.651672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.651672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:59.651672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:59.651672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.651672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:59.651672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:59.651672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.651672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:59.651672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:59.651672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.652945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:59.652945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.652945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:59.713283 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:59.714271 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:59.714708 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:59.716338 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:59.716731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:59.716978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.718180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:59.718180 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.718180 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:59.718180 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.718180 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.718180 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:59.718180 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.718180 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:59.720275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.720275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:59.720275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:59.720275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:59.720275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.720275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:59.720275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:59.720275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.720275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:59.720275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:59.720275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:59.720275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.720837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:59.720837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:59.720837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:59.720837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:59.720837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:59.720837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:59.720837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:59.720837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:59.720837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.720837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:59.720837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.720837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.720837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:59.721323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.721323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:59.722664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.722664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:59.722664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:59.722664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:59.722664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:59.722664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:59.722664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.722664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:59.722664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:59.722664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.722664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:59.722664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:59.722664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.722664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:59.722664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:59.722664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.723345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.724245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:59.724245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.724245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:59.748909 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:59.749835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:59.750020 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:59.750201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:37:59.750922 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:59.751237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.752034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:59.752034 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.752034 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:59.752034 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.752034 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.752034 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:59.752034 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.752034 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:59.753090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.753090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:59.753090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:59.753090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:59.753090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.753090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:59.753090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:59.753090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:59.753090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.753090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:59.753090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:59.753090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:59.753090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:59.753090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:59.753090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:59.753637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:59.753637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:59.753637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.753637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:59.753637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.753637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.753637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:59.753637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.753637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:59.754025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.754025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:59.754025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:59.754025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:59.754025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.754025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:59.754025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:59.754025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:37:59.754025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:59.754025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:59.754025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.754025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:59.754407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:59.754407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:59.754407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.754407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:59.754407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:59.754407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:59.754407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:59.754407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:59.754407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:59.754407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:59.754407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:59.754407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.754407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:59.754407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.754996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.754996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:59.754996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.754996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:59.755264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.755264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:59.755264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:59.755264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:59.755264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:59.755264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:59.755264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.755264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:59.755264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:59.755264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.755264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:59.755264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:59.755264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.755264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:59.755264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:59.755264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:59.755776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:59.756418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.756418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:59.756418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.756418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.756418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:59.756418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.756418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:59.757271 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:59.757630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:59.757748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:59.757889 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:59.758308 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:59.758580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.759155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:59.759155 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.759155 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:59.759155 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.759155 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.759155 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:59.759155 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.759155 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:59.760010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.760010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:37:59.760010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:59.760010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:59.760010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.760010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:59.760010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:59.760010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:59.760010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.760010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:37:59.760010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:59.760010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:37:59.760010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:59.760010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:37:59.760010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:37:59.760619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:59.760619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:37:59.760619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.760619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:37:59.760619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.760619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.760619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:37:59.760619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.760619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:37:59.761002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.761002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:59.761002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:59.761002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:59.761002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.761002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:59.761002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:59.761002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:59.761002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:59.761002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.761002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:59.761357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:59.761357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:59.761357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.761357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:59.761357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:59.761357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:59.761357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:59.761357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:59.761357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:59.761357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:59.761357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:59.761357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.761357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:59.761357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.761799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.761799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:59.761799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.761799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.762140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:59.762758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.763313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.763313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:59.763313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.763313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:37:59.763518 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:37:59.763740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:37:59.763840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:37:59.764041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:37:59.764474 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:59.764693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:37:59.764882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.765754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:37:59.765754 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.765754 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:37:59.765754 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.765754 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.765754 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:37:59.765754 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.765754 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:37:59.766751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.766751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:37:59.766751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:59.766751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:37:59.766751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.766751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:59.766751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:59.766751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.766751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:59.766751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:59.766751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:59.766751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.767194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:37:59.767194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:59.767194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:37:59.767194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:59.767194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:37:59.767194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:37:59.767194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:59.767194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:37:59.767194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.767194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:37:59.767194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.767194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.767194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:37:59.767645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.767645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:37:59.767905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.767905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:37:59.767905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:37:59.767905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:37:59.767905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:37:59.767905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:37:59.767905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.767905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:37:59.767905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:37:59.767905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.767905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:37:59.767905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:37:59.767905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.767905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:37:59.767905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:37:59.767905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:37:59.768470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:37:59.769124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:37:59.769124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:37:59.769124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:04.609730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:04.610459 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:04.610459 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:04.611084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:04.646022 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:04.646172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.646773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:04.646773 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.646773 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:04.646773 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.646773 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.646773 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:04.646773 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.646773 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:04.647510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.647510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:04.647510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:04.647510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:04.647510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.647510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:04.647510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:04.647510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.647510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:04.647510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:04.647510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:04.647510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.648018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:04.648018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:04.648018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:04.648018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:04.648018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:04.648018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:04.648018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:04.648018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:04.648018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.648018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:04.648018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.648018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.648018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:04.648562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.648562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:04.648562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.648562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:04.648562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:04.648562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:04.648562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:04.648562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:04.648562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.648562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:04.648562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:04.648562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.648562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:04.648562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:04.648562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:04.649149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.649987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:04.649987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.649987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.649987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:04.649987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.649987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:04.714096 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:04.715042 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:04.715042 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:04.715857 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:04.716062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:04.716348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.717187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:04.717187 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.717187 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:04.717187 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.717187 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.717187 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:04.717187 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.717187 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:04.718698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.718698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:04.718698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:04.718698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:04.718698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.718698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:04.718698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:04.718698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.718698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:04.718698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:04.718698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:04.718698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.719906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:04.719906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:04.719906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:04.719906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:04.719906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:04.719906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:04.719906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:04.719906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:04.719906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.719906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:04.719906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.719906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.719906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:04.720313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.720313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:04.720908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.720908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:04.720908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:04.720908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:04.720908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:04.720908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:04.720908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.720908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:04.720908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:04.720908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.720908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:04.720908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:04.720908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.720908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:04.720908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:04.720908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.721512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.722072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:04.722072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.722072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:04.749604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:04.750353 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:04.750488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:04.750828 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:38:04.751414 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:04.752162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.752408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:04.752408 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.752408 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:04.752408 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.752408 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.752408 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:04.752408 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.752408 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:04.753021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.753021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:04.753021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:04.753021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:04.753021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.753021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:04.753021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:04.753021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:04.753021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.753021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:04.753021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:04.753021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:04.753021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:04.753021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:04.753021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:04.753901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:04.753901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:04.753901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.753901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:04.753901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.753901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.753901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:04.753901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.753901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:04.753901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.753901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:04.753901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:04.753901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:04.753901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.754682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:04.754682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:04.754682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:38:04.754682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:04.754682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:04.754682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.754682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:04.754682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:04.754682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:04.754682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.754682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:04.754682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:04.754682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:04.755565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:04.755565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:04.755565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:04.755565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:04.755565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:04.755565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.755565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:04.755565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.755565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.755565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:04.755565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.755565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:04.756128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.756128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:04.756128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:04.756128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:04.756128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:04.756128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:04.756128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.756128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:04.756128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:04.756128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.756128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:04.756128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:04.756128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.756128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:04.756128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:04.756128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:04.756874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:04.757638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.757638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:04.757638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.757638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.757638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:04.757638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.757638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:04.757914 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:04.758201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:04.758280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:04.758451 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:04.758703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:04.758912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.759410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:04.759410 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.759410 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:04.759410 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.759410 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.759410 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:04.759410 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.759410 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:04.760092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.760092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:04.760092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:04.760092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:04.760092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.760092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:04.760092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:04.760092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:04.760092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.760092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:04.760092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:04.760092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:04.760092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:04.760092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:04.760092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:04.760499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:04.760499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:04.760499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.760499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:04.760499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.760499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.760499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:04.760499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.760499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:04.761361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.761361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:04.761361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:04.761361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:04.761361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.761361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:04.761361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:04.761361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:04.761361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:04.761361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.761361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:04.761715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:04.761715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:04.761715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.761715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:04.761715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:04.761715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:04.761715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:04.761715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:04.761715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:04.761715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:04.761715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:04.761715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.761715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:04.761715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.762076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.762076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:04.762076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.762076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.762904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:04.763427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.763938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.763938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:04.763938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.763938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:04.763938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:04.764137 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:04.764300 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:04.764556 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:04.765127 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:04.765668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:04.765925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.766783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:04.766783 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.766783 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:04.766783 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.766783 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.766783 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:04.766783 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.766783 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:04.767836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.767836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:04.767836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:04.767836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:04.767836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.767836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:04.767836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:04.767836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.767836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:04.767836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:04.767836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:04.767836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.768231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:04.768231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:04.768231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:04.768231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:04.768231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:04.768231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:04.768231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:04.768231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:04.768231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.768231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:04.768231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.768231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.768231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:04.768569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.768569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:04.769281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.769281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:04.769281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:04.769281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:04.769281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:04.769281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:04.769281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.769281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:04.769281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:04.769281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.769281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:04.769281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:04.769281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.769281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:04.769281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:04.769281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:04.769722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:04.770204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:04.770204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:04.770204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:09.610546 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:09.611211 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:09.611262 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:09.612603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:09.655530 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:09.655777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.656673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:09.656673 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.656673 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:09.656673 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.656673 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.656673 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:09.656673 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.656673 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:09.657474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.045 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.657474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:09.657474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:09.657474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:09.657474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.657474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:09.657474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:09.657474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.657474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:09.657474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:09.657474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:09.657474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.658311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:09.658311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:09.658311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:09.658311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:09.658311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:09.658311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:09.658311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:09.658311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:09.658311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.658311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:09.658311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.658311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.658311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:09.658776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.658776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:09.658776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.658776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:09.658776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:09.658776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:09.658776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:09.658776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:09.658776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.658776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:09.658776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:09.658776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.658776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:09.658776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:09.658776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:09.659335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.660046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:09.660046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.660046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.660046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:09.660046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.660046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:09.715011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:09.715595 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:09.715852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:09.717116 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:09.717711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:09.718171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.719349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:09.719349 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.719349 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:09.719349 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.719349 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.719349 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:09.719349 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.719349 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:09.720810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.720810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:09.720810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:09.720810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:09.720810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.720810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:09.720810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:09.720810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.720810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:09.720810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:09.720810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:09.720810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.721509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:09.721509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:09.721509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:09.721509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:09.721509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:09.721509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:09.721509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:09.721509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:09.721509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.721509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:09.721509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.721509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.721509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:09.722143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.722143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:09.722143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.722143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:09.722143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:09.722143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:09.722143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:09.722143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:09.722143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.722143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:09.722143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:09.722143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.722143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:09.722143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:09.722143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:09.722910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.723800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:09.723800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.723800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.723800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:09.723800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.723800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:09.750249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:09.750683 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:09.750801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:09.750930 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:38:09.751509 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:09.751763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.752446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:09.752446 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.752446 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:09.752446 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.752446 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.752446 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:09.752446 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.752446 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:09.753258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.753258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:09.753258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:09.753258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:09.753258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.753258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:09.753258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:09.753258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:09.753258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.753258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:09.753258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:09.753258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:09.753258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:09.753258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:09.753258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:09.753978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:09.753978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:09.753978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.753978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:09.753978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.753978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.753978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:09.753978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.753978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:09.754416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.754416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:09.754416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:09.754416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:09.754416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.754416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:09.754416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:09.754416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:38:09.754416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:09.754416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:09.754416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.754416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:09.754769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:09.754769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:09.754769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.754769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:09.754769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:09.754769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:09.754769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:09.754769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:09.754769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:09.754769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:09.754769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:09.754769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.754769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:09.754769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.755281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.755281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:09.755281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.755281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:09.755281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.755281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:09.755281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:09.755281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:09.755281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:09.755281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:09.755281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.755281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:09.755281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:09.755281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:09.755868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:09.756699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:09.756699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:09.756699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:09.756699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:09.756699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:09.756699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.756699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:09.756699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.756699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.756699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:09.756699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.756699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:09.758403 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:09.758674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:09.758756 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:09.758913 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:09.759314 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:09.759629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.760239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:09.760239 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.760239 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:09.760239 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.760239 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.760239 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:09.760239 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.760239 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:09.760941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.760941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:09.760941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:09.760941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:09.760941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.760941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:09.760941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:09.760941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:09.760941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.760941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:09.760941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:09.760941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:09.760941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:09.760941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:09.760941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:09.761741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:09.761741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:09.761741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.761741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:09.761741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.761741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.761741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:09.761741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.761741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:09.762158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.762158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:09.762158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:09.762158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:09.762158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.762158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:09.762158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:09.762158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:09.762158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:09.762158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.762158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:09.762748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:09.762748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:09.762748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.762748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:09.762748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:09.762748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:09.762748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:09.762748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:09.762748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:09.762748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:09.762748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:09.762748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.762748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:09.762748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.763668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.763668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:09.763668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.763668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:09.763668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.763668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:09.763668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:09.763668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:09.763668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:09.763668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:09.763668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.763668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:09.763668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:09.763668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:09.764297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:09.765273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:09.765273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:09.765273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:09.765273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:09.765273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.765273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:09.765273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.765273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.765273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:09.765273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.765273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:09.765273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:09.765273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:09.765924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:09.765924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:09.765924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:09.765924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:09.765924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.765924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:09.765924 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.765924 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:09.765924 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.766339 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.766339 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:09.766339 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.766339 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:09.766339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.766339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:09.766339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:09.766339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:09.766339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.766339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:09.766339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:09.766339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.766339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:09.766339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:09.767155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:09.767155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.767155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:09.767155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:09.767155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:09.767155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:09.767155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:09.767155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:09.767155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:09.767155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:09.767155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.767155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:09.767155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.767155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.767578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:09.767578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.767578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:09.767578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.767578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:09.767578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:09.767578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:09.767578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:09.767578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:09.767578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.767578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:09.767578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:09.767578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.767578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:09.767578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:09.767578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:09.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:09.768613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:09.768613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:09.768613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:09.768613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:09.768613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:09.768613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:14.611135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:14.611948 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:14.612021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:14.613864 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:14.643595 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:14.644003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.645016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:14.645016 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.645016 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:14.645016 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.645016 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.645016 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:14.645016 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.645016 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:14.645779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.645779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:14.645779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:14.645779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:14.645779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.645779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:14.645779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:14.645779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.645779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:14.645779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:14.645779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:14.645779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.646363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:14.646363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:14.646363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:14.646363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:14.646363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:14.646363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:14.646363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:14.646363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:14.646363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.646363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:14.646363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.646363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.646363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:14.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:14.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:14.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:14.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:14.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:14.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:14.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:14.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:14.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:14.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:14.647029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:14.647708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.648873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:14.648873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.648873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.648873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:14.648873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.648873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:14.715625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:14.716455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:14.716455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:14.717668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:14.718056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:14.718406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:14.719651 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.719651 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:14.719651 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.719651 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.719651 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:14.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.719651 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:14.723229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.723229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:14.723229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:14.723229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:14.723229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.723229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:14.723229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:14.723229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.723229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:14.723229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:14.723229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:14.723229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.723624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:14.723624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:14.723624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:14.723624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:14.723624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:14.723624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:14.723624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:14.723624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:14.723624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.723624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:14.723624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.723624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.723624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:14.723976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.723976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:14.723976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.723976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:14.723976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:14.723976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:14.723976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:14.723976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:14.723976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.723976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:14.723976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:14.723976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.723976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:14.723976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:14.723976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:14.724451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.725016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:14.725016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.725016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.725016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:14.725016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.725016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:14.750932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:14.751497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:14.751978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:14.752113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:38:14.752738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:14.753176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.753992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:14.753992 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.753992 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:14.753992 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.753992 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.753992 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:14.753992 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.753992 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:14.755500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.755500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:14.755500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:14.755500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:14.755500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.755500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:14.755500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:14.755500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:14.755500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.755500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:14.755500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:14.755500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:14.755500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:14.755500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:14.755500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:14.756525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:14.756525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:14.756525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.756525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:14.756525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.756525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.756525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:14.756525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.756525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:14.757094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.757094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:14.757094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:14.757094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:14.757094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.757094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:14.757094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:14.757094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:38:14.757094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:14.757094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:14.757094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.757094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:14.757649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:14.757649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:14.757649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.757649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:14.757649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:14.757649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:14.757649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:14.757649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:14.757649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:14.757649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:14.757649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:14.757649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.757649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:14.757649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.758166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.758166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:14.758166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.758166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:14.758796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.758796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:14.758796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:14.758796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:14.758796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:14.758796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:14.758796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.758796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:14.758796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:14.758796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.758796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:14.758796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:14.758796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.758796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:14.758796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:14.758796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:14.759238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:14.759973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.759973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:14.759973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.759973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.759973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:14.759973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.759973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:14.759973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:14.759973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:14.759973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:14.760304 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:14.760304 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:14.760545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.761306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:14.761306 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.761306 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:14.761306 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.761306 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.761306 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:14.761306 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.761306 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:14.763275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.763275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:14.763275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:14.763275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:14.763275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.763275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:14.763275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:14.763275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:14.763275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.763275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:14.763275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:14.763275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:14.763275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:14.763275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:14.763275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:14.763696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:14.763696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:14.763696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.763696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:14.763696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.763696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.763696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:14.763696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.763696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:14.765023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.765023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:14.765023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:14.765023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:14.765023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.765023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:14.765023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:14.765023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:14.765023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:14.765023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.765023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:14.765490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:14.765490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:14.765490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.765490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:14.765490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:14.765490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:14.765490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:14.765490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:14.765490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:14.765490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:14.765490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:14.765490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.765490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:14.765490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.765974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.765974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:14.765974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.765974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:14.765974 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.766608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:14.767277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.767881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.767881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:14.767881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.767881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:14.767881 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:14.767881 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:14.767881 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:14.767881 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:14.768136 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:14.768136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.769051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:14.769051 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.769051 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:14.769051 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.769051 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.769051 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:14.769051 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.769051 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:14.769910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.769910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:14.769910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:14.769910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:14.769910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.769910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:14.769910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:14.769910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.769910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:14.769910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:14.769910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:14.769910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.770412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:14.770412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:14.770412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:14.770412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:14.770412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:14.770412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:14.770412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:14.770412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:14.770412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.770412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:14.770412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.770412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.770412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:14.770884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.770884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:14.770884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.770884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:14.770884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:14.770884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:14.770884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:14.770884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:14.770884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.770884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:14.770884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:14.770884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.770884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:14.770884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:14.770884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:14.771506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:14.772240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:14.772240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:14.772240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:14.772240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:14.772240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:14.772240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:19.611849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:19.612489 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:19.612489 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:19.613301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:19.645881 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:19.646101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.646671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:19.646671 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.646671 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:19.646671 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.646671 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.646671 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:19.646671 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.646671 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:19.647294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.647294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:19.647294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:19.647294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:19.647294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.647294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:19.647294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:19.647294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.647294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:19.647294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:19.647294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:19.647294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.648558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:19.648558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:19.648558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:19.648558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:19.648558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:19.648558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:19.648558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:19.648558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:19.648558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.648558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:19.648558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.648558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.648558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:19.649174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.649174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:19.649174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.649174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:19.649174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:19.649174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:19.649174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:19.649174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:19.649174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.649174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:19.649174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:19.649174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.649174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:19.649174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:19.649174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:19.649940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.650875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:19.650875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.650875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.650875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:19.650875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.650875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:19.716272 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:19.716856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:19.717076 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:19.717988 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:19.718275 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:19.718609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.719497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:19.719497 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.719497 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:19.719497 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.719497 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.719497 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:19.719497 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.719497 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:19.721210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.721210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:19.721210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:19.721210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:19.721210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.721210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:19.721210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:19.721210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.721210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:19.721210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:19.721210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:19.721210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.722124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:19.722124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:19.722124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:19.722124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:19.722124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:19.722124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:19.722124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:19.722124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:19.722124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.722124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:19.722124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.722124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.722124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:19.723031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.723031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:19.723770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.723770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:19.723770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:19.723770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:19.723770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:19.723770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:19.723770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.723770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:19.723770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:19.723770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.723770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:19.723770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:19.723770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.723770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:19.723770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:19.723770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.724580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.725437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:19.725437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.725437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:19.751496 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:19.751961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:19.752217 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:19.752521 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:38:19.753147 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:19.753635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.754622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:19.754622 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.754622 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:19.754622 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.754622 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.754622 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:19.754622 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.754622 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:19.756042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.756042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:19.756042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:19.756042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:19.756042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.756042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:19.756042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:19.756042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:19.756042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.756042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:19.756042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:19.756042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:19.756042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:19.756042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:19.756042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:19.757883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:19.757883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:19.757883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.757883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:19.757883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.757883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.757883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:19.757883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.757883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:19.758665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.758665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:19.758665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:19.758665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:19.758665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.758665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:19.758665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:19.758665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:38:19.758665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:19.758665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:19.758665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.758665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:19.759951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:19.759951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:19.759951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.759951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:19.759951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:19.759951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:19.759951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:19.759951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:19.759951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:19.759951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:19.759951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:19.759951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.759951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:19.759951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.761416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.761416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:19.761416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.761416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:19.761416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.761416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:19.761416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:19.761416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:19.761416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:19.761416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:19.761416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.761416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:19.761416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:19.761416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:19.762125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:19.762690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:19.762690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:19.762690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:19.762690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:19.762690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:19.762690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.762690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:19.762690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.762690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.762690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:19.762690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.762690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:19.762690 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:19.762690 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:19.763249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:19.763249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:19.763249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:19.763249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.763249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:19.763249 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.763249 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:19.763249 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.763249 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.763249 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:19.763249 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.763249 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:19.763919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.763919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:19.763919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:19.763919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:19.763919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.763919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:19.763919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:19.763919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:19.763919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.763919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:19.763919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:19.763919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:19.763919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:19.763919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:19.763919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:19.764503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:19.764503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:19.764503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.764503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:19.764503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.764503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.764503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:19.764503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.764503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:19.765124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.765124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:19.765124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:19.765124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:19.765124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.765124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:19.765124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:19.765124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:19.765124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:19.765124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.765124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:19.765697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:19.765697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:19.765697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.765697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:19.765697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:19.765697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:19.765697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:19.765697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:19.765697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:19.765697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:19.765697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:19.765697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.765697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:19.765697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.766325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.766325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:19.766325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.766325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.766798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:19.767542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.768171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.768171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:19.768171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.768171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:19.768171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:19.768171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:19.768171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:19.768171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:19.768459 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:19.768680 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:19.768993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.769783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:19.769783 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.769783 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:19.769783 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.769783 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.769783 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:19.769783 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.769783 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:19.770732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.770732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:19.770732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:19.770732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:19.770732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.770732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:19.770732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:19.770732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.770732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:19.770732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:19.770732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:19.770732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.771263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:19.771263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:19.771263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:19.771263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:19.771263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:19.771263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:19.771263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:19.771263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:19.771263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.771263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:19.771263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.771263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.771263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:19.771857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.771857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:19.772090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.772090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:19.772090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:19.772090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:19.772090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:19.772090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:19.772090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.772090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:19.772090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:19.772090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.772090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:19.772090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:19.772090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.772090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:19.772090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:19.772090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:19.772641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:19.773287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:19.773287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:19.773287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:24.612721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:24.613699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:24.613699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:24.615085 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:24.652171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:24.652534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.653008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:24.653008 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.653008 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:24.653008 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.653008 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.653008 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:24.653008 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.653008 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:24.653768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.653768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:24.653768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:24.653768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:24.653768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.653768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:24.653768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:24.653768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.653768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:24.653768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:24.653768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:24.653768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.654821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:24.654821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:24.654821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:24.654821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:24.654821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:24.654821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:24.654821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:24.654821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:24.654821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.654821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:24.654821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.654821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.654821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:24.655832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.655832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:24.655832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.655832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:24.655832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:24.655832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:24.655832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:24.655832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:24.655832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.655832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:24.655832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:24.655832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.655832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:24.655832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:24.655832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:24.657023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.658255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:24.658255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.658255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.658255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:24.658255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.658255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:24.716984 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:24.717615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:24.717828 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:24.718777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:24.719060 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:24.719310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.720173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:24.720173 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.720173 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:24.720173 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.720173 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.720173 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:24.720173 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.720173 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:24.721776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.721776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:24.721776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:24.721776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:24.721776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.721776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:24.721776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:24.721776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.721776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:24.721776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:24.721776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:24.721776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.722688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:24.722688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:24.722688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:24.722688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:24.722688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:24.722688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:24.722688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:24.722688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:24.722688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.722688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:24.722688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.722688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.722688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:24.723563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.723563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:24.725167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.725167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:24.725167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:24.725167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:24.725167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:24.725167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:24.725167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.725167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:24.725167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:24.725167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.725167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:24.725167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:24.725167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.725167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:24.725167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:24.725167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.726324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.727656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:24.727656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.727656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:24.751942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:24.753141 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:24.753327 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:24.753549 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:38:24.754086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:24.754426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.755210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:24.755210 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.755210 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:24.755210 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.755210 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.755210 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:24.755210 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.755210 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:24.756800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.756800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:24.756800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:24.756800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:24.756800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.756800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:24.756800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:24.756800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:24.756800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.756800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:24.756800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:24.756800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:24.756800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:24.756800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:24.756800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:24.757318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:24.757318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:24.757318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.757318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:24.757318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.757318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.757318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:24.757318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.757318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:24.759542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.759542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:24.759542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:24.759542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:24.759542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.759542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:24.759542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:24.759542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:38:24.759542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:24.759542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:24.759542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.759542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:24.760053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:24.760053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:24.760053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.760053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:24.760053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:24.760053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:24.760053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:24.760053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:24.760053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:24.760053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:24.760053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:24.760053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.760053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:24.760053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.760458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.760458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:24.760458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.760458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:24.761327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.761327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:24.761327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:24.761327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:24.761327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:24.761327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:24.761327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.761327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:24.761327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:24.761327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.761327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:24.761327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:24.761327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.761327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:24.761327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:24.761327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:24.761823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:24.762505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.762505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:24.762505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.762505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.762505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:24.762505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.762505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:24.762505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:24.762505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:24.762505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:24.762816 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:24.762816 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:24.762894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.763494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:24.763494 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.763494 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:24.763494 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.763494 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.763494 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:24.763494 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.763494 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:24.764247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.764247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:24.764247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:24.764247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:24.764247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.764247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:24.764247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:24.764247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:24.764247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.764247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:24.764247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:24.764247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:24.764247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:24.764247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:24.764247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:24.764696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:24.764696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:24.764696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.764696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:24.764696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.764696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.764696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:24.764696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.764696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:24.765111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.765111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:24.765111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:24.765111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:24.765111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.765111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:24.765111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:24.765111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:24.765111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:24.765111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.765111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:24.765501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:24.765501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:24.765501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.765501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:24.765501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:24.765501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:24.765501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:24.765501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:24.765501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:24.765501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:24.765501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:24.765501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.765501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:24.765501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.765881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.765881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:24.765881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.765881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:24.766822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.767334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.767334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:24.767334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.767334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:24.767469 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:24.767976 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:24.768100 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:24.768258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:24.769021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:24.769385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:24.769654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.770740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:24.770740 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.770740 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:24.770740 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.770740 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.770740 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:24.770740 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.770740 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:24.771641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.771641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:24.771641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:24.771641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:24.771641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.771641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:24.771641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:24.771641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.771641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:24.771641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:24.771641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:24.771641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.772046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:24.772046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:24.772046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:24.772046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:24.772046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:24.772046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:24.772046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:24.772046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:24.772046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.772046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:24.772046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.772046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.772046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:24.772425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.772425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:24.772723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.772723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:24.772723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:24.772723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:24.772723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:24.772723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:24.772723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.772723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:24.772723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:24.772723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.772723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:24.772723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:24.772723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.772723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:24.772723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:24.772723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:24.773184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:24.773863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:24.773863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:24.773863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:29.613194 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:29.613834 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:29.614021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:29.615308 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:29.654495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:29.654961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.656502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:29.656502 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.656502 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:29.656502 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.656502 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.656502 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:29.656502 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.656502 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:29.657192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.657192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:29.657192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:29.657192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:29.657192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.657192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:29.657192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:29.657192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.657192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:29.657192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:29.657192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:29.657192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.658112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:29.658112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:29.658112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:29.658112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:29.658112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:29.658112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:29.658112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:29.658112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:29.658112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.658112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:29.658112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.658112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.658112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:29.658859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.658859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:29.658859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.658859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:29.658859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:29.658859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:29.658859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:29.658859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:29.658859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.658859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:29.658859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:29.658859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.658859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:29.658859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:29.658859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:29.659604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.660443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:29.660443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.660443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.660443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:29.660443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.660443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:29.717671 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:29.718274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:29.718552 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:29.719486 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:29.720484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:29.720484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.720672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:29.720672 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.720672 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:29.720672 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.720672 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.720672 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:29.720672 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.720672 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:29.722271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.722271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:29.722271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:29.722271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:29.722271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.722271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:29.722271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:29.722271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.722271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:29.722271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:29.722271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:29.722271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.722676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:29.722676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:29.722676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:29.722676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:29.722676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:29.722676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:29.722676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:29.722676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:29.722676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.722676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:29.722676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.722676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.722676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:29.723055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.723055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:29.724220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.724220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:29.724220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:29.724220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:29.724220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:29.724220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:29.724220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.724220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:29.724220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:29.724220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.724220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:29.724220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:29.724220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.724220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:29.724220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:29.724220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.724956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.725923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:29.725923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.725923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:29.753087 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:29.753432 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:29.753620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:29.753827 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:38:29.754608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:29.754998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.756022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:29.756022 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.756022 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:29.756022 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.756022 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.756022 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:29.756022 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.756022 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:29.757235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.757235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:29.757235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:29.757235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:29.757235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.757235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:29.757235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:29.757235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:29.757235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.757235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:29.757235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:29.757235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:29.757235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:29.757235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:29.757235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:29.758053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:29.758053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:29.758053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.758053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:29.758053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.758053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.758053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:29.758053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.758053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:29.758573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.758573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:29.758573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:29.758573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:29.758573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.758573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:29.758573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:29.758573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:38:29.758573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:29.758573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:29.758573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.758573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:29.759029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:29.759029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:29.759029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.759029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:29.759029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:29.759029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:29.759029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:29.759029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:29.759029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:29.759029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:29.759029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:29.759029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.759029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:29.759029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.759425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.759425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:29.759425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.759425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:29.759923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.759923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:29.759923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:29.759923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:29.759923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:29.759923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:29.759923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.759923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:29.759923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:29.759923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.759923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:29.759923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:29.759923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.759923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:29.759923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:29.759923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:29.760356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:29.760866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.760866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:29.760866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.760866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.760866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:29.760866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.760866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:29.761866 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:29.762068 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:29.762177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:29.762301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:29.762685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:29.762943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.763515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:29.763515 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.763515 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:29.763515 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.763515 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.763515 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:29.763515 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.763515 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:29.764352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.764352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:29.764352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:29.764352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:29.764352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.764352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:29.764352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:29.764352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:29.764352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.764352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:29.764352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:29.764352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:29.764352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:29.764352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:29.764352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:29.764765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:29.764765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:29.764765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.764765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:29.764765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.764765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.764765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:29.764765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.764765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:29.765203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.765203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:29.765203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:29.765203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:29.765203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.765203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:29.765203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:29.765203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:29.765203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:29.765203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.765203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:29.765655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:29.765655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:29.765655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.765655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:29.765655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:29.765655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:29.765655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:29.765655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:29.765655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:29.765655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:29.765655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:29.765655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.765655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:29.765655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.766008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.766008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:29.766008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.766008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.766205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:29.766721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.767233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.767233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:29.767233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.767233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:29.767863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:29.768049 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:29.768155 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:29.768297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:29.768694 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:29.768975 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:29.769155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.769679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:29.769679 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.769679 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:29.769679 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.769679 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.769679 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:29.769679 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.769679 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:29.770489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.770489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:29.770489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:29.770489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:29.770489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.770489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:29.770489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:29.770489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.770489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:29.770489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:29.770489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:29.770489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.770945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:29.770945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:29.770945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:29.770945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:29.770945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:29.770945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:29.770945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:29.770945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:29.770945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.770945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:29.770945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.770945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.770945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:29.771310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.771310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:29.771458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.771458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:29.771458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:29.771458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:29.771458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:29.771458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:29.771458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.771458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:29.771458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:29.771458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.771458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:29.771458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:29.771458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.771458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:29.771458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:29.771458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:29.772015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:29.772548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:29.772548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:29.772548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:34.613913 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:34.614822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:34.614822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:34.616065 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:34.651148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:34.651414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.652481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:34.652481 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.652481 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:34.652481 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.652481 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.652481 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:34.652481 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.652481 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:34.653512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.653512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:34.653512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:34.653512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:34.653512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.653512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:34.653512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:34.653512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.653512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:34.653512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:34.653512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:34.653512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.654090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:34.654090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:34.654090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:34.654090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:34.654090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:34.654090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:34.654090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:34.654090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:34.654090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.654090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:34.654090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.654090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.654090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:34.654655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.654655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:34.654655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.654655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:34.654655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:34.654655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:34.654655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:34.654655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:34.654655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.654655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:34.654655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:34.654655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.654655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:34.654655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:34.654655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:34.655323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.656169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:34.656169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.656169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.656169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:34.656169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.656169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:34.718359 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:34.718846 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:34.719033 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:34.720323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:34.720785 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:34.721124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.722136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:34.722136 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.722136 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:34.722136 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.722136 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.722136 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:34.722136 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.722136 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:34.723855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.723855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:34.723855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:34.723855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:34.723855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.723855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:34.723855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:34.723855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.723855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:34.723855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:34.723855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:34.723855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.724402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:34.724402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:34.724402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:34.724402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:34.724402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:34.724402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:34.724402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:34.724402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:34.724402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.724402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:34.724402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.724402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.724402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:34.724902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.724902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:34.725838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.725838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:34.725838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:34.725838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:34.725838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:34.725838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:34.725838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.725838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:34.725838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:34.725838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.725838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:34.725838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:34.725838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.725838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:34.725838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:34.725838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.727289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.728722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:34.728722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.728722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:34.753602 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:34.754141 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:34.754315 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:34.754554 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:38:34.755259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:34.755531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.756201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:34.756201 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.756201 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:34.756201 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.756201 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.756201 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:34.756201 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.756201 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:34.757462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.757462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:34.757462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:34.757462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:34.757462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.757462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:34.757462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:34.757462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:34.757462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.757462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:34.757462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:34.757462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:34.757462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:34.757462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:34.757462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:34.757901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:34.757901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:34.757901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.757901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:34.757901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.757901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.757901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:34.757901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.757901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:34.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:34.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:34.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:34.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:34.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:34.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:38:34.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:34.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:34.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:34.759124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:34.759124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:34.759124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.759124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:34.759124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:34.759124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:34.759124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:34.759124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:34.759124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:34.759124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:34.759124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:34.759124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.759124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:34.759124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.759523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.759523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:34.759523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.759523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:34.760550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.760550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:34.760550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:34.760550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:34.760550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:34.760550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:34.760550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.760550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:34.760550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:34.760550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.760550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:34.760550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:34.760550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.760550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:34.760550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:34.760550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:34.761009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:34.761518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.761518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:34.761518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.761518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.761518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:34.761518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.761518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:34.762300 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:34.762655 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:34.762769 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:34.762898 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:34.763279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:34.763573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.764048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:34.764048 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.764048 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:34.764048 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.764048 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.764048 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:34.764048 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.764048 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:34.764825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.764825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:34.764825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:34.764825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:34.764825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.764825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:34.764825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:34.764825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:34.764825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.764825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:34.764825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:34.764825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:34.764825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:34.764825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:34.764825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:34.765246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:34.765246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:34.765246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.765246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:34.765246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.765246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.765246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:34.765246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.765246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:34.765820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.765820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:34.765820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:34.765820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:34.765820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.765820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:34.765820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:34.765820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:34.765820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:34.765820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.765820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:34.766135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:34.766135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:34.766135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.766135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:34.766135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:34.766135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:34.766135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:34.766135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:34.766135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:34.766135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:34.766135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:34.766135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.766135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:34.766135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.766538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.766538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:34.766538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.766538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.767006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:34.767516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.768050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.768050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:34.768050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.768050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:34.768242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:34.768515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:34.768631 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:34.768821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:34.769162 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:34.769380 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:34.769751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.770064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:34.770064 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.770064 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:34.770064 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.770064 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.770064 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:34.770064 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.770064 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:34.770958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.770958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:34.770958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:34.770958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:34.770958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.770958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:34.770958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:34.770958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.770958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:34.770958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:34.770958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:34.770958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.771495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:34.771495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:34.771495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:34.771495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:34.771495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:34.771495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:34.771495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:34.771495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:34.771495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.771495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:34.771495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.771495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.771495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:34.771901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.771901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:34.772036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.772036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:34.772036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:34.772036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:34.772036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:34.772036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:34.772036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.772036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:34.772036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:34.772036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.772036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:34.772036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:34.772036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.772036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:34.772036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:34.772036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:34.772606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:34.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:34.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:34.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:39.614917 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:39.616029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:39.616029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:39.617199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:39.652622 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:39.653050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.653913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:39.653913 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.653913 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:39.653913 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.653913 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.653913 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:39.653913 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.653913 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:39.654977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.654977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:39.654977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:39.654977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:39.654977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.654977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:39.654977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:39.654977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.654977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:39.654977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:39.654977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:39.654977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.655815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:39.655815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:39.655815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:39.655815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:39.655815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:39.655815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:39.655815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:39.655815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:39.655815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.655815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:39.655815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.655815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.655815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:39.656493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.656493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:39.656493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.656493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:39.656493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:39.656493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:39.656493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:39.656493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:39.656493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.656493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:39.656493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:39.656493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.656493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:39.656493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:39.656493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:39.657331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.658252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:39.658252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.658252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.658252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:39.658252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.658252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:39.719095 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:39.719618 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:39.719806 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:39.720976 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:39.721389 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:39.722758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.722758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:39.722758 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.722758 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:39.722758 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.722758 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.722758 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:39.722758 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.722758 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:39.724545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.724545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:39.724545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:39.724545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:39.724545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.724545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:39.724545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:39.724545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.724545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:39.724545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:39.724545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:39.724545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.725491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:39.725491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:39.725491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:39.725491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:39.725491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:39.725491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:39.725491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:39.725491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:39.725491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.725491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:39.725491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.725491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.725491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:39.726220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.726220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:39.726878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.726878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:39.726878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:39.726878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:39.726878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:39.726878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:39.726878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.726878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:39.726878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:39.726878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.726878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:39.726878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:39.726878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.726878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:39.726878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:39.726878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.727469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.728019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:39.728019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.728019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:39.754113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:39.754584 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:39.754741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:39.754860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:38:39.755446 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:39.755710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.756397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:39.756397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.756397 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:39.756397 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.756397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.756397 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:39.756397 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.756397 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:39.757287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.757287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:39.757287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:39.757287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:39.757287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.757287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:39.757287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:39.757287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:39.757287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.757287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:39.757287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:39.757287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:39.757287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:39.757287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:39.757287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:39.758271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:39.758271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:39.758271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.758271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:39.758271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.758271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.758271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:39.758271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.758271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:39.758900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.758900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:39.758900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:39.758900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:39.758900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.758900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:39.758900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:39.758900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:38:39.758900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:39.758900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:39.758900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.758900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:39.759782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:39.759782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:39.759782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.759782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:39.759782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:39.759782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:39.759782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:39.759782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:39.759782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:39.759782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:39.759782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:39.759782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.759782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:39.759782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.760813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.760813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:39.760813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.760813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:39.760813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.760813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:39.760813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:39.760813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:39.760813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:39.760813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:39.760813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.760813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:39.760813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:39.760813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:39.761668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:39.762661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:39.762661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:39.762661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:39.762661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:39.762661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:39.762661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.762661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:39.762661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.762661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.762661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:39.762661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.762661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:39.763187 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:39.763441 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:39.763545 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:39.763660 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:39.764084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:39.764391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.765010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:39.765010 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.765010 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:39.765010 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.765010 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.765010 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:39.765010 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.765010 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:39.765910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.765910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:39.765910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:39.765910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:39.765910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.765910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:39.765910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:39.765910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:39.765910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.765910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:39.765910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:39.765910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:39.765910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:39.765910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:39.765910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:39.766469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:39.766469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:39.766469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.766469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:39.766469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.766469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.766469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:39.766469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.766469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:39.766817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.766817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:39.766817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:39.766817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:39.766817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.766817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:39.766817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:39.766817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:39.766817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:39.766817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.766817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:39.767173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:39.767173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:39.767173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.767173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:39.767173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:39.767173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:39.767173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:39.767173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:39.767173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:39.767173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:39.767173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:39.767173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.767173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:39.767173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.767614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.767614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:39.767614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.767614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.767792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:39.768276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.768806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.768806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:39.768806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.768806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:39.768806 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:39.768982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:39.768982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:39.769111 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:39.769650 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:39.769967 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:39.770167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.770755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:39.770755 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.770755 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:39.770755 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.770755 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.770755 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:39.770755 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.770755 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:39.771650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.771650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:39.771650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:39.771650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:39.771650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.771650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:39.771650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:39.771650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.771650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:39.771650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:39.771650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:39.771650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.771993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:39.771993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:39.771993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:39.771993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:39.771993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:39.771993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:39.771993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:39.771993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:39.771993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.771993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:39.771993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.771993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.771993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:39.772327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.772327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:39.772736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.772736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:39.772736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:39.772736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:39.772736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:39.772736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:39.772736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.772736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:39.772736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:39.772736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.772736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:39.772736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:39.772736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.772736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:39.772736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:39.772736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:39.773176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:39.773699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:39.773699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:39.773699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:44.615213 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:44.616503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:44.616503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:44.617575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:44.654130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:44.654639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.655592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:44.655592 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.655592 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:44.655592 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.655592 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.655592 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:44.655592 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.655592 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:44.656317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.656317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:44.656317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:44.656317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:44.656317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.656317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:44.656317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:44.656317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.656317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:44.656317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:44.656317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:44.656317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.657057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:44.657057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:44.657057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:44.657057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:44.657057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:44.657057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:44.657057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:44.657057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:44.657057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.657057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:44.657057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.657057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.657057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:44.657766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.657766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:44.657766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.657766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:44.657766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:44.657766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:44.657766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:44.657766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:44.657766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.657766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:44.657766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:44.657766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.657766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:44.657766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:44.657766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:44.658564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.659762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:44.659762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.659762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.659762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:44.659762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.659762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:44.719730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:44.720055 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:44.720289 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:44.722488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:44.722488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:44.722488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.724532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:44.724532 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.724532 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:44.724532 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.724532 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.724532 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:44.724532 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.724532 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:44.724532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.724532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:44.724532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:44.724532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:44.724532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.724532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:44.724532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:44.725325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.725325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:44.725325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:44.725325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:44.725325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.725325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:44.725325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:44.725325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:44.725325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:44.725325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:44.725325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:44.725325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:44.725325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:44.725325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.725903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:44.725903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.725903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.725903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:44.725903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.725903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:44.725903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.725903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:44.725903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:44.725903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:44.725903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:44.725903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:44.725903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.725903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:44.726516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:44.727892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:44.727892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:44.727892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:44.727892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.727892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:44.727892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.727892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.727892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:44.727892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.727892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:44.754760 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:44.755284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:44.755532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:44.755810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:38:44.756741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:44.757189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.758336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:44.758336 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.758336 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:44.758336 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.758336 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.758336 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:44.758336 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.758336 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:44.759823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.759823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:44.759823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:44.759823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:44.759823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.759823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:44.759823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:44.759823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:44.759823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.759823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:44.759823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:44.759823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:44.759823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:44.759823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:44.759823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:44.760434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:44.760434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:44.760434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.760434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:44.760434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.760434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.760434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:44.760434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.760434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:44.761271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.761271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:44.761271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:44.761271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:44.761271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.761271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:44.761271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:44.761271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:38:44.761271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:44.761271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:44.761271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.761271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:44.761706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:44.761706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:44.761706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.761706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:44.761706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:44.761706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:44.761706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:44.761706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:44.761706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:44.761706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:44.761706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:44.761706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.761706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:44.761706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.762104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.762104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:44.762104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.762104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:44.763529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.763529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:44.763529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:44.763529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:44.763529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:44.763529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:44.763529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.763529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:44.763529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:44.763529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.763529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:44.763529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:44.763529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.763529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:44.763529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:44.763529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:44.763971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:44.764504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.764504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:44.764504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.764504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.764504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:44.764504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.764504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:44.764504 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:44.764982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:44.765161 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:44.765468 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:44.766132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:44.766486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.767101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:44.767101 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.767101 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:44.767101 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.767101 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.767101 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:44.767101 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.767101 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:44.767909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.767909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:44.767909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:44.767909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:44.767909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.767909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:44.767909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:44.767909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:44.767909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.767909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:44.767909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:44.767909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:44.767909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:44.767909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:44.767909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:44.768607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:44.768607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:44.768607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.768607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:44.768607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.768607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.768607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:44.768607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.768607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:44.769017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.769017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:44.769017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:44.769017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:44.769017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.769017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:44.769017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:44.769017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:44.769017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:44.769017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.769017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:44.769337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:44.769337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:44.769337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.769337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:44.769337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:44.769337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:44.769337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:44.769337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:44.769337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:44.769337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:44.769337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:44.769337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.769337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:44.769337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.769711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.769711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:44.769711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.769711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.770196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:44.770662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.771224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.771224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:44.771224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.771224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:44.771224 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:44.771224 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:44.771224 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:44.771224 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:44.771512 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:44.771662 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:44.771869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.772583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:44.772583 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.772583 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:44.772583 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.772583 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.772583 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:44.772583 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.772583 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:44.773358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.773358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:44.773358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:44.773358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:44.773358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.773358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:44.773358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:44.773358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.773358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:44.773358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:44.773358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:44.773358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.773723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:44.773723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:44.773723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:44.773723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:44.773723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:44.773723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:44.773723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:44.773723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:44.773723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.773723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:44.773723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.773723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.773723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:44.774056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.774056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:44.774328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.774328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:44.774328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:44.774328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:44.774328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:44.774328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:44.774328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.774328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:44.774328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:44.774328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.774328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:44.774328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:44.774328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.774328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:44.774328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:44.774328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:44.774811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:44.775319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:44.775319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:44.775319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:49.615823 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:49.616510 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:49.616510 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:49.617338 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:49.650972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:49.651516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.652566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:49.652566 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.652566 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:49.652566 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.652566 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.652566 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:49.652566 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.652566 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:49.653774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.653774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:49.653774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:49.653774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:49.653774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.653774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:49.653774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:49.653774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.653774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:49.653774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:49.653774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:49.653774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.654459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:49.654459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:49.654459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:49.654459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:49.654459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:49.654459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:49.654459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:49.654459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:49.654459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.654459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:49.654459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.654459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.654459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:49.655089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.655089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:49.655089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.655089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:49.655089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:49.655089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:49.655089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:49.655089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:49.655089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.655089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:49.655089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:49.655089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.655089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:49.655089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:49.655089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:49.656711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.658562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:49.658562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.658562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.658562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:49.658562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.658562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:49.720406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:49.721024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:49.721252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:49.722695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:49.723056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:49.723318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.724623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:49.724623 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.724623 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:49.724623 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.724623 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.724623 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:49.724623 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.724623 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:49.726870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.726870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:49.726870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:49.726870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:49.726870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.726870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:49.726870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:49.726870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.726870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:49.726870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:49.726870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:49.726870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.727247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:49.727247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:49.727247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:49.727247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:49.727247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:49.727247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:49.727247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:49.727247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:49.727247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.727247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:49.727247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.727247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.727247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:49.727660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.727660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:49.729356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.729356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:49.729356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:49.729356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:49.729356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:49.729356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:49.729356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.729356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:49.729356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:49.729356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.729356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:49.729356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:49.729356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.729356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:49.729356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:49.729356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.730311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.731353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:49.731353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.731353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:49.755280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:49.755888 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:49.756071 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:49.756244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:38:49.757553 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:49.757821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.758662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:49.758662 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.758662 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:49.758662 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.758662 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.758662 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:49.758662 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.758662 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:49.760085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.760085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:49.760085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:49.760085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:49.760085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.760085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:49.760085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:49.760085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:49.760085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.760085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:49.760085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:49.760085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:49.760085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:49.760085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:49.760085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:49.760953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:49.760953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:49.760953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.760953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:49.760953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.760953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.760953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:49.760953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.760953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:49.762233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.762233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:49.762233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:49.762233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:49.762233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.762233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:49.762233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:49.762233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:38:49.762233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:49.762233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:49.762233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.762233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:49.762713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:49.762713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:49.762713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.762713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:49.762713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:49.762713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:49.762713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:49.762713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:49.762713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:49.762713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:49.762713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:49.762713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.762713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:49.762713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.763143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.763143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:49.763143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.763143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:49.764313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.764313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:49.764313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:49.764313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:49.764313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:49.764313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:49.764313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.764313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:49.764313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:49.764313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.764313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:49.764313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:49.764313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.764313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:49.764313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:49.764313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:49.764796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:49.765310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.765310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:49.765310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.765310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.765310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:49.765310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.765310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:49.765310 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:49.765310 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:49.765310 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:49.765628 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:49.765667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:49.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.766735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:49.766735 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.766735 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:49.766735 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.766735 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.766735 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:49.766735 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.766735 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:49.767482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.767482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:49.767482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:49.767482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:49.767482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.767482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:49.767482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:49.767482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:49.767482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.767482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:49.767482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:49.767482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:49.767482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:49.767482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:49.767482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:49.767940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:49.767940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:49.767940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.767940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:49.767940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.767940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.767940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:49.767940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.767940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:49.768387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.768387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:49.768387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:49.768387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:49.768387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.768387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:49.768387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:49.768387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:49.768387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:49.768387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.768387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:49.768892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:49.768892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:49.768892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.768892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:49.768892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:49.768892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:49.768892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:49.768892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:49.768892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:49.768892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:49.768892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:49.768892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.768892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:49.768892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.769386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.769386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:49.769386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.769386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.769631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:49.770150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.770707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.770707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:49.770707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.770707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:49.770840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:49.771093 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:49.771191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:49.771346 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:49.771698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:49.771935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:49.772083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.772694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:49.772694 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.772694 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:49.772694 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.772694 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.772694 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:49.772694 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.772694 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:49.773494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.773494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:49.773494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:49.773494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:49.773494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.773494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:49.773494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:49.773494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.773494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:49.773494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:49.773494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:49.773494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.773931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:49.773931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:49.773931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:49.773931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:49.773931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:49.773931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:49.773931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:49.773931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:49.773931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.773931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:49.773931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.773931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.773931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:49.774320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.774320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:49.774412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.774412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:49.774412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:49.774412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:49.774412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:49.774412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:49.774412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.774412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:49.774412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:49.774412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.774412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:49.774412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:49.774412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.774412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:49.774412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:49.774412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:49.774906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:49.775482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:49.775482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:49.775482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:54.616573 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:54.617661 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:54.617661 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:54.618613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:54.620359 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:38:54.651977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:54.652480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.653397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:54.653397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.653397 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:54.653397 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.653397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.653397 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:54.653397 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.653397 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:54.654214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.654214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:54.654214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:54.654214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:54.654214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.654214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:54.654214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:54.654214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.654214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:54.654214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:54.654214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:54.654214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.654908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:54.654908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:54.654908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:54.654908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:54.654908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:54.654908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:54.654908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:54.654908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:54.654908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.654908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:54.654908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.654908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.654908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:54.655541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.655541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:54.655541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.655541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:54.655541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:54.655541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:54.655541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:54.655541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:54.655541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.655541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:54.655541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:54.655541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.655541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:54.655541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:54.655541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:54.656331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.657254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:54.657254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.657254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.657254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:54.657254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.657254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:54.721246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:54.721529 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:54.721529 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:54.722562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:54.722912 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:54.723148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.723919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:54.723919 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.723919 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:54.723919 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.723919 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.723919 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:54.723919 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.723919 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:54.724728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.724728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:54.724728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:54.724728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:54.724728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.724728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:54.724728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:54.724728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.724728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:54.724728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:54.724728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:54.724728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.725712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:54.725712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:54.725712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:54.725712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:54.725712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:54.725712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:54.725712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:54.725712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:54.725712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.725712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:54.725712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.725712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.725712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:54.726937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.726937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:54.726937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.726937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:54.726937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:54.726937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:54.726937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:54.726937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:54.726937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.726937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:54.726937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:54.726937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.726937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:54.726937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:54.726937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:54.727926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.728945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:54.728945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.728945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.728945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:54.728945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.728945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:54.755837 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:54.756132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:54.756212 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:54.756290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:38:54.757214 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:54.757555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.758495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:54.758495 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.758495 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:54.758495 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.758495 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.758495 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:54.758495 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.758495 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:54.759107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.759107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:54.759107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:54.759107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:54.759107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.759107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:54.759107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:54.759107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:54.759107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.759107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:54.759107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:54.759107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:54.759107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:54.759107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:54.759107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:54.759922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.760637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:54.760637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:54.760637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:38:54.760637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:54.760637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:54.760637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.760637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:54.760637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:54.760637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:54.760637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.760637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:54.760637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:54.760637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:54.761213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:54.761213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:54.761213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:54.761213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:54.761213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:54.761213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.761213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:54.761213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.761213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.761213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:54.761213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.761213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:54.761809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.761809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:54.761809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:54.761809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:54.761809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:54.761809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:54.761809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.761809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:54.761809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:54.761809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.761809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:54.761809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:54.761809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.761809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:54.761809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:54.761809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:54.762825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:54.763907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.763907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:54.763907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.763907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.763907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:54.763907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.763907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:54.765119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:54.765337 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:54.765464 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:54.765626 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:54.766237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:54.766603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.767157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:54.767157 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.767157 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:54.767157 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.767157 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.767157 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:54.767157 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.767157 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:54.768141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.768141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:54.768141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:54.768141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:54.768141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.768141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:54.768141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:54.768141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:54.768141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.768141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:54.768141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:54.768141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:54.768141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:54.768141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:54.768141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:54.768593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:54.768593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:54.768593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.768593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:54.768593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.768593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.768593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:54.768593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.768593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:54.769070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.769070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:54.769070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:54.769070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:54.769070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.769070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:54.769070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:54.769070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:54.769070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:54.769070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.769070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:54.769413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:54.769413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:54.769413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.769413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:54.769413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:54.769413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:54.769413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:54.769413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:54.769413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:54.769413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:54.769413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:54.769413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.769413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:54.769413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.769780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.769780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:54.769780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.769780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.770403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:54.770972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.771698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.771698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:54.771698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.771698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:54.771698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:54.771698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:54.771698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:54.772026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:54.772026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:54.772221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:54.772342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.773304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:54.773304 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.773304 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:54.773304 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.773304 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.773304 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:54.773304 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.773304 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.774504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:54.774504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:54.774504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:54.774504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:54.774504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:54.774504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:54.774504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:54.774504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:54.774504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.774504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:54.774504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.774504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.774504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:54.774732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.774732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:54.775191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.775191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:54.775191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:54.775191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:54.775191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:54.775191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:54.775191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.775191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:54.775191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:54.775191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.775191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:54.775191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:54.775191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.775191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:54.775191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:54.775191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:54.775805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:54.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:54.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:54.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:59.617130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:59.617974 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:59.617974 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:59.619196 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:59.651111 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:59.651506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.651848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:59.651848 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.651848 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:59.651848 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.651848 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.651848 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:59.651848 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.651848 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:59.653119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.653119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:59.653119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:59.653119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:59.653119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.653119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:59.653119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:59.653119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.653119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:59.653119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:59.653119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:59.653119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.654292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:59.654292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:59.654292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:59.654292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:59.654292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:59.654292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:59.654292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:59.654292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:59.654292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.654292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:59.654292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.654292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.654292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:59.655091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.655091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:59.655091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.655091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:59.655091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:59.655091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:59.655091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:59.655091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:59.655091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.655091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:59.655091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:59.655091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.655091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:59.655091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:59.655091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:59.655988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.658832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:59.658832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.658832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.658832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:59.658832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.658832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:59.721995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:59.722625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:59.722870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:59.724141 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:59.724484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:59.724773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.725613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:59.725613 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.725613 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:59.725613 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.725613 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.725613 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:59.725613 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.725613 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:59.727199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.727199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:59.727199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:59.727199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:59.727199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.727199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:59.727199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:59.727199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.727199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:59.727199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:59.727199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:59.727199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.727796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:59.727796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:59.727796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:59.727796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:59.727796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:59.727796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:59.727796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:59.727796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:59.727796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.727796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:59.727796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.727796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.727796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:59.728116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.728116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:59.729021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.729021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:59.729021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:59.729021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:59.729021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:59.729021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:59.729021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.729021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:59.729021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:59.729021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.729021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:59.729021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:59.729021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.729021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:59.729021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:59.729021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.729945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.730808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:59.730808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.730808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:59.756348 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:59.756777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:59.756980 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:59.757163 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:38:59.757954 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:59.758391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.759256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:59.759256 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.759256 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:59.759256 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.759256 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.759256 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:59.759256 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.759256 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:59.760247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.760247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:59.760247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:59.760247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:59.760247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.760247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:59.760247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:59.760247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:59.760247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.760247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:59.760247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:59.760247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:59.760247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:59.760247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:59.760247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:59.760831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:59.760831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:59.760831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.760831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:59.760831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.760831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.760831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:59.760831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.760831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:59.761205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.761205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:59.761205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:59.761205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:59.761205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.761205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:59.761205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:59.761205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:38:59.761205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:59.761205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:59.761205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.761205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:59.762057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:59.762057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:59.762057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.762057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:59.762057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:59.762057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:59.762057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:59.762057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:59.762057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:59.762057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:59.762057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:59.762057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.762057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:59.762057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.762807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.762807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:59.762807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.762807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:59.762807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.762807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:59.762807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:59.762807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:59.762807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:59.762807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:59.762807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.762807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:59.762807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:59.762807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:59.763259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:59.763784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:59.763784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:59.763784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:59.763784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:59.763784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:59.763784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.763784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:59.763784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.763784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.763784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:59.763784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.763784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:59.765529 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:59.765803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:59.765945 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:59.766091 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:59.766665 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:59.767045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.767797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:59.767797 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.767797 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:59.767797 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.767797 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.767797 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:59.767797 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.767797 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:59.768547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.768547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:38:59.768547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:59.768547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:59.768547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.768547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:59.768547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:59.768547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:59.768547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.768547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:38:59.768547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:59.768547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:38:59.768547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:59.768547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:38:59.768547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:38:59.769002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:59.769002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:38:59.769002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.769002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:38:59.769002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.769002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.769002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:38:59.769002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.769002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:38:59.769490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.769490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:59.769490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:59.769490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:59.769490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.769490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:59.769490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:59.769490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:59.769490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:59.769490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.769490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:59.770169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:59.770169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:59.770169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.770169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:59.770169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:59.770169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:59.770169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:59.770169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:59.770169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:59.770169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:59.770169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:59.770169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.770169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:59.770169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.770821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.770821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:59.770821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.770821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:59.770821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.770821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:59.770821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:59.770821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:59.770821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:59.770821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:59.770821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.770821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:59.770821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:59.770821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:59.771174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:59.771687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:59.771687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:59.771687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:59.771687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:59.771687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.771687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:59.771687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.771687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.771687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:59.771687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.771687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:38:59.771687 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:38:59.772006 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:38:59.772006 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:38:59.772280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:38:59.772602 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:59.773016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:38:59.773258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.774082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:38:59.774082 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.774082 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:38:59.774082 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.774082 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.774082 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:38:59.774082 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.774082 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:38:59.775476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.775476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:38:59.775476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:59.775476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:38:59.775476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.775476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:59.775476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:59.775476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.775476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:59.775476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:59.775476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:59.775476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.776515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:38:59.776515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:59.776515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:38:59.776515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:59.776515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:38:59.776515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:38:59.776515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:59.776515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:38:59.776515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.776515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:38:59.776515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.776515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.776515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:38:59.777557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.777557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:38:59.777557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.777557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:38:59.777557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:38:59.777557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:38:59.777557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:38:59.777557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:38:59.777557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.777557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:38:59.777557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:38:59.777557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.777557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:38:59.777557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:38:59.777557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:38:59.778264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:38:59.778910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:38:59.778910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:38:59.778910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:38:59.778910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:38:59.778910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:38:59.778910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:04.617861 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:04.618843 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:04.618843 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:04.620083 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:04.653576 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:04.653940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.654872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:04.654872 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.654872 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:04.654872 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.654872 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.654872 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:04.654872 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.654872 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:04.656026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.656026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:04.656026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:04.656026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:04.656026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.656026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:04.656026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:04.656026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.656026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:04.656026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:04.656026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:04.656026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.656758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:04.656758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:04.656758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:04.656758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:04.656758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:04.656758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:04.656758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:04.656758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:04.656758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.656758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:04.656758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.656758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.656758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:04.657855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.657855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:04.657855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.657855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:04.657855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:04.657855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:04.657855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:04.657855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:04.657855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.657855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:04.657855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:04.657855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.657855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:04.657855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:04.657855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:04.658823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.659868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:04.659868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.659868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.659868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:04.659868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.659868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:04.722906 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:04.723680 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:04.723909 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:04.725084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:04.725481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:04.725776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.726904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:04.726904 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.726904 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:04.726904 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.726904 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.726904 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:04.726904 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.726904 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:04.728409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.728409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:04.728409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:04.728409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:04.728409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.728409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:04.728409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:04.728409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.728409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:04.728409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:04.728409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:04.728409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.728962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:04.728962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:04.728962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:04.728962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:04.728962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:04.728962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:04.728962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:04.728962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:04.728962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.728962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:04.728962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.728962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.728962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:04.729571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.729571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:04.730092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.730092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:04.730092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:04.730092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:04.730092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:04.730092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:04.730092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.730092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:04.730092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:04.730092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.730092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:04.730092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:04.730092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.730092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:04.730092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:04.730092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.731601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.733412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:04.733412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.733412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:04.756904 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:04.757337 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:04.757573 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:04.757727 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:39:04.758470 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:04.758749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.759721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:04.759721 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.759721 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:04.759721 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.759721 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.759721 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:04.759721 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.759721 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:04.760976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.760976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:04.760976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:04.760976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:04.760976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.760976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:04.760976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:04.760976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:04.760976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.760976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:04.760976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:04.760976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:04.760976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:04.760976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:04.760976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:04.761480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:04.761480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:04.761480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.761480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:04.761480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.761480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.761480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:04.761480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.761480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:04.762394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.762394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:04.762394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:04.762394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:04.762394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.762394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:04.762394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:04.762394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:39:04.762394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:04.762394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:04.762394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.762394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:04.763119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:04.763119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:04.763119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.763119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:04.763119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:04.763119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:04.763119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:04.763119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:04.763119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:04.763119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:04.763119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:04.763119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.763119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:04.763119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.763850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.763850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:04.763850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.763850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:04.764151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.764151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:04.764151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:04.764151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:04.764151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:04.764151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:04.764151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.764151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:04.764151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:04.764151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.764151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:04.764151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:04.764151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.764151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:04.764151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:04.764151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:04.764611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:04.765073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.765073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:04.765073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.765073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.765073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:04.765073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.765073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:04.765860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:04.766222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:04.766450 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:04.766652 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:04.767184 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:04.767695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.768514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:04.768514 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.768514 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:04.768514 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.768514 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.768514 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:04.768514 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.768514 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:04.769461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.769461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:04.769461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:04.769461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:04.769461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.769461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:04.769461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:04.769461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:04.769461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.769461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:04.769461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:04.769461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:04.769461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:04.769461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:04.769461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:04.769885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:04.769885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:04.769885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.769885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:04.769885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.769885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.769885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:04.769885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.769885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:04.770339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.770339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:04.770339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:04.770339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:04.770339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.770339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:04.770339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:04.770339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:04.770339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:04.770339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.770339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:04.770947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:04.770947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:04.770947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.770947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:04.770947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:04.770947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:04.770947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:04.770947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:04.770947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:04.770947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:04.770947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:04.770947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.770947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:04.770947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.771797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.771797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:04.771797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.771797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:04.771797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.771797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:04.771797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:04.771797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:04.771797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:04.771797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:04.771797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.771797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:04.771797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:04.771797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:04.772433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:04.772995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:04.772995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:04.772995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:04.772995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:04.772995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.772995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:04.772995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.772995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.772995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:04.772995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.772995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:04.772995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:04.773497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:04.773497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:04.773497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:04.774024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:04.774221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:04.774504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.775260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:04.775260 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.775260 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:04.775260 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.775260 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.775260 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:04.775260 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.775260 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:04.776145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.776145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:04.776145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:04.776145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:04.776145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.776145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:04.776145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:04.776145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.776145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:04.776145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:04.776145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:04.776145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.776896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:04.776896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:04.776896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:04.776896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:04.776896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:04.776896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:04.776896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:04.776896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:04.776896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.776896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:04.776896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.776896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.776896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:04.777591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.777591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:04.777591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.777591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:04.777591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:04.777591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:04.777591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:04.777591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:04.777591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.777591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:04.777591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:04.777591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.777591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:04.777591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:04.777591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:04.778258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:04.778737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:04.778737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:04.778737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:04.778737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:04.778737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:04.778737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:09.620541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:09.620541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:09.620541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:09.622084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:09.661274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:09.661736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.662492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:09.662492 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.662492 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:09.662492 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.662492 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.662492 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:09.662492 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.662492 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:09.663126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.663126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:09.663126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:09.663126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:09.663126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.663126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:09.663126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:09.663126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.663126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:09.663126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:09.663126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:09.663126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.663496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:09.663496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:09.663496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:09.663496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:09.663496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:09.663496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:09.663496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:09.663496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:09.663496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.663496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:09.663496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.663496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.663496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:09.663881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.663881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:09.663881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.663881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:09.663881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:09.663881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:09.663881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:09.663881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:09.663881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.663881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:09.663881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:09.663881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.663881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:09.663881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:09.663881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:09.664347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.664897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:09.664897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.664897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.664897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:09.664897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.664897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:09.723803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:09.724283 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:09.724503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:09.725315 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:09.725737 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:09.725855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.726493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:09.726493 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.726493 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:09.726493 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.726493 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.726493 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:09.726493 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.726493 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:09.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:09.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:09.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:09.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:09.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:09.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:09.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:09.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:09.727573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.728192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:09.728192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:09.728192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:09.728192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:09.728192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:09.728192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:09.728192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:09.728192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:09.728192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.728192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:09.728192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.728192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.728192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:09.728800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.728800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:09.728800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.728800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:09.728800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:09.728800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:09.728800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:09.728800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:09.728800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.728800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:09.728800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:09.728800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.728800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:09.728800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:09.728800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:09.729546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.731849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:09.731849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.731849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.731849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:09.731849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.731849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:09.757536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:09.758359 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:09.758528 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:09.758633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:39:09.759052 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:09.759274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.759801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:09.759801 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.759801 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:09.759801 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.759801 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.759801 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:09.759801 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.759801 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:09.760585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.760585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:09.760585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:09.760585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:09.760585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.760585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:09.760585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:09.760585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:09.760585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.760585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:09.760585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:09.760585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:09.760585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:09.760585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:09.760585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:09.761903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:09.761903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:09.761903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.761903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:09.761903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.761903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.761903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:09.761903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.761903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:09.761903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.761903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:09.761903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:09.761903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:09.761903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.763257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:09.763257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:09.763257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:39:09.763257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:09.763257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:09.763257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.763257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:09.763257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:09.763257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:09.763257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.763257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:09.763257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:09.763257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:09.763872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:09.763872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:09.763872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:09.763872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:09.763872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:09.763872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.763872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:09.763872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.763872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.763872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:09.763872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.763872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:09.764763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.764763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:09.764763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:09.764763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:09.764763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:09.764763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:09.764763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.764763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:09.764763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:09.764763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.764763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:09.764763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:09.764763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.764763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:09.764763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:09.764763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:09.766449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:09.766936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.766936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:09.766936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.766936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.766936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:09.766936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.766936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:09.766936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:09.766936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:09.766936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:09.767129 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:09.767153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:09.767480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.768023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:09.768023 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.768023 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:09.768023 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.768023 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.768023 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:09.768023 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.768023 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:09.768740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.768740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:09.768740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:09.768740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:09.768740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.768740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:09.768740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:09.768740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:09.768740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.768740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:09.768740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:09.768740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:09.768740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:09.768740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:09.768740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:09.769239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:09.769239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:09.769239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.769239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:09.769239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.769239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.769239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:09.769239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.769239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:09.769676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.769676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:09.769676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:09.769676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:09.769676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.769676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:09.769676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:09.769676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:09.769676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:09.769676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.769676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:09.769906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:09.769906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:09.769906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.769906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:09.769906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:09.769906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:09.769906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:09.769906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:09.769906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:09.769906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:09.769906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:09.769906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.769906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:09.769906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.770161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.770161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:09.770161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.770161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.770796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:09.771180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.771519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.771519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:09.771519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.771519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:09.773153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:09.773346 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:09.773505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:09.773691 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:09.774063 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:09.774321 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:09.774536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.775019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:09.775019 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.775019 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:09.775019 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.775019 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.775019 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:09.775019 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.775019 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:09.775819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.775819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:09.775819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:09.775819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:09.775819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.775819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:09.775819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:09.775819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.775819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:09.775819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:09.775819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:09.775819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.776287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:09.776287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:09.776287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:09.776287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:09.776287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:09.776287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:09.776287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:09.776287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:09.776287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.776287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:09.776287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.776287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.776287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:09.776725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.776725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:09.776834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.776834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:09.776834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:09.776834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:09.776834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:09.776834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:09.776834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.776834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:09.776834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:09.776834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.776834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:09.776834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:09.776834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.776834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:09.776834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:09.776834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:09.777478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:09.778139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:09.778139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:09.778139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:14.619178 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:14.619829 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:14.619877 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:14.620770 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:14.651146 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:14.651700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.652786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:14.652786 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.652786 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:14.652786 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.652786 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.652786 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:14.652786 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.652786 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:14.653585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.653585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:14.653585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:14.653585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:14.653585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.653585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:14.653585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:14.653585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.653585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:14.653585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:14.653585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:14.653585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.654003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:14.654003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:14.654003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:14.654003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:14.654003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:14.654003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:14.654003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:14.654003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:14.654003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.654003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:14.654003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.654003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.654003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:14.654399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.654399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:14.654716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.654716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:14.654716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:14.654716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:14.654716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:14.654716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:14.654716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.654716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:14.654716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:14.654716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.654716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:14.654716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:14.654716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.654716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:14.654716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:14.654716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.655221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.655770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:14.655770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.655770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:14.724436 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:14.725140 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:14.725529 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:14.726465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:14.726916 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:14.727210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.728169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:14.728169 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.728169 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:14.728169 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.728169 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.728169 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:14.728169 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.728169 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:14.730026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.730026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:14.730026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:14.730026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:14.730026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.730026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:14.730026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:14.730026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.730026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:14.730026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:14.730026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:14.730026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.730842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:14.730842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:14.730842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:14.730842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:14.730842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:14.730842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:14.730842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:14.730842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:14.730842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.730842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:14.730842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.730842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.730842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:14.731951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.731951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:14.731951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.731951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:14.731951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:14.731951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:14.731951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:14.731951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:14.731951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.731951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:14.731951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:14.731951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.731951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:14.731951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:14.731951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:14.732722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.733306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:14.733306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.733306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.733306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:14.733306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.733306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:14.758396 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:14.758897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:14.759118 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:14.759309 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:39:14.759822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:14.760053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.760767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:14.760767 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.760767 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:14.760767 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.760767 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.760767 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:14.760767 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.760767 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:14.762055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.762055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:14.762055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:14.762055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:14.762055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.762055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:14.762055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:14.762055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:14.762055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.762055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:14.762055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:14.762055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:14.762055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:14.762055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:14.762055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:14.762533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:14.762533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:14.762533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.762533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:14.762533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.762533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.762533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:14.762533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.762533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:14.763457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.763457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:14.763457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:14.763457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:14.763457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.763457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:14.763457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:14.763457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:39:14.763457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:14.763457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:14.763457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.763457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:14.763856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:14.763856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:14.763856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.763856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:14.763856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:14.763856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:14.763856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:14.763856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:14.763856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:14.763856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:14.763856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:14.763856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.763856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:14.763856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.764208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.764208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:14.764208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.764208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:14.765110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.765110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:14.765110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:14.765110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:14.765110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:14.765110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:14.765110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.765110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:14.765110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:14.765110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.765110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:14.765110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:14.765110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.765110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:14.765110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:14.765110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:14.765585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:14.766154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.766154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:14.766154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.766154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.766154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:14.766154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.766154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:14.766674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:14.766922 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:14.767034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:14.767157 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:14.767539 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:14.767821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.768335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:14.768335 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.768335 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:14.768335 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.768335 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.768335 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:14.768335 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.768335 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:14.769088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.769088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:14.769088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:14.769088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:14.769088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.769088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:14.769088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:14.769088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:14.769088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.769088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:14.769088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:14.769088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:14.769088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:14.769088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:14.769088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:14.769518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:14.769518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:14.769518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.769518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:14.769518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.769518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.769518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:14.769518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.769518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:14.769943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.769943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:14.769943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:14.769943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:14.769943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.769943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:14.769943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:14.769943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:14.769943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:14.769943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.769943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:14.770283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:14.770283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:14.770283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.770283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:14.770283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:14.770283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:14.770283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:14.770283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:14.770283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:14.770283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:14.770283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:14.770283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.770283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:14.770283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.770691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.770691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:14.770691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.770691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.770973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:14.771588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.772161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.772161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:14.772161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.772161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:14.773480 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:14.773815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:14.773815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:14.774636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:14.774636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:14.774731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:14.774873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.775356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:14.775356 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.775356 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:14.775356 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.775356 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.775356 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:14.775356 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.775356 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:14.776215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.776215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:14.776215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:14.776215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:14.776215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.776215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:14.776215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:14.776215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.776215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:14.776215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:14.776215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:14.776215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.776754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:14.776754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:14.776754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:14.776754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:14.776754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:14.776754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:14.776754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:14.776754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:14.776754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.776754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:14.776754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.776754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.776754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:14.777125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.777125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:14.777248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.777248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:14.777248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:14.777248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:14.777248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:14.777248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:14.777248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.777248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:14.777248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:14.777248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.777248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:14.777248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:14.777248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.777248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:14.777248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:14.777248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:14.777719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:14.778432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:14.778432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:14.778432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:19.619733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:19.620522 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:19.620679 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:19.622090 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:19.652229 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:19.652708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.653587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:19.653587 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.653587 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:19.653587 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.653587 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.653587 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:19.653587 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.653587 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:19.654575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.654575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:19.654575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:19.654575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:19.654575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.654575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:19.654575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:19.654575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.654575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:19.654575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:19.654575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:19.654575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.655024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:19.655024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:19.655024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:19.655024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:19.655024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:19.655024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:19.655024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:19.655024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:19.655024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.655024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:19.655024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.655024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.655024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:19.655479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.655479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:19.655641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.655641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:19.655641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:19.655641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:19.655641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:19.655641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:19.655641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.655641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:19.655641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:19.655641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.655641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:19.655641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:19.655641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.655641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:19.655641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:19.655641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.656450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.657416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:19.657416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.657416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:19.725041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:19.725705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:19.725913 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:19.726994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:19.727439 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:19.727782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.728895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:19.728895 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.728895 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:19.728895 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.728895 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.728895 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:19.728895 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.728895 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:19.730412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.730412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:19.730412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:19.730412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:19.730412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.730412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:19.730412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:19.730412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.730412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:19.730412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:19.730412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:19.730412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.730921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:19.730921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:19.730921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:19.730921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:19.730921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:19.730921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:19.730921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:19.730921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:19.730921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.730921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:19.730921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.730921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.730921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:19.731650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.731650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:19.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:19.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:19.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:19.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:19.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:19.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:19.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:19.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:19.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:19.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:19.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:19.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.733168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.734029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:19.734029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.734029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:19.759156 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:19.759663 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:19.759807 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:19.760017 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:39:19.760572 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:19.760851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.761577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:19.761577 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.761577 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:19.761577 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.761577 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.761577 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:19.761577 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.761577 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:19.762711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.762711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:19.762711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:19.762711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:19.762711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.762711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:19.762711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:19.762711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:19.762711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.762711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:19.762711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:19.762711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:19.762711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:19.762711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:19.762711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:19.763620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:19.763620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:19.763620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.763620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:19.763620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.763620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.763620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:19.763620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.763620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:19.764038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.764038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:19.764038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:19.764038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:19.764038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.764038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:19.764038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:19.764038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:39:19.764038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:19.764038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:19.764038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.764038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:19.764572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:19.764572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:19.764572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.764572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:19.764572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:19.764572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:19.764572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:19.764572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:19.764572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:19.764572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:19.764572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:19.764572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.764572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:19.764572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.765092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.765092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:19.765092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.765092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:19.765624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.765624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:19.765624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:19.765624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:19.765624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:19.765624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:19.765624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.765624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:19.765624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:19.765624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.765624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:19.765624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:19.765624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.765624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:19.765624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:19.765624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:19.766118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:19.766845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.766845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:19.766845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.766845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.766845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:19.766845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.766845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:19.767130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:19.767601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:19.767774 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:19.767898 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:19.768396 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:19.768765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.769428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:19.769428 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.769428 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:19.769428 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.769428 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.769428 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:19.769428 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.769428 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:19.770210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.770210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:19.770210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:19.770210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:19.770210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.770210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:19.770210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:19.770210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:19.770210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.770210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:19.770210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:19.770210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:19.770210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:19.770210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:19.770210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:19.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:19.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:19.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:19.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:19.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:19.771236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.771236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:19.771236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:19.771236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:19.771236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.771236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:19.771236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:19.771236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:19.771236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:19.771236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.771236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:19.771742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:19.771742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:19.771742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.771742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:19.771742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:19.771742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:19.771742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:19.771742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:19.771742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:19.771742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:19.771742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:19.771742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.771742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:19.771742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.772121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.772121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:19.772121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.772121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.772722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:19.773286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.773997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.773997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:19.773997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.773997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:19.773997 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:19.774215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:19.774215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:19.774362 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:19.774767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:19.775122 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:19.775358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.776060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:19.776060 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.776060 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:19.776060 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.776060 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.776060 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:19.776060 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.776060 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:19.777136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.777136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:19.777136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:19.777136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:19.777136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.777136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:19.777136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:19.777136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.777136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:19.777136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:19.777136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:19.777136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.777533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:19.777533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:19.777533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:19.777533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:19.777533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:19.777533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:19.777533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:19.777533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:19.777533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.777533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:19.777533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.777533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.777533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:19.777868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.777868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:19.778318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.778318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:19.778318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:19.778318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:19.778318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:19.778318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:19.778318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.778318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:19.778318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:19.778318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.778318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:19.778318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:19.778318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.778318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:19.778318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:19.778318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:19.778831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:19.779419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:19.779419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:19.779419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:24.620640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:24.621360 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:24.621360 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:24.622235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:24.653278 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:24.653727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.654561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:24.654561 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.654561 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:24.654561 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.654561 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.654561 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:24.654561 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.654561 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:24.655498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.655498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:24.655498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:24.655498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:24.655498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.655498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:24.655498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:24.655498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.655498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:24.655498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:24.655498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:24.655498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.655828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:24.655828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:24.655828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:24.655828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:24.655828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:24.655828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:24.655828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:24.655828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:24.655828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.655828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:24.655828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.655828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.655828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:24.656172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.656172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:24.656794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.656794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:24.656794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:24.656794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:24.656794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:24.656794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:24.656794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.656794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:24.656794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:24.656794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.656794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:24.656794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:24.656794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.656794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:24.656794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:24.656794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.657218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.657731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:24.657731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.657731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:24.726337 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:24.726337 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:24.726615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:24.727602 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:24.727942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:24.728331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.729050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:24.729050 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.729050 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:24.729050 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.729050 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.729050 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:24.729050 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.729050 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:24.730647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.730647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:24.730647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:24.730647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:24.730647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.730647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:24.730647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:24.730647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.730647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:24.730647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:24.730647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:24.730647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.731278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:24.731278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:24.731278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:24.731278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:24.731278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:24.731278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:24.731278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:24.731278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:24.731278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.731278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:24.731278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.731278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.731278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:24.731934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.731934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:24.732715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.732715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:24.732715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:24.732715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:24.732715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:24.732715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:24.732715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.732715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:24.732715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:24.732715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.732715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:24.732715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:24.732715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.732715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:24.732715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:24.732715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.733577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.734666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:24.734666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.734666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:24.759815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:24.760283 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:24.760495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:24.760690 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:39:24.761297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:24.762969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.762969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:24.762969 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.762969 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:24.762969 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.762969 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.762969 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:24.762969 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.762969 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:24.763752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.763752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:24.763752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:24.763752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:24.763752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.763752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:24.763752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:24.763752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:24.763752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.763752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:24.763752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:24.763752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:24.763752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:24.763752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:24.763752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:24.764443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:24.764443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:24.764443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.764443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:24.764443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.764443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.764443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:24.764443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.764443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:24.765057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.765057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:24.765057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:24.765057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:24.765057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.765057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:24.765057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:24.765057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:39:24.765057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:24.765057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:24.765057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.765057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:24.765645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:24.765645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:24.765645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.765645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:24.765645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:24.765645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:24.765645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:24.765645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:24.765645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:24.765645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:24.765645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:24.765645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.765645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:24.765645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.766324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.766324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:24.766324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.766324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:24.766775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.766775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:24.766775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:24.766775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:24.766775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:24.766775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:24.766775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.766775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:24.766775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:24.766775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.766775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:24.766775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:24.766775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.766775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:24.766775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:24.766775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:24.767518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:24.768390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.768390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:24.768390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.768390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.768390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:24.768390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.768390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:24.768390 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:24.768390 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:24.768390 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:24.768882 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:24.768882 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:24.768882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.769614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:24.769614 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.769614 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:24.769614 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.769614 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.769614 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:24.769614 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.769614 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:24.770344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.770344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:24.770344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:24.770344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:24.770344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.770344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:24.770344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:24.770344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:24.770344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.770344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:24.770344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:24.770344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:24.770344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:24.770344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:24.770344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:24.771089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:24.771089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:24.771089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.771089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:24.771089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.771089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.771089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:24.771089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.771089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:24.771557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.771557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:24.771557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:24.771557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:24.771557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.771557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:24.771557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:24.771557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:24.771557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:24.771557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.771557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:24.772074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:24.772074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:24.772074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.772074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:24.772074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:24.772074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:24.772074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:24.772074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:24.772074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:24.772074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:24.772074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:24.772074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.772074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:24.772074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.772763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.772763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:24.772763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.772763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:24.772763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.772763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:24.772763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:24.772763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:24.772763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:24.772763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:24.772763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.772763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:24.772763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:24.772763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:24.774313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:24.774313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:24.774313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:24.774313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:24.774313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.774313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:24.774313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.774313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.774313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:24.774313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.774313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:24.774313 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:24.774894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:24.774894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:24.774894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:24.775328 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:24.775726 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:24.775968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.776710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:24.776710 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.776710 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:24.776710 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.776710 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.776710 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:24.776710 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.776710 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:24.777505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.777505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:24.777505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:24.777505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:24.777505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.777505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:24.777505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:24.777505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.777505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:24.777505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:24.777505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:24.777505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.777745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:24.777745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:24.777745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:24.777745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:24.777745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:24.777745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:24.777745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:24.777745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:24.777745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.777745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:24.777745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.777745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.777745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:24.778013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.778013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:24.778474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.778474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:24.778474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:24.778474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:24.778474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:24.778474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:24.778474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.778474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:24.778474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:24.778474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.778474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:24.778474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:24.778474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.778474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:24.778474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:24.778474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:24.778790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:24.779157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:24.779157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:24.779157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:29.621191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:29.622126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:29.622126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:29.622740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:29.653553 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:29.653854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.654589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:29.654589 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.654589 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:29.654589 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.654589 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.654589 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:29.654589 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.654589 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:29.655625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.655625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:29.655625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:29.655625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:29.655625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.655625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:29.655625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:29.655625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.655625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:29.655625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:29.655625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:29.655625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.656844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:29.656844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:29.656844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:29.656844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:29.656844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:29.656844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:29.656844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:29.656844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:29.656844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.656844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:29.656844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.656844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.656844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:29.657550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.657550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:29.657550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.657550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:29.657550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:29.657550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:29.657550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:29.657550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:29.657550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.657550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:29.657550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:29.657550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.657550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:29.657550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:29.657550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:29.658435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.659582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:29.659582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.659582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.659582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:29.659582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.659582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:29.726862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:29.727565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:29.727767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:29.729011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:29.729395 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:29.729731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.730629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:29.730629 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.730629 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:29.730629 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.730629 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.730629 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:29.730629 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.730629 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:29.732167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.732167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:29.732167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:29.732167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:29.732167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.732167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:29.732167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:29.732167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.732167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:29.732167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:29.732167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:29.732167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.732831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:29.732831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:29.732831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:29.732831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:29.732831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:29.732831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:29.732831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:29.732831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:29.732831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.732831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:29.732831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.732831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.732831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:29.733395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.733395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:29.733919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.733919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:29.733919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:29.733919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:29.733919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:29.733919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:29.733919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.733919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:29.733919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:29.733919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.733919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:29.733919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:29.733919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.733919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:29.733919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:29.733919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.734688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.735610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:29.735610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.735610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:29.760485 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:29.761041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:29.761135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:29.761265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:39:29.761759 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:29.762176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.762704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:29.762704 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.762704 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:29.762704 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.762704 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.762704 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:29.762704 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.762704 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:29.763504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.763504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:29.763504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:29.763504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:29.763504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.763504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:29.763504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:29.763504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:29.763504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.763504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:29.763504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:29.763504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:29.763504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:29.763504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:29.763504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:29.764066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:29.764066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:29.764066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.764066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:29.764066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.764066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.764066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:29.764066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.764066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:29.764383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.764383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:29.764383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:29.764383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:29.764383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.764383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:29.764383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:29.764383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:39:29.764383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:29.764383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:29.764383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.764383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:29.764841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:29.764841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:29.764841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.764841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:29.764841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:29.764841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:29.764841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:29.764841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:29.764841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:29.764841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:29.764841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:29.764841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.764841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:29.764841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.765260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.765260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:29.765260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.765260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:29.765260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.765260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:29.765260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:29.765260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:29.765260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:29.765260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:29.765260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.765260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:29.765260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:29.765260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:29.765671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:29.766191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:29.766191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:29.766191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:29.766191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:29.766191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:29.766191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.766191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:29.766191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.766191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.766191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:29.766191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.766191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:29.768044 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:29.768512 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:29.768698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:29.768982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:29.769463 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:29.769840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.770807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:29.770807 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.770807 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:29.770807 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.770807 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.770807 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:29.770807 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.770807 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:29.772276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.772276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:29.772276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:29.772276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:29.772276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.772276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:29.772276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:29.772276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:29.772276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.772276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:29.772276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:29.772276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:29.772276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:29.772276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:29.772276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:29.772775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:29.772775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:29.772775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.772775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:29.772775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.772775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.772775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:29.772775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.772775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:29.774230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.774230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:29.774230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:29.774230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:29.774230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.774230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:29.774230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:29.774230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:29.774230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:29.774230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.774230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:29.774581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:29.774581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:29.774581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.774581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:29.774581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:29.774581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:29.774581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:29.774581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:29.774581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:29.774581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:29.774581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:29.774581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.774581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:29.774581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.774963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.774963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:29.774963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.774963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.776164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:29.776651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.777145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.777145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:29.777145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.777145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:29.777145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:29.777145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:29.777315 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:29.777532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:29.777869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:29.778088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:29.778232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.778886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:29.778886 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.778886 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:29.778886 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.778886 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.778886 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:29.778886 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.778886 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:29.779865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.779865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:29.779865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:29.779865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:29.779865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.779865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:29.779865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:29.779865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.779865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:29.779865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:29.779865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:29.779865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.780222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:29.780222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:29.780222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:29.780222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:29.780222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:29.780222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:29.780222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:29.780222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:29.780222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.780222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:29.780222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.780222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.780222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:29.780557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.780557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:29.780863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.780863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:29.780863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:29.780863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:29.780863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:29.780863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:29.780863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.780863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:29.780863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:29.780863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.780863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:29.780863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:29.780863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.780863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:29.780863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:29.780863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:29.781309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:29.781843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:29.781843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:29.781843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:34.621803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:34.622789 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:34.622789 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:34.623829 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:34.655859 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:34.656279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.658720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:34.658720 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.658720 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:34.658720 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.658720 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.658720 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:34.658720 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.658720 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:34.658720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.658720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:34.658720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:34.658720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:34.658720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.658720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:34.658720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:34.659323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.659323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:34.659323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:34.659323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:34.659323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.659323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:34.659323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:34.659323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:34.659323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:34.659323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:34.659323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:34.659323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:34.659323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:34.659323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.659729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:34.659729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.659729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.659729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:34.659729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.659729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:34.659729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.659729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:34.659729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:34.659729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:34.659729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:34.659729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:34.659729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.659729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:34.660036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:34.660482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:34.660482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:34.660482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.660482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:34.660482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.660482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.660482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:34.660482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.660482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:34.727616 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:34.729173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:34.729173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:34.729852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:34.730227 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:34.730508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.733652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:34.733652 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.733652 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:34.733652 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.733652 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.733652 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:34.733652 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.733652 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:34.733652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.733652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:34.733652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:34.733652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:34.733652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.733652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:34.733652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:34.734130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.734130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:34.734130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:34.734130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:34.734130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.734130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:34.734130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:34.734130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:34.734130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:34.734130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:34.734130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:34.734130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:34.734130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:34.734130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.734528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:34.734528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.734528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.734528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:34.734528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.734528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:34.734528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.734528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:34.734528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:34.734528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:34.734528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:34.734528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:34.734528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.734528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:34.734945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:34.735582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:34.735582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:34.735582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:34.735582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.735582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:34.735582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.735582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.735582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:34.735582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.735582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:34.761278 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:34.762205 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:34.762508 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:34.762772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:39:34.763463 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:34.763681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.766019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:34.766019 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.766019 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:34.766019 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.766019 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.766019 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:34.766019 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.766019 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:34.767311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.767311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:34.767311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:34.767311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:34.767311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.767311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:34.767311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:34.767311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:34.767311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.767311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:34.767311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:34.767311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:34.767311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:34.767311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:34.767311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:34.768226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:34.768226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:34.768226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.768226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:34.768226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.768226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.768226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:34.768226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.768226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:34.768645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.768645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:34.768645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:34.768645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:34.768645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.768645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:34.768645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:34.768645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:39:34.768645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:34.768645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:34.768645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.768645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:34.769047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:34.769047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:34.769047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.769047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:34.769047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:34.769047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:34.769047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:34.769047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:34.769047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:34.769047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:34.769047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:34.769047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.769047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:34.769047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.769447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.769447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:34.769447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.769447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:34.770105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.770105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:34.770105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:34.770105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:34.770105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:34.770105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:34.770105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.770105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:34.770105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:34.770105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.770105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:34.770105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:34.770105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.770105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:34.770105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:34.770105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:34.771044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:34.772455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.772455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:34.772455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.772455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.772455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:34.772455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.772455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:34.772455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:34.772455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:34.772455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:34.772939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:34.772939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:34.772939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.773178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:34.773178 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.773178 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:34.773178 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.773178 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.773178 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:34.773178 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.773178 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:34.773912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.773912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:34.773912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:34.773912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:34.773912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.773912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:34.773912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:34.773912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:34.773912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.773912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:34.773912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:34.773912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:34.773912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:34.773912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:34.773912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:34.774333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:34.774333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:34.774333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.774333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:34.774333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.774333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.774333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:34.774333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.774333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:34.774759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.774759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:34.774759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:34.774759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:34.774759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.774759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:34.774759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:34.774759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:34.774759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:34.774759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.774759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:34.775189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:34.775189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:34.775189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.775189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:34.775189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:34.775189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:34.775189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:34.775189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:34.775189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:34.775189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:34.775189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:34.775189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.775189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:34.775189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.775563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.775563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:34.775563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.775563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.775824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:34.776313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.776841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.776841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:34.776841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.776841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:34.777027 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:34.777252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:34.777351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:34.777538 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:34.777938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:34.778210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:34.778428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.778974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:34.778974 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.778974 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:34.778974 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.778974 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.778974 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:34.778974 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.778974 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:34.779793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.779793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:34.779793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:34.779793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:34.779793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.779793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:34.779793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:34.779793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.779793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:34.779793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:34.779793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:34.779793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:34.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:34.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:34.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:34.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:34.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:34.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:34.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:34.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:34.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:34.780535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.780535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:34.781002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.781002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:34.781002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:34.781002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:34.781002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:34.781002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:34.781002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.781002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:34.781002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:34.781002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.781002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:34.781002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:34.781002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.781002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:34.781002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:34.781002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:34.781481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:34.782005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:34.782005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:34.782005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:39.622689 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:39.623299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:39.623299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:39.624182 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:39.658543 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:39.658936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.659830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:39.659830 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.659830 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:39.659830 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.659830 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.659830 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:39.659830 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.659830 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:39.660911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.660911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:39.660911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:39.660911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:39.660911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.660911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:39.660911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:39.660911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.660911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:39.660911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:39.660911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:39.660911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.661604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:39.661604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:39.661604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:39.661604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:39.661604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:39.661604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:39.661604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:39.661604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:39.661604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.661604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:39.661604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.661604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.661604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:39.662982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.662982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:39.662982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.662982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:39.662982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:39.662982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:39.662982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:39.662982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:39.662982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.662982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:39.662982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:39.662982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.662982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:39.662982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:39.662982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:39.664979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.666044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:39.666044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.666044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.666044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:39.666044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.666044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:39.728635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:39.729257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:39.729583 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:39.730754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:39.731460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:39.731460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:39.732243 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.732243 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:39.732243 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.732243 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.732243 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:39.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.732243 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:39.733708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.733708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:39.733708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:39.733708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:39.733708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.733708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:39.733708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:39.733708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.733708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:39.733708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:39.733708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:39.733708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.734348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:39.734348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:39.734348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:39.734348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:39.734348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:39.734348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:39.734348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:39.734348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:39.734348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.734348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:39.734348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.734348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.734348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:39.734914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.734914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:39.735669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.735669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:39.735669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:39.735669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:39.735669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:39.735669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:39.735669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.735669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:39.735669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:39.735669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.735669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:39.735669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:39.735669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.735669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:39.735669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:39.735669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.736604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.737460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:39.737460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.737460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:39.762295 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:39.762827 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:39.763039 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:39.763247 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:39:39.763752 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:39.763974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.764708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:39.764708 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.764708 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:39.764708 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.764708 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.764708 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:39.764708 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.764708 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:39.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:39.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:39.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:39.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:39.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:39.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:39.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:39.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:39.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:39.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:39.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:39.766278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:39.767305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:39.767305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:39.767305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.767305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:39.767305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.767305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.767305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:39.767305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.767305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:39.767821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.767821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:39.767821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:39.767821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:39.767821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.767821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:39.767821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:39.767821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:39:39.767821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:39.767821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:39.767821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.767821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:39.768578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:39.768578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:39.768578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.768578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:39.768578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:39.768578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:39.768578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:39.768578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:39.768578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:39.768578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:39.768578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:39.768578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.768578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:39.768578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.769188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.769188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:39.769188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.769188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:39.769879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.769879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:39.769879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:39.769879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:39.769879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:39.769879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:39.769879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.769879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:39.769879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:39.769879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.769879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:39.769879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:39.769879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.769879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:39.769879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:39.769879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:39.771350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:39.772608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.772608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:39.772608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.772608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.772608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:39.772608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.772608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:39.772608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:39.772608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:39.772608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:39.773481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:39.773481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:39.773481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.773481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:39.773481 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.773481 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:39.773481 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.773481 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.773481 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:39.773481 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.773481 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:39.774764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.774764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:39.774764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:39.774764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:39.774764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.774764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:39.774764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:39.774764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:39.774764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.774764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:39.774764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:39.774764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:39.774764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:39.774764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:39.774764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:39.775147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:39.775147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:39.775147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.775147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:39.775147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.775147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.775147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:39.775147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.775147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:39.775681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.775681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:39.775681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:39.775681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:39.775681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.775681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:39.775681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:39.775681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:39.775681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:39.775681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.775681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:39.775991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:39.775991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:39.775991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.775991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:39.775991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:39.775991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:39.775991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:39.775991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:39.775991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:39.775991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:39.775991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:39.775991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.775991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:39.775991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.776353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.776353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:39.776353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.776353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.776707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:39.777197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.777693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.777693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:39.777693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.777693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:39.777693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:39.777693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:39.777693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:39.777994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:39.778762 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:39.778994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:39.779182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.779725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:39.779725 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.779725 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:39.779725 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.779725 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.779725 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:39.779725 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.779725 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:39.780610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.780610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:39.780610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:39.780610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:39.780610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.780610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:39.780610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:39.780610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.780610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:39.780610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:39.780610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:39.780610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.780873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:39.780873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:39.780873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:39.780873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:39.780873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:39.780873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:39.780873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:39.780873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:39.780873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.780873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:39.780873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.780873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.780873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:39.781151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.781151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:39.781632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.781632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:39.781632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:39.781632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:39.781632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:39.781632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:39.781632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.781632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:39.781632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:39.781632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.781632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:39.781632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:39.781632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.781632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:39.781632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:39.781632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:39.781926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:39.782337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:39.782337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:39.782337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:44.623312 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:44.624331 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:44.624331 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:44.625267 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:44.657151 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:44.657583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.658481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:44.658481 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.658481 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:44.658481 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.658481 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.658481 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:44.658481 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.658481 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:44.659243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.659243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:44.659243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:44.659243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:44.659243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.659243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:44.659243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:44.659243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.659243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:44.659243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:44.659243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:44.659243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.659907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:44.659907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:44.659907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:44.659907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:44.659907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:44.659907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:44.659907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:44.659907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:44.659907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.659907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:44.659907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.659907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.659907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:44.660590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.660590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:44.660590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.660590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:44.660590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:44.660590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:44.660590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:44.660590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:44.660590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.660590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:44.660590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:44.660590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.660590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:44.660590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:44.660590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:44.661419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.662409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:44.662409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.662409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.662409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:44.662409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.662409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:44.729427 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:44.730011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:44.730095 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:44.730976 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:44.731327 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:44.731619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.732442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:44.732442 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.732442 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:44.732442 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.732442 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.732442 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:44.732442 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.732442 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:44.733227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.733227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:44.733227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:44.733227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:44.733227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.733227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:44.733227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:44.733227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.733227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:44.733227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:44.733227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:44.733227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.733912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:44.733912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:44.733912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:44.733912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:44.733912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:44.733912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:44.733912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:44.733912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:44.733912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.733912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:44.733912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.733912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.733912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:44.734561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.734561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:44.734561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.734561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:44.734561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:44.734561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:44.734561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:44.734561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:44.734561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.734561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:44.734561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:44.734561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.734561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:44.734561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:44.734561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:44.735298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:44.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:44.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:44.762998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:44.763332 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:44.763492 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:44.763610 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:39:44.764136 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:44.764510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.765334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:44.765334 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.765334 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:44.765334 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.765334 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.765334 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:44.765334 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.765334 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:44.766152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.766152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:44.766152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:44.766152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:44.766152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.766152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:44.766152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:44.766152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:44.766152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.766152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:44.766152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:44.766152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:44.766152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:44.766152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:44.766152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:44.767307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:44.767307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:44.767307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.767307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:44.767307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.767307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.767307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:44.767307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.767307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:44.767307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.767307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:44.767307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:44.767307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:44.767307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.768325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:44.768325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:44.768325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:39:44.768325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:44.768325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:44.768325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.768325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:44.768325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:44.768325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:44.768325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.768325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:44.768325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:44.768325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:44.769234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:44.769234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:44.769234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:44.769234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:44.769234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:44.769234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.769234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:44.769234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.769234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.769234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:44.769234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.769234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:44.770019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.770019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:44.770019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:44.770019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:44.770019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:44.770019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:44.770019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.770019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:44.770019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:44.770019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.770019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:44.770019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:44.770019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.770019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:44.770019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:44.770019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:44.771125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:44.772207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.772207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:44.772207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.772207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.772207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:44.772207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.772207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:44.772207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:44.772207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:44.772207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:44.772773 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:44.772773 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:44.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.774024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:44.774024 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.774024 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:44.774024 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.774024 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.774024 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:44.774024 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.774024 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:44.774835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.774835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:44.774835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:44.774835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:44.774835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.774835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:44.774835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:44.774835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:44.774835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.774835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:44.774835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:44.774835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:44.774835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:44.774835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:44.774835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:44.775269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:44.775269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:44.775269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.775269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:44.775269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.775269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.775269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:44.775269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.775269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:44.775737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.775737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:44.775737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:44.775737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:44.775737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.775737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:44.775737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:44.775737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:44.775737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:44.775737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.775737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:44.776074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:44.776074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:44.776074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.776074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:44.776074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:44.776074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:44.776074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:44.776074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:44.776074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:44.776074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:44.776074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:44.776074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.776074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:44.776074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.776460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.776460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:44.776460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.776460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:44.777411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.777927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.777927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:44.777927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.777927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:44.777927 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:44.778263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:44.778421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:44.778593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:44.778894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:44.779123 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:44.779276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.779897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:44.779897 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.779897 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:44.779897 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.779897 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.779897 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:44.779897 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.779897 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:44.780828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.780828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:44.780828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:44.780828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:44.780828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.780828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:44.780828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:44.780828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.780828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:44.780828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:44.780828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:44.780828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.781264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:44.781264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:44.781264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:44.781264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:44.781264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:44.781264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:44.781264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:44.781264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:44.781264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.781264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:44.781264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.781264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.781264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:44.781635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.781635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:44.781838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.781838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:44.781838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:44.781838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:44.781838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:44.781838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:44.781838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.781838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:44.781838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:44.781838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.781838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:44.781838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:44.781838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.781838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:44.781838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:44.781838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:44.782288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:44.782824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:44.782824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:44.782824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:49.623994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:49.624581 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:49.624722 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:49.626000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:49.655592 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:49.655959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.656726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:49.656726 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.656726 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:49.656726 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.656726 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.656726 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:49.656726 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.656726 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:49.657490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.032 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.657490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:49.657490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:49.657490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:49.657490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.657490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:49.657490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:49.657490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.657490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:49.657490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:49.657490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:49.657490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.657861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:49.657861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:49.657861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:49.657861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:49.657861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:49.657861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:49.657861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:49.657861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:49.657861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.657861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:49.657861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.657861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.657861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:49.658218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.658218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:49.658304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.658304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:49.658304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:49.658304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:49.658304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:49.658304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:49.658304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.658304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:49.658304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:49.658304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.658304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:49.658304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:49.658304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.658304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:49.658304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:49.658304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.658732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.659473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:49.659473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.659473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:49.730103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:49.730594 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:49.730795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:49.731683 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:49.731855 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:49.731980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.732743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:49.732743 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.732743 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:49.732743 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.732743 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.732743 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:49.732743 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.732743 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:49.734340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.734340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:49.734340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:49.734340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:49.734340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.734340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:49.734340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:49.734340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.734340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:49.734340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:49.734340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:49.734340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.734999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:49.734999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:49.734999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:49.734999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:49.734999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:49.734999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:49.734999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:49.734999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:49.734999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.734999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:49.734999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.734999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.734999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:49.735724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.735724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:49.736117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.736117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:49.736117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:49.736117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:49.736117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:49.736117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:49.736117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.736117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:49.736117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:49.736117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.736117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:49.736117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:49.736117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.736117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:49.736117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:49.736117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.737867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:49.737867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.737867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:49.763570 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:49.764006 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:49.764494 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:49.764494 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:39:49.765166 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:49.765518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.766344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:49.766344 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.766344 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:49.766344 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.766344 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.766344 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:49.766344 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.766344 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:49.767761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.767761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:49.767761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:49.767761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:49.767761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.767761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:49.767761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:49.767761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:49.767761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.767761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:49.767761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:49.767761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:49.767761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:49.767761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:49.767761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:49.768266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:49.768266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:49.768266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.768266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:49.768266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.768266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.768266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:49.768266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.768266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:49.769282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.769282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:49.769282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:49.769282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:49.769282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.769282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:49.769282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:49.769282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:39:49.769282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:49.769282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:49.769282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.769282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:49.769903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:49.769903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:49.769903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.769903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:49.769903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:49.769903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:49.769903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:49.769903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:49.769903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:49.769903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:49.769903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:49.769903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.769903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:49.769903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.770492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.770492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:49.770492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.770492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:49.770954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.770954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:49.770954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:49.770954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:49.770954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:49.770954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:49.770954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.770954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:49.770954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:49.770954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.770954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:49.770954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:49.770954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.770954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:49.770954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:49.770954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:49.771720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:49.772733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.772733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:49.772733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.772733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.772733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:49.772733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.772733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:49.772733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:49.772733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:49.772733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:49.773407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:49.773407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:49.773407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.774093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:49.774093 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.774093 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:49.774093 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.774093 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.774093 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:49.774093 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.774093 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:49.774843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.774843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:49.774843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:49.774843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:49.774843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.774843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:49.774843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:49.774843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:49.774843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.774843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:49.774843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:49.774843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:49.774843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:49.774843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:49.774843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:49.775653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:49.775653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:49.775653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.775653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:49.775653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.775653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.775653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:49.775653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.775653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:49.776199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.776199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:49.776199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:49.776199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:49.776199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.776199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:49.776199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:49.776199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:49.776199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:49.776199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.776199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:49.776562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:49.776562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:49.776562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.776562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:49.776562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:49.776562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:49.776562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:49.776562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:49.776562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:49.776562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:49.776562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:49.776562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.776562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:49.776562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.776960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.776960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:49.776960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.776960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:49.776960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.776960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:49.776960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:49.776960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:49.776960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:49.776960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:49.776960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.776960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:49.776960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:49.776960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:49.777448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:49.777960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:49.777960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:49.777960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:49.777960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:49.777960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.777960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:49.777960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.777960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.777960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:49.777960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.777960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:49.778251 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:49.779509 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:49.779509 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:49.779509 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:49.779509 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:49.779509 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:49.780452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.780452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:49.780452 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.780452 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:49.780452 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.780452 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.780452 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:49.780452 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.780452 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:49.781248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.781248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:49.781248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:49.781248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:49.781248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.781248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:49.781248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:49.781248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.781248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:49.781248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:49.781248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:49.781248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.781658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:49.781658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:49.781658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:49.781658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:49.781658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:49.781658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:49.781658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:49.781658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:49.781658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.781658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:49.781658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.781658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.781658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:49.782082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.782082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:49.782320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.782320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:49.782320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:49.782320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:49.782320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:49.782320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:49.782320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.782320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:49.782320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:49.782320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.782320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:49.782320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:49.782320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.782320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:49.782320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:49.782320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:49.783872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:49.784336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:49.784336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:49.784336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:54.624718 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:54.625638 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:54.625638 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:54.626862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:54.628620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:39:54.659502 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:54.659703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.660216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:54.660216 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.660216 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:54.660216 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.660216 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.660216 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:54.660216 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.660216 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:54.661082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.661082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:54.661082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:54.661082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:54.661082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.661082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:54.661082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:54.661082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.661082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:54.661082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:54.661082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:54.661082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.661813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:54.661813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:54.661813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:54.661813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:54.661813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:54.661813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:54.661813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:54.661813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:54.661813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.661813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:54.661813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.661813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.661813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:54.662586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.662586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:54.662586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.662586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:54.662586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:54.662586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:54.662586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:54.662586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:54.662586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.662586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:54.662586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:54.662586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.662586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:54.662586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:54.662586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:54.663428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.664418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:54.664418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.664418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.664418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:54.664418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.664418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:54.730737 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:54.731525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:54.731525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:54.732093 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:54.732393 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:54.732648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.733413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:54.733413 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.733413 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:54.733413 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.733413 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.733413 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:54.733413 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.733413 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:54.734767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.734767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:54.734767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:54.734767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:54.734767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.734767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:54.734767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:54.734767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.734767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:54.734767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:54.734767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:54.734767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.735358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:54.735358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:54.735358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:54.735358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:54.735358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:54.735358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:54.735358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:54.735358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:54.735358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.735358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:54.735358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.735358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.735358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:54.737243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.737243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:54.737243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.737243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:54.737243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:54.737243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:54.737243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:54.737243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:54.737243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.737243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:54.737243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:54.737243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.737243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:54.737243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:54.737243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:54.737914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.738763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:54.738763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.738763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.738763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:54.738763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.738763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:54.764193 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:54.764692 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:54.764951 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:54.765120 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:39:54.765678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:54.765886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.766664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:54.766664 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.766664 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:54.766664 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.766664 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.766664 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:54.766664 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.766664 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:54.767769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.767769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:54.767769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:54.767769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:54.767769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.767769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:54.767769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:54.767769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:54.767769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.767769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:54.767769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:54.767769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:54.767769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:54.767769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:54.767769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:54.768272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:54.768272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:54.768272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.768272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:54.768272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.768272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.768272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:54.768272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.768272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:54.769186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.769186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:54.769186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:54.769186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:54.769186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.769186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:54.769186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:54.769186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:39:54.769186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:54.769186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:54.769186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.769186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:54.769667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:54.769667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:54.769667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.769667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:54.769667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:54.769667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:54.769667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:54.769667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:54.769667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:54.769667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:54.769667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:54.769667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.769667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:54.769667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.770075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.770075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:54.770075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.770075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:54.770863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.770863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:54.770863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:54.770863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:54.770863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:54.770863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:54.770863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.770863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:54.770863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:54.770863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.770863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:54.770863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:54.770863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.770863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:54.770863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:54.770863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:54.771563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:54.772437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.772437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:54.772437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.772437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.772437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:54.772437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.772437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:54.772437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:54.773010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:54.773010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:54.773130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:54.773418 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:54.773630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.774028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:54.774028 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.774028 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:54.774028 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.774028 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.774028 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:54.774028 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.774028 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:54.774771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.774771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:54.774771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:54.774771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:54.774771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.774771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:54.774771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:54.774771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:54.774771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.774771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:54.774771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:54.774771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:54.774771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:54.774771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:54.774771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:54.775208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:54.775208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:54.775208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.775208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:54.775208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.775208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.775208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:54.775208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.775208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:54.775610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.775610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:54.775610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:54.775610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:54.775610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.775610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:54.775610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:54.775610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:54.775610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:54.775610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.775610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:54.775946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:54.775946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:54.775946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.775946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:54.775946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:54.775946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:54.775946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:54.775946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:54.775946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:54.775946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:54.775946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:54.775946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.775946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:54.775946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.776332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.776332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:54.776332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.776332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.776643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:54.777122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.777637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.777637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:54.777637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.777637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:54.778623 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:54.778732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:54.778849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:54.778990 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:54.779204 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:54.779446 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:54.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.779981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:54.779981 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.779981 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:54.779981 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.779981 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.779981 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:54.779981 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.779981 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:54.780745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.780745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:54.780745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:54.780745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:54.780745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.780745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:54.780745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:54.780745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.780745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:54.780745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:54.780745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:54.780745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.781146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:54.781146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:54.781146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:54.781146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:54.781146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:54.781146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:54.781146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:54.781146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:54.781146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.781146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:54.781146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.781146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.781146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:54.781506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.781506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:54.781989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.781989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:54.781989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:54.781989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:54.781989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:54.781989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:54.781989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.781989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:54.781989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:54.781989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.781989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:54.781989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:54.781989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.781989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:54.781989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:54.781989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:54.782587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:54.782958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:54.782958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:54.782958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:59.625323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:59.626160 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:59.626233 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:59.627012 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:59.658559 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:59.658956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.659814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:59.659814 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.659814 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:59.659814 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.659814 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.659814 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:59.659814 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.659814 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:59.660565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.660565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:59.660565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:59.660565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:59.660565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.660565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:59.660565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:59.660565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.660565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:59.660565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:59.660565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:59.660565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.661181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:59.661181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:59.661181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:59.661181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:59.661181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:59.661181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:59.661181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:59.661181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:59.661181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.661181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:59.661181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.661181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.661181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:59.661948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.661948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:59.661948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.661948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:59.661948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:59.661948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:59.661948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:59.661948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:59.661948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.661948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:59.661948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:59.661948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.661948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:59.661948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:59.661948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:59.662602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.663413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:59.663413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.663413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.663413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:59.663413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.663413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:59.731265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:59.731990 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:59.732203 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:59.733403 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:59.733718 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:59.733937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.735036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:59.735036 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.735036 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:59.735036 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.735036 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.735036 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:59.735036 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.735036 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:59.736875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.736875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:59.736875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:59.736875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:59.736875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.736875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:59.736875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:59.736875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.736875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:59.736875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:59.736875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:59.736875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.737465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:59.737465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:59.737465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:59.737465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:59.737465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:59.737465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:59.737465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:59.737465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:59.737465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.737465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:59.737465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.737465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.737465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:59.738060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.738060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:59.738602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.738602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:59.738602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:59.738602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:59.738602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:59.738602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:59.738602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.738602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:59.738602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:59.738602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.738602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:59.738602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:59.738602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.738602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:59.738602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:59.738602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.739262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.739931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:59.739931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.739931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:59.764919 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:59.765390 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:59.765604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:59.765815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:39:59.766532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:59.766911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.767825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:59.767825 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.767825 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:59.767825 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.767825 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.767825 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:59.767825 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.767825 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:59.769035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.769035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:59.769035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:59.769035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:59.769035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.769035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:59.769035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:59.769035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:59.769035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.769035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:59.769035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:59.769035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:59.769035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:59.769035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:59.769035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:59.769726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:59.769726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:59.769726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.769726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:59.769726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.769726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.769726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:59.769726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.769726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:59.770392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.770392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:59.770392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:59.770392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:59.770392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.770392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:59.770392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:59.770392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:39:59.770392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:59.770392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:59.770392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.770392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:59.770960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:59.770960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:59.770960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.770960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:59.770960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:59.770960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:59.770960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:59.770960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:59.770960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:59.770960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:59.770960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:59.770960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.770960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:59.770960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.771587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.771587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:59.771587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.771587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:59.772291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.772291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:59.772291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:59.772291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:59.772291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:59.772291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:59.772291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.772291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:59.772291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:59.772291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.772291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:59.772291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:59.772291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.772291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:59.772291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:59.772291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:59.772874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:59.773446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.773446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:59.773446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.773446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.773446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:59.773446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.773446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:59.773446 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:59.773446 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:59.773446 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:59.773716 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:59.773753 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:59.774021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.774562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:59.774562 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.774562 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:59.774562 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.774562 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.774562 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:59.774562 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.774562 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:59.775274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.775274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:39:59.775274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:59.775274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:59.775274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.775274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:59.775274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:59.775274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:59.775274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.775274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:39:59.775274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:59.775274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:39:59.775274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:59.775274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:39:59.775274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:39:59.775671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:59.775671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:39:59.775671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.775671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:39:59.775671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.775671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.775671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:39:59.775671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.775671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:39:59.776438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.776438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:59.776438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:59.776438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:59.776438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.776438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:59.776438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:59.776438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:59.776438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:59.776438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.776438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:59.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:59.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:59.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:59.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:59.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:59.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:59.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:59.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:59.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:59.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:59.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:59.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.777442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.777442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:59.777442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.777442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:59.777442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.777442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:59.777442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:59.777442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:59.777442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:59.777442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:59.777442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.777442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:59.777442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:59.777442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:59.777964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:59.778675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:59.778675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:59.778675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:59.778675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:59.778675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.778675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:59.778675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.778675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.778675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:59.778675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.778675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:39:59.779070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:39:59.779984 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:39:59.780088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:39:59.780248 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:39:59.780620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:59.780896 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:39:59.781025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.781611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:39:59.781611 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.781611 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:39:59.781611 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.781611 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.781611 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:39:59.781611 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.781611 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:39:59.782500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.782500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:39:59.782500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:59.782500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:39:59.782500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.782500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:59.782500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:59.782500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.782500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:59.782500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:59.782500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:59.782500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.782970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:39:59.782970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:59.782970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:39:59.782970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:59.782970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:39:59.782970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:39:59.782970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:59.782970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:39:59.782970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.782970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:39:59.782970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.782970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.782970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:39:59.783488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.783488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:39:59.783488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.783488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:39:59.783488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:39:59.783488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:39:59.783488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:39:59.783488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:39:59.783488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.783488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:39:59.783488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:39:59.783488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.783488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:39:59.783488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:39:59.783488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:39:59.784166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:39:59.785038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:39:59.785038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:39:59.785038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:39:59.785038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:39:59.785038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:39:59.785038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:03.773789 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:03.774355 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_for_inconsistencies {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:03.774569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Checking Neutron and OVN revision consistency. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:03.784185 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:440}}
Apr 24 10:40:03.784319 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=106381) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:419}}
Apr 24 10:40:03.784431 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 412fe0fb-d3c8-41ef-b742-c7e091bf5e56 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:40:03.817171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, resource={'id': '412fe0fb-d3c8-41ef-b742-c7e091bf5e56', 'name': 'private', 'tenant_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'project_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['bedea127-581a-4245-bdcf-823b49c82996', 'd98dd98c-3740-4b7b-9054-95b7f384275a'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:19:49Z', 'updated_at': '2026-04-24T10:19:53Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 21598}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:03.817419 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:03.817836 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-d9e6c44e-2c1f-4e1c-97fa-3abe15d536c8, external_ids_update=None, columns={'tag': 21598}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:03.817960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:03.818507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:03.818507 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:03.818507 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:03.818507 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:03.818507 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:03.818507 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:03.818507 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:03.818507 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:03.819542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 412fe0fb-d3c8-41ef-b742-c7e091bf5e56 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:03.819542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:03.819542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:40:03.819542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:40:03.819542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:40:03.819542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:40:03.819542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:40:03.819542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:03.819542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:03.819542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:03.819542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:03.820060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:03.820060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:03.820060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:03.820060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:03.820060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:03.820060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:03.820060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:03.820060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:03.820060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:03.820060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:03.820060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:03.820060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:03.820060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:03.820060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:03.820699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:03.820699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:03.820699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:03.820699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 86c46bc9-7739-46e7-9c49-62d2723e0d83 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:40:03.850961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, resource={'id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'name': 'public', 'tenant_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'project_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['4daf396b-50dc-4100-9154-fd24fc0e5f1d', '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-24T10:19:55Z', 'updated_at': '2026-04-24T10:20:05Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:03.851343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:03.851979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-b792be55-4fbf-4e4f-a9dc-10cee932ceea, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:03.852347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:03.853092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:03.853092 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:03.853092 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:03.853092 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:03.853092 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:03.853092 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:03.853092 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:03.853092 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:03.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 86c46bc9-7739-46e7-9c49-62d2723e0d83 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:03.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:03.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:40:03.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:40:03.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:40:03.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:40:03.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:40:03.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:03.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:03.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:03.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:03.855114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:03.855114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:03.855114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:03.855114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:03.855114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:03.855114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:03.855114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:03.855114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:03.855114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:03.855114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:03.855114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:03.855114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:03.855114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:03.855114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:03.855976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:03.855976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:03.855976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:03.855976 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 64c3f969-5120-406a-afc1-20f8f45b7533 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:40:03.928623 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-64c3f969-5120-406a-afc1-20f8f45b7533, resource={'id': '64c3f969-5120-406a-afc1-20f8f45b7533', 'name': 'admin_net', 'tenant_id': '91bc93878b40449c8fd1c9924d8a3e8b', 'project_id': '91bc93878b40449c8fd1c9924d8a3e8b', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['18db2f65-6ba9-4ddd-8ab7-55370a16debc'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:23:22Z', 'updated_at': '2026-04-24T10:23:23Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 10837}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:03.928973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-64c3f969-5120-406a-afc1-20f8f45b7533, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:03.929481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-a26d15c8-ce05-4e3e-84bc-9aa33edf96fe, external_ids_update=None, columns={'tag': 10837}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:03.929665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:03.930630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:03.930630 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:03.930630 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:03.930630 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:03.930630 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:03.930630 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:03.930630 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:03.930630 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:03.932152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 64c3f969-5120-406a-afc1-20f8f45b7533 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:03.932152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:03.932152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:40:03.932152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:40:03.932152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:40:03.932152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:40:03.932152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:40:03.932152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:03.932152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:03.932152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:03.932152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:03.932747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:03.932747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:03.932747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:03.932747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:03.932747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:03.932747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:03.932747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:03.932747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:03.932747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:03.932747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:03.932747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:03.932747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:03.932747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:03.932747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:03.933553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:03.933553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:03.933553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:03.933553 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource b30b34a1-477c-4ef7-aea4-d9540988f10a (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:40:03.958635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a, resource={'id': 'b30b34a1-477c-4ef7-aea4-d9540988f10a', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'tenant_id': '277dd31c279b430f90665727a827242c', 'project_id': '277dd31c279b430f90665727a827242c', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['a3090689-5a84-48d5-9685-f418bb1fd559'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:24:04Z', 'updated_at': '2026-04-24T10:24:05Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 23713}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:03.959034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:03.959635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-6d5b7906-0378-49b8-88fc-e9fa642055e4, external_ids_update=None, columns={'tag': 23713}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:03.959825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:03.960655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:03.960655 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:03.960655 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:03.960655 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:03.960655 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:03.960655 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:03.960655 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:03.960655 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:03.961611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource b30b34a1-477c-4ef7-aea4-d9540988f10a (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:03.961611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:03.961611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:40:03.961611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:40:03.961611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:40:03.961611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:40:03.961611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:40:03.961611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:03.961611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:03.961611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:03.961611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:03.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:03.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:03.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:03.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:03.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:03.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:03.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:03.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:03.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:03.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:03.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:03.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:03.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:03.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:03.962919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:03.962919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:03.962919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:03.962919 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 931f18d3-b7f8-4874-928b-3c06d4d5d355 (type: routers) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:40:04.040608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, resource={'id': '931f18d3-b7f8-4874-928b-3c06d4d5d355', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'project_id': '277dd31c279b430f90665727a827242c', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'external_fixed_ips': [{'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7', 'ip_address': '172.24.5.167'}, {'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'ip_address': '2001:db8::1b3'}], 'enable_snat': True}, 'gw_port_id': '77659748-a2b4-448f-aa2d-e166be8f2be9', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-7ytfi', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'external_fixed_ips': [{'ip_address': '172.24.5.167', 'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7'}, {'ip_address': '2001:db8::1b3', 'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-24T10:24:05Z', 'updated_at': '2026-04-24T10:24:08Z', 'revision_number': 3, 'tenant_id': '277dd31c279b430f90665727a827242c'}, resource_type=routers, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:04.040889 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:04.040889 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "77659748-a2b4-448f-aa2d-e166be8f2be9"')], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:04.040889 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "77659748-a2b4-448f-aa2d-e166be8f2be9"')], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:04.041150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.041464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:04.041464 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.041464 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:04.041464 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.041464 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.041464 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:04.041464 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.041464 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:04.041936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Unable to update router 931f18d3-b7f8-4874-928b-3c06d4d5d355. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.042610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 931f18d3-b7f8-4874-928b-3c06d4d5d355 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.042610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:04.042610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:40:04.042610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:40:04.042610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:40:04.042610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:40:04.042610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1634, in update_router
Apr 24 10:40:04.042610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 24 10:40:04.042610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
Apr 24 10:40:04.042610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 24 10:40:04.042610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 24 10:40:04.043347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 24 10:40:04.043347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1568, in update_router
Apr 24 10:40:04.043347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:04.043347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.043347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:04.043347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:04.043347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:04.043347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.043347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:04.043347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:04.043347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:04.043347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:04.043347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:04.043347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:04.043994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:04.043994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:04.043994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.043994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:04.043994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.043994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.043994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:04.043994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.043994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:04.043994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 77659748-a2b4-448f-aa2d-e166be8f2be9 (type: router_ports) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:40:04.142630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, resource={'id': '77659748-a2b4-448f-aa2d-e166be8f2be9', 'name': '', 'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'project_id': '', 'mac_address': 'fa:16:3e:fa:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '931f18d3-b7f8-4874-928b-3c06d4d5d355', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7', 'ip_address': '172.24.5.167'}, {'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'ip_address': '2001:db8::1b3'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000170011', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-24T10:24:06Z', 'updated_at': '2026-04-24T10:24:07Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:04.143104 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7 4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'neutron:network_name': 'neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.167/24', '2001:db8::1b3/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:04.143897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=77659748-a2b4-448f-aa2d-e166be8f2be9, lrouter_port=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:04.144481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.145526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:04.145526 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.145526 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:04.145526 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.145526 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.145526 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:04.145526 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.145526 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:04.146612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 77659748-a2b4-448f-aa2d-e166be8f2be9 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.146612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:04.146612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:40:04.146612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:40:04.146612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:40:04.146612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:40:04.146612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1971, in update_router_port
Apr 24 10:40:04.146612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:04.146612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.146612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:04.146612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:04.147535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:04.147535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.147535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:04.147535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:04.147535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:04.147535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:04.147535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:04.147535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:04.147535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:04.147535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:04.147535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.147535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:04.147535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.147535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.148103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:04.148103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.148103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:04.148103 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_for_inconsistencies finished in 0.372 seconds
Apr 24 10:40:04.626490 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:04.626901 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:04.627080 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:04.627908 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:04.663415 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:04.663700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.664395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:04.664395 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.664395 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:04.664395 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.664395 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.664395 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:04.664395 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.664395 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:04.665391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.665391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:04.665391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:04.665391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:04.665391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.665391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:04.665391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:04.665391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.665391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:04.665391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:04.665391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:04.665391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.666015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:04.666015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:04.666015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:04.666015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:04.666015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:04.666015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:04.666015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:04.666015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:04.666015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.666015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:04.666015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.666015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.666015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:04.666829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.666829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:04.666829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.666829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:04.666829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:04.666829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:04.666829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:04.666829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:04.666829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.666829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:04.666829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:04.666829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.666829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:04.666829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:04.666829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:04.667836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.670612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:04.670612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.670612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.670612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:04.670612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.670612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:04.732161 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:04.732795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:04.732976 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:04.734130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:04.734497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:04.734914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.735937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:04.735937 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.735937 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:04.735937 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.735937 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.735937 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:04.735937 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.735937 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:04.737501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.737501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:04.737501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:04.737501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:04.737501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.737501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:04.737501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:04.737501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.737501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:04.737501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:04.737501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:04.737501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.738797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:04.738797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:04.738797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:04.738797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:04.738797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:04.738797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:04.738797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:04.738797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:04.738797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.738797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:04.738797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.738797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.738797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:04.739779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.739779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:04.739779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.739779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:04.739779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:04.739779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:04.739779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:04.739779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:04.739779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.739779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:04.739779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:04.739779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.739779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:04.739779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:04.739779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:04.740480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.741570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:04.741570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.741570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.741570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:04.741570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.741570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:04.765595 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:04.765995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:04.766163 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:04.766343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:40:04.767114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:04.767493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.768376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:04.768376 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.768376 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:04.768376 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.768376 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.768376 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:04.768376 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.768376 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:04.769724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.769724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:04.769724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:04.769724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:04.769724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.769724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:04.769724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:04.769724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:04.769724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.769724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:04.769724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:04.769724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:04.769724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:04.769724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:04.769724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:04.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:04.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:04.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:04.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:04.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.770704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:04.771800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.771800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:04.771800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:04.771800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:04.771800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.771800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:04.771800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:04.771800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:40:04.771800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:04.771800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:04.771800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.771800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:04.772476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:04.772476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:04.772476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.772476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:04.772476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:04.772476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:04.772476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:04.772476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:04.772476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:04.772476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:04.772476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:04.772476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.772476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:04.772476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.772814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.772814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:04.772814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.772814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:04.772814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.772814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:04.772814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:04.772814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:04.772814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:04.772814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:04.772814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.772814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:04.772814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:04.772814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:04.773170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:04.774847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:04.774847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:04.774847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:04.774847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:04.774847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:04.774847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.774847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:04.774847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.774847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.774847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:04.774847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.774847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:04.774847 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:04.774847 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:04.775632 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:04.775632 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:04.775632 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:04.775632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.775632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:04.775632 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.775632 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:04.775632 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.775632 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.775632 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:04.775632 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.775632 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:04.776189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.776189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:04.776189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:04.776189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:04.776189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.776189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:04.776189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:04.776189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:04.776189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.776189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:04.776189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:04.776189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:04.776189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:04.776189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:04.776189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:04.776573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:04.776573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:04.776573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.776573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:04.776573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.776573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.776573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:04.776573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.776573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:04.776790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.776790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:04.776790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:04.776790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:04.776790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.776790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:04.776790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:04.776790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:04.776790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:04.776790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.776790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:04.777157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:04.777157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:04.777157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.777157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:04.777157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:04.777157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:04.777157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:04.777157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:04.777157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:04.777157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:04.777157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:04.777157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.777157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:04.777157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.778047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.778047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:04.778047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.778047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:04.778047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.778047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:04.778047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:04.778047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:04.778047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:04.778047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:04.778047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.778047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:04.778047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:04.778047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:04.778807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:04.779858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:04.779858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:04.779858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:04.779858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:04.779858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.779858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:04.779858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.779858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.779858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:04.779858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.779858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:04.780314 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:04.780314 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:04.780385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:04.780502 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:04.780906 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:04.781267 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:04.781535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.782216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:04.782216 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.782216 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:04.782216 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.782216 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.782216 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:04.782216 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.782216 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:04.783004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.783004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:04.783004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:04.783004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:04.783004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.783004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:04.783004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:04.783004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.783004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:04.783004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:04.783004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:04.783004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.783252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:04.783252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:04.783252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:04.783252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:04.783252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:04.783252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:04.783252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:04.783252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:04.783252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.783252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:04.783252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.783252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.783252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:04.783492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.783492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:04.783960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.783960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:04.783960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:04.783960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:04.783960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:04.783960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:04.783960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.783960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:04.783960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:04.783960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.783960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:04.783960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:04.783960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.783960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:04.783960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:04.783960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:04.784275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:04.784639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:04.784639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:04.784639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:09.627223 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:09.627807 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:09.627898 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:09.629303 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:09.664591 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:09.665156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.666259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:09.666259 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.666259 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:09.666259 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.666259 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.666259 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:09.666259 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.666259 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:09.667160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.667160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:09.667160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:09.667160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:09.667160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.667160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:09.667160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:09.667160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.667160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:09.667160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:09.667160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:09.667160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.667791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:09.667791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:09.667791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:09.667791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:09.667791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:09.667791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:09.667791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:09.667791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:09.667791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.667791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:09.667791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.667791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.667791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:09.668333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.668333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:09.668333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.668333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:09.668333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:09.668333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:09.668333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:09.668333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:09.668333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.668333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:09.668333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:09.668333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.668333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:09.668333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:09.668333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:09.669003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.669806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:09.669806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.669806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.669806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:09.669806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.669806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:09.732675 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:09.733055 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:09.733254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:09.734670 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:09.735076 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:09.735331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.736386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:09.736386 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.736386 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:09.736386 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.736386 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.736386 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:09.736386 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.736386 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:09.738013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.738013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:09.738013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:09.738013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:09.738013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.738013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:09.738013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:09.738013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.738013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:09.738013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:09.738013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:09.738013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.738351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:09.738351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:09.738351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:09.738351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:09.738351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:09.738351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:09.738351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:09.738351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:09.738351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.738351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:09.738351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.738351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.738351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:09.738749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.738749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:09.739353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.739353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:09.739353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:09.739353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:09.739353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:09.739353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:09.739353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.739353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:09.739353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:09.739353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.739353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:09.739353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:09.739353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.739353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:09.739353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:09.739353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.739952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.740476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:09.740476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.740476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:09.766034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:09.766462 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:09.766624 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:09.766834 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:40:09.767497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:09.767841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.768746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:09.768746 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.768746 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:09.768746 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.768746 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.768746 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:09.768746 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.768746 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:09.769960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.769960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:09.769960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:09.769960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:09.769960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.769960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:09.769960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:09.769960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:09.769960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.769960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:09.769960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:09.769960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:09.769960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:09.769960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:09.769960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:09.770862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:09.770862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:09.770862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.770862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:09.770862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.770862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.770862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:09.770862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.770862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:09.771494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.771494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:09.771494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:09.771494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:09.771494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.771494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:09.771494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:09.771494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:40:09.771494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:09.771494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:09.771494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.771494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:09.772328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:09.772328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:09.772328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.772328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:09.772328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:09.772328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:09.772328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:09.772328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:09.772328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:09.772328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:09.772328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:09.772328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.772328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:09.772328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.773187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.773187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:09.773187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.773187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:09.773187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.773187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:09.773187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:09.773187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:09.773187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:09.773187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:09.773187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.773187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:09.773187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:09.773187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:09.774451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:09.775490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:09.775490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:09.775490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:09.775490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:09.775490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:09.775490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.775490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:09.775490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.775490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.775490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:09.775490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.775490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:09.775490 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:09.775490 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:09.776069 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:09.776069 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:09.776069 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:09.776069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.776069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:09.776069 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.776069 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:09.776069 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.776069 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.776069 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:09.776069 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.776069 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:09.776702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.776702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:09.776702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:09.776702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:09.776702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.776702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:09.776702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:09.776702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:09.776702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.776702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:09.776702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:09.776702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:09.776702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:09.776702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:09.776702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:09.777261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:09.777261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:09.777261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.777261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:09.777261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.777261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.777261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:09.777261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.777261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:09.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:09.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:09.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:09.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:09.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:09.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:09.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:09.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.778077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:09.778580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:09.778580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:09.778580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.778580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:09.778580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:09.778580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:09.778580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:09.778580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:09.778580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:09.778580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:09.778580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:09.778580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.778580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:09.778580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.779119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.779119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:09.779119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.779119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.779390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:09.780030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.780765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.780765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:09.780765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.780765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:09.780765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:09.780765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:09.780765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:09.781071 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:09.781271 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:09.781524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:09.781673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.782257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:09.782257 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.782257 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:09.782257 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.782257 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.782257 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:09.782257 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.782257 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:09.783077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.783077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:09.783077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:09.783077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:09.783077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.783077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:09.783077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:09.783077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.783077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:09.783077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:09.783077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:09.783077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.783467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:09.783467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:09.783467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:09.783467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:09.783467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:09.783467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:09.783467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:09.783467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:09.783467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.783467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:09.783467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.783467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.783467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:09.783844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.783844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:09.784037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.784037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:09.784037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:09.784037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:09.784037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:09.784037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:09.784037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.784037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:09.784037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:09.784037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.784037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:09.784037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:09.784037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.784037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:09.784037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:09.784037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:09.784511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:09.785049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:09.785049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:09.785049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:14.627738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:14.628597 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:14.628597 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:14.629808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:14.669782 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:14.670208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.671267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:14.671267 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.671267 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:14.671267 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.671267 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.671267 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:14.671267 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.671267 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:14.672959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.672959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:14.672959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:14.672959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:14.672959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.672959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:14.672959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:14.672959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.672959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:14.672959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:14.672959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:14.672959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.674622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:14.674622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:14.674622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:14.674622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:14.674622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:14.674622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:14.674622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:14.674622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:14.674622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.674622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:14.674622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.674622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.674622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:14.675321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.675321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:14.675321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.675321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:14.675321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:14.675321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:14.675321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:14.675321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:14.675321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.675321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:14.675321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:14.675321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.675321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:14.675321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:14.675321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:14.676164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.677795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:14.677795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.677795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.677795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:14.677795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.677795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:14.733069 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:14.733322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:14.733507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:14.734795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:14.735271 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:14.735742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.736649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:14.736649 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.736649 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:14.736649 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.736649 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.736649 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:14.736649 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.736649 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:14.737728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.737728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:14.737728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:14.737728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:14.737728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.737728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:14.737728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:14.737728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.737728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:14.737728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:14.737728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:14.737728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.738144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:14.738144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:14.738144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:14.738144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:14.738144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:14.738144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:14.738144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:14.738144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:14.738144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.738144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:14.738144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.738144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.738144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:14.738544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.738544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:14.738746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.738746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:14.738746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:14.738746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:14.738746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:14.738746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:14.738746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.738746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:14.738746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:14.738746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.738746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:14.738746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:14.738746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.738746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:14.738746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:14.738746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.739228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.739803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:14.739803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.739803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:14.766550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:14.766912 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:14.767100 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:14.767286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:40:14.768181 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:14.768544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.769512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:14.769512 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.769512 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:14.769512 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.769512 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.769512 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:14.769512 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.769512 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:14.770674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.770674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:14.770674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:14.770674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:14.770674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.770674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:14.770674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:14.770674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:14.770674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.770674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:14.770674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:14.770674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:14.770674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:14.770674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:14.770674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:14.771730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:14.771730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:14.771730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.771730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:14.771730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.771730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.771730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:14.771730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.771730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:14.772281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.772281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:14.772281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:14.772281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:14.772281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.772281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:14.772281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:14.772281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:40:14.772281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:14.772281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:14.772281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.772281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:14.773048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:14.773048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:14.773048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.773048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:14.773048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:14.773048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:14.773048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:14.773048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:14.773048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:14.773048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:14.773048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:14.773048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.773048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:14.773048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.773791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.773791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:14.773791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.773791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:14.773791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.773791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:14.773791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:14.773791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:14.773791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:14.773791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:14.773791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.773791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:14.773791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:14.773791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:14.774770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:14.775765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:14.775765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:14.775765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:14.775765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:14.775765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:14.775765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.775765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:14.775765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.775765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.775765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:14.775765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.775765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:14.775765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:14.775765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:14.776708 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:14.776708 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:14.776708 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:14.776708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.776708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:14.776708 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.776708 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:14.776708 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.776708 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.776708 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:14.776708 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.776708 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:14.777514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.777514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:14.777514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:14.777514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:14.777514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.777514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:14.777514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:14.777514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:14.777514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.777514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:14.777514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:14.777514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:14.777514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:14.777514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:14.777514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:14.778102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:14.778102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:14.778102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.778102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:14.778102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.778102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.778102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:14.778102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.778102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:14.778102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.778102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:14.778102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:14.778102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:14.778102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.778579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:14.778579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:14.778579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:14.778579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:14.778579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.778579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:14.778579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:14.778579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:14.778579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.778579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:14.778579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:14.778579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:14.778579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:14.778983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:14.778983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:14.778983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:14.778983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:14.778983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.778983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:14.778983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.778983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.778983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:14.778983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.778983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:14.778983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:14.779352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.779967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:14.780937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:14.781197 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:14.781318 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:14.781485 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:14.781831 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:14.782148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:14.782354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.782780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:14.782780 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.782780 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:14.782780 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.782780 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.782780 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:14.782780 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.782780 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:14.783565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.783565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:14.783565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:14.783565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:14.783565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.783565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:14.783565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:14.783565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.783565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:14.783565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:14.783565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:14.783565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.784227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:14.784227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:14.784227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:14.784227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:14.784227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:14.784227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:14.784227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:14.784227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:14.784227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.784227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:14.784227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.784227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.784227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:14.784855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.784855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:14.784855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.784855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:14.784855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:14.784855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:14.784855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:14.784855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:14.784855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.784855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:14.784855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:14.784855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.784855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:14.784855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:14.784855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:14.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:14.786755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:14.786755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:14.786755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:14.786755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:14.786755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:14.786755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:19.628396 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:19.628981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:19.629350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:19.630485 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:19.658982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:19.659400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.660475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:19.660475 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.660475 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:19.660475 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.660475 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.660475 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:19.660475 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.660475 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:19.661249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.031 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.661249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:19.661249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:19.661249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:19.661249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.661249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:19.661249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:19.661249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.661249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:19.661249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:19.661249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:19.661249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.661915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:19.661915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:19.661915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:19.661915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:19.661915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:19.661915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:19.661915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:19.661915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:19.661915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.661915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:19.661915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.661915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.661915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:19.662523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.662523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:19.662523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.662523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:19.662523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:19.662523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:19.662523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:19.662523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:19.662523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.662523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:19.662523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:19.662523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.662523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:19.662523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:19.662523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:19.663210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.664325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:19.664325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.664325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.664325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:19.664325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.664325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:19.733744 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:19.734227 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:19.734336 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:19.735243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:19.735587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:19.735825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.736733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:19.736733 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.736733 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:19.736733 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.736733 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.736733 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:19.736733 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.736733 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:19.737987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.737987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:19.737987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:19.737987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:19.737987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.737987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:19.737987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:19.737987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.737987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:19.737987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:19.737987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:19.737987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.738654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:19.738654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:19.738654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:19.738654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:19.738654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:19.738654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:19.738654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:19.738654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:19.738654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.738654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:19.738654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.738654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.738654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:19.739245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.739245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:19.739245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.739245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:19.739245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:19.739245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:19.739245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:19.739245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:19.739245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.739245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:19.739245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:19.739245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.739245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:19.739245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:19.739245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:19.740174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.741021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:19.741021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.741021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.741021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:19.741021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.741021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:19.767008 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:19.767765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:19.767961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:19.768147 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:40:19.768648 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:19.768914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.770079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:19.770079 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.770079 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:19.770079 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.770079 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.770079 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:19.770079 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.770079 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:19.771681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.771681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:19.771681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:19.771681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:19.771681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.771681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:19.771681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:19.771681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:19.771681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.771681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:19.771681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:19.771681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:19.771681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:19.771681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:19.771681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:19.773059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:19.773059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:19.773059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.773059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:19.773059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.773059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.773059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:19.773059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.773059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:19.773059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.773059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:19.773059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:19.773059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:19.773059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.774149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:19.774149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:19.774149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:40:19.774149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:19.774149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:19.774149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.774149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:19.774149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:19.774149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:19.774149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.774149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:19.774149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:19.774149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:19.775262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:19.775262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:19.775262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:19.775262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:19.775262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:19.775262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.775262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:19.775262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.775262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.775262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:19.775262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.775262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:19.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:19.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:19.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:19.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:19.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:19.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:19.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:19.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:19.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:19.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:19.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:19.776179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:19.776881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:19.777645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.777645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:19.777645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.777645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.777645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:19.777645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.777645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:19.777645 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:19.777645 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:19.777645 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:19.778138 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:19.778138 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:19.778138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.778138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:19.778138 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.778138 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:19.778138 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.778138 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.778138 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:19.778138 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.778138 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:19.778138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:19.778553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.779236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:19.779236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.779236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.779236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:19.779236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.779236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:19.779236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.779236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:19.779236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:19.779236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:19.779236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.779236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:19.779236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:19.779909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:19.779909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:19.779909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.779909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:19.779909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:19.779909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:19.779909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.779909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:19.779909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:19.779909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:19.779909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:19.779909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:19.779909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:19.780425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:19.780425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:19.780425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.780425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:19.780425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.780425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.780425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:19.780425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.780425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:19.780425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.780425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:19.780425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.780808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.781407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:19.781899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:19.781899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:19.781899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:19.781899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:19.782523 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:19.782869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:19.783100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.783841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:19.783841 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.783841 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:19.783841 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.783841 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.783841 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:19.783841 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.783841 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:19.784469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.784469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:19.784469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:19.784469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:19.784469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.784469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:19.784469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:19.784469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.784469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:19.784469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:19.784469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:19.784469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.784825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:19.784825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:19.784825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:19.784825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:19.784825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:19.784825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:19.784825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:19.784825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:19.784825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.784825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:19.784825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.784825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.784825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:19.785103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.785103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:19.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:19.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:19.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:19.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:19.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:19.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:19.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:19.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:19.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:19.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:19.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:19.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:19.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:19.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:19.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:19.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:24.629152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:24.630071 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:24.630249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:24.631670 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:24.664688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:24.665199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.666202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:24.666202 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.666202 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:24.666202 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.666202 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.666202 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:24.666202 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.666202 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:24.667307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.667307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:24.667307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:24.667307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:24.667307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.667307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:24.667307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:24.667307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.667307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:24.667307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:24.667307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:24.667307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.667955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:24.667955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:24.667955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:24.667955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:24.667955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:24.667955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:24.667955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:24.667955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:24.667955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.667955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:24.667955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.667955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.667955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:24.668564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.668564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:24.668564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.668564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:24.668564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:24.668564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:24.668564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:24.668564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:24.668564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.668564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:24.668564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:24.668564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.668564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:24.668564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:24.668564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:24.669218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.670067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:24.670067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.670067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.670067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:24.670067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.670067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:24.734603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:24.735218 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:24.735535 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:24.736785 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:24.737190 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:24.737468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.738420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:24.738420 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.738420 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:24.738420 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.738420 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.738420 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:24.738420 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.738420 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:24.739852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.739852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:24.739852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:24.739852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:24.739852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.739852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:24.739852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:24.739852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.739852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:24.739852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:24.739852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:24.739852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.740510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:24.740510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:24.740510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:24.740510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:24.740510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:24.740510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:24.740510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:24.740510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:24.740510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.740510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:24.740510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.740510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.740510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:24.741105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.741105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:24.741508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.741508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:24.741508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:24.741508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:24.741508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:24.741508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:24.741508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.741508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:24.741508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:24.741508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.741508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:24.741508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:24.741508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.741508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:24.741508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:24.741508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.742512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.743437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:24.743437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.743437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:24.767713 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:24.768129 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:24.768310 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:24.768523 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:40:24.769148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:24.769522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.770432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:24.770432 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.770432 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:24.770432 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.770432 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.770432 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:24.770432 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.770432 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:24.771639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.771639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:24.771639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:24.771639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:24.771639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.771639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:24.771639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:24.771639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:24.771639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.771639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:24.771639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:24.771639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:24.771639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:24.771639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:24.771639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:24.772336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:24.772336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:24.772336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.772336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:24.772336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.772336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.772336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:24.772336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.772336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:24.772966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.772966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:24.772966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:24.772966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:24.772966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.772966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:24.772966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:24.772966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:40:24.772966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:24.772966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:24.772966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.772966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:24.773559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:24.773559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:24.773559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.773559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:24.773559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:24.773559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:24.773559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:24.773559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:24.773559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:24.773559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:24.773559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:24.773559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.773559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:24.773559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.774171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.774171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:24.774171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.774171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:24.774639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.774639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:24.774639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:24.774639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:24.774639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:24.774639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:24.774639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.774639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:24.774639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:24.774639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.774639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:24.774639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:24.774639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.774639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:24.774639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:24.774639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:24.775241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:24.775863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.775863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:24.775863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.775863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.775863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:24.775863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.775863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:24.775863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:24.775863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:24.775863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:24.776153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:24.776508 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:24.776966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.777842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:24.777842 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.777842 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:24.777842 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.777842 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.777842 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:24.777842 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.777842 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:24.778601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.778601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:24.778601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:24.778601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:24.778601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.778601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:24.778601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:24.778601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:24.778601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.778601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:24.778601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:24.778601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:24.778601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:24.778601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:24.778601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:24.779010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:24.779010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:24.779010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.779010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:24.779010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.779010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.779010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:24.779010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.779010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:24.779450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.779450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:24.779450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:24.779450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:24.779450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.779450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:24.779450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:24.779450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:24.779450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:24.779450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.779450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:24.779767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:24.779767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:24.779767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.779767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:24.779767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:24.779767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:24.779767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:24.779767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:24.779767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:24.779767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:24.779767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:24.779767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.779767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:24.779767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.780135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.780135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:24.780135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.780135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.780468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:24.781050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.781599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.781599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:24.781599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.781599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:24.781804 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:24.782024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:24.782125 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:24.782296 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:24.783460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:24.783460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:24.783460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.784000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:24.784000 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.784000 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:24.784000 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.784000 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.784000 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:24.784000 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.784000 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:24.784794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.784794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:24.784794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:24.784794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:24.784794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.784794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:24.784794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:24.784794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.784794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:24.784794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:24.784794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:24.784794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.785167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:24.785167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:24.785167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:24.785167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:24.785167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:24.785167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:24.785167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:24.785167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:24.785167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.785167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:24.785167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.785167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.785167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:24.785507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.785507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:24.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:24.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:24.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:24.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:24.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:24.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:24.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:24.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:24.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:24.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:24.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:24.785912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:24.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:24.787660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:24.787660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:24.787660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:29.630766 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:29.632470 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:29.632470 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:29.634490 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:29.673686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:29.674178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.675260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:29.675260 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.675260 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:29.675260 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.675260 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.675260 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:29.675260 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.675260 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:29.676392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.676392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:29.676392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:29.676392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:29.676392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.676392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:29.676392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:29.676392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.676392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:29.676392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:29.676392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:29.676392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.677067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:29.677067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:29.677067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:29.677067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:29.677067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:29.677067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:29.677067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:29.677067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:29.677067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.677067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:29.677067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.677067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.677067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:29.677576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.677576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:29.677675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.677675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:29.677675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:29.677675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:29.677675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:29.677675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:29.677675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.677675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:29.677675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:29.677675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.677675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:29.677675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:29.677675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.677675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:29.677675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:29.677675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.678238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.678799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:29.678799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.678799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:29.735337 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:29.735993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:29.736073 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:29.737346 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:29.737683 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:29.737911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.738665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:29.738665 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.738665 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:29.738665 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.738665 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.738665 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:29.738665 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.738665 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:29.740331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.740331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:29.740331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:29.740331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:29.740331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.740331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:29.740331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:29.740331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.740331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:29.740331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:29.740331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:29.740331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.740768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:29.740768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:29.740768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:29.740768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:29.740768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:29.740768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:29.740768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:29.740768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:29.740768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.740768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:29.740768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.740768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.740768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:29.741138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.741138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:29.742481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.742481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:29.742481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:29.742481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:29.742481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:29.742481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:29.742481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.742481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:29.742481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:29.742481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.742481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:29.742481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:29.742481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.742481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:29.742481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:29.742481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.742976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.743626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:29.743626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.743626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:29.768498 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:29.768698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:29.768763 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:29.769036 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:40:29.769755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:29.770029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.771065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:29.771065 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.771065 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:29.771065 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.771065 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.771065 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:29.771065 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.771065 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:29.772171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.772171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:29.772171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:29.772171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:29.772171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.772171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:29.772171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:29.772171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:29.772171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.772171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:29.772171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:29.772171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:29.772171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:29.772171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:29.772171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:29.772925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:29.772925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:29.772925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.772925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:29.772925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.772925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.772925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:29.772925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.772925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:29.774681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.774681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:29.774681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:29.774681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:29.774681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.774681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:29.774681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:29.774681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:40:29.774681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:29.774681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:29.774681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.774681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:29.775304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:29.775304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:29.775304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.775304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:29.775304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:29.775304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:29.775304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:29.775304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:29.775304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:29.775304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:29.775304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:29.775304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.775304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:29.775304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.775920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.775920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:29.775920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.775920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:29.776936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.776936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:29.776936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:29.776936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:29.776936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:29.776936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:29.776936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.776936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:29.776936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:29.776936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.776936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:29.776936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:29.776936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.776936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:29.776936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:29.776936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:29.777689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:29.778523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.778523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:29.778523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.778523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.778523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:29.778523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.778523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:29.778523 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:29.778523 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:29.778523 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:29.778978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:29.778978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:29.778978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.779569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:29.779569 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.779569 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:29.779569 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.779569 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.779569 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:29.779569 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.779569 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:29.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:29.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:29.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:29.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:29.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:29.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:29.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:29.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:29.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:29.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:29.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:29.780162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:29.780614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:29.780614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:29.780614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.780614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:29.780614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.780614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.780614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:29.780614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.780614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:29.780961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.780961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:29.780961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:29.780961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:29.780961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.780961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:29.780961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:29.780961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:29.780961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:29.780961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.780961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:29.781323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:29.781323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:29.781323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.781323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:29.781323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:29.781323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:29.781323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:29.781323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:29.781323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:29.781323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:29.781323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:29.781323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.781323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:29.781323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.781728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.781728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:29.781728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.781728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.782031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:29.782618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.783284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.783284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:29.783284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.783284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:29.783284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:29.783284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:29.783284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:29.783284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:29.783587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:29.783587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:29.783720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.784395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:29.784395 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.784395 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:29.784395 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.784395 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.784395 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:29.784395 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.784395 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:29.785121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.785121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:29.785121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:29.785121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:29.785121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.785121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:29.785121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:29.785121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.785121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:29.785121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:29.785121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:29.785121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:29.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:29.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:29.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:29.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:29.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:29.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:29.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:29.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:29.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.785538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:29.785951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.785951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:29.786102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.786102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:29.786102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:29.786102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:29.786102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:29.786102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:29.786102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.786102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:29.786102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:29.786102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.786102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:29.786102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:29.786102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.786102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:29.786102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:29.786102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:29.786490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:29.786857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:29.786857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:29.786857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:34.632239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:34.633261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:34.633261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:34.634149 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:34.667959 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:34.668356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.669229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:34.669229 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.669229 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:34.669229 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.669229 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.669229 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:34.669229 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.669229 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:34.670221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.670221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:34.670221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:34.670221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:34.670221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.670221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:34.670221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:34.670221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.670221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:34.670221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:34.670221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:34.670221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.670906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:34.670906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:34.670906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:34.670906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:34.670906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:34.670906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:34.670906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:34.670906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:34.670906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.670906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:34.670906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.670906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.670906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:34.671625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.671625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:34.671625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.671625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:34.671625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:34.671625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:34.671625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:34.671625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:34.671625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.671625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:34.671625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:34.671625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.671625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:34.671625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:34.671625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:34.672443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.673427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:34.673427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.673427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.673427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:34.673427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.673427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:34.736034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:34.736505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:34.736686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:34.737716 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:34.738092 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:34.738343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.739274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:34.739274 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.739274 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:34.739274 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.739274 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.739274 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:34.739274 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.739274 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:34.740667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.740667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:34.740667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:34.740667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:34.740667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.740667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:34.740667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:34.740667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.740667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:34.740667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:34.740667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:34.740667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.741230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:34.741230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:34.741230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:34.741230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:34.741230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:34.741230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:34.741230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:34.741230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:34.741230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.741230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:34.741230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.741230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.741230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:34.741840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.741840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:34.742266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.742266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:34.742266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:34.742266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:34.742266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:34.742266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:34.742266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.742266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:34.742266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:34.742266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.742266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:34.742266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:34.742266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.742266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:34.742266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:34.742266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.743819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:34.743819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.743819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:34.768869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:34.769189 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:34.769280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:34.769421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:40:34.769998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:34.770323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.771074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:34.771074 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.771074 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:34.771074 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.771074 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.771074 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:34.771074 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.771074 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:34.772079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.772079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:34.772079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:34.772079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:34.772079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.772079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:34.772079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:34.772079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:34.772079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.772079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:34.772079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:34.772079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:34.772079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:34.772079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:34.772079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:34.772828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:34.772828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:34.772828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.772828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:34.772828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.772828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.772828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:34.772828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.772828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:34.773346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.773346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:34.773346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:34.773346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:34.773346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.773346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:34.773346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:34.773346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:40:34.773346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:34.773346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:34.773346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.773346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:34.773961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:34.773961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:34.773961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.773961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:34.773961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:34.773961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:34.773961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:34.773961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:34.773961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:34.773961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:34.773961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:34.773961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.773961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:34.773961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.774579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.774579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:34.774579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.774579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:34.774960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.774960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:34.774960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:34.774960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:34.774960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:34.774960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:34.774960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.774960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:34.774960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:34.774960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.774960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:34.774960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:34.774960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.774960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:34.774960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:34.774960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:34.775724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:34.776538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.776538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:34.776538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.776538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.776538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:34.776538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.776538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:34.777711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:34.778085 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:34.778269 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:34.778504 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:34.778943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:34.779179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.779792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:34.779792 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.779792 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:34.779792 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.779792 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.779792 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:34.779792 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.779792 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:34.780750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.780750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:34.780750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:34.780750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:34.780750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.780750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:34.780750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:34.780750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:34.780750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.780750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:34.780750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:34.780750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:34.780750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:34.780750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:34.780750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:34.781162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:34.781162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:34.781162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.781162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:34.781162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.781162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.781162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:34.781162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.781162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:34.781593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.781593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:34.781593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:34.781593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:34.781593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.781593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:34.781593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:34.781593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:34.781593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:34.781593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.781593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:34.782041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:34.782041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:34.782041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.782041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:34.782041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:34.782041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:34.782041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:34.782041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:34.782041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:34.782041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:34.782041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:34.782041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.782041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:34.782041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.782450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.782450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:34.782450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.782450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.782641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:34.783125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.783642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.783642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:34.783642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.783642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:34.783642 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:34.783642 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:34.783642 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:34.783642 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:34.783903 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:34.783984 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:34.784137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.784695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:34.784695 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.784695 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:34.784695 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.784695 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.784695 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:34.784695 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.784695 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:34.785495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.785495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:34.785495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:34.785495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:34.785495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.785495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:34.785495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:34.785495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.785495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:34.785495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:34.785495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:34.785495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.785878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:34.785878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:34.785878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:34.785878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:34.785878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:34.785878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:34.785878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:34.785878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:34.785878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.785878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:34.785878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.785878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.785878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:34.786232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.786232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:34.786497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.786497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:34.786497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:34.786497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:34.786497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:34.786497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:34.786497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.786497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:34.786497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:34.786497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.786497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:34.786497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:34.786497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.786497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:34.786497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:34.786497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:34.786917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:34.787395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:34.787395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:34.787395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:39.632970 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:39.634114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:39.634114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:39.634974 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:39.673203 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:39.673821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.674841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:39.674841 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.674841 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:39.674841 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.674841 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.674841 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:39.674841 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.674841 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:39.676346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.676346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:39.676346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:39.676346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:39.676346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.676346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:39.676346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:39.676346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.676346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:39.676346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:39.676346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:39.676346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.677581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:39.677581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:39.677581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:39.677581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:39.677581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:39.677581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:39.677581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:39.677581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:39.677581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.677581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:39.677581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.677581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.677581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:39.678560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.678560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:39.678560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.678560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:39.678560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:39.678560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:39.678560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:39.678560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:39.678560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.678560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:39.678560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:39.678560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.678560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:39.678560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:39.678560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:39.679925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.681677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:39.681677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.681677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.681677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:39.681677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.681677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:39.736679 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:39.737296 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:39.737653 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:39.738809 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:39.738939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:39.739072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.739531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:39.739531 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.739531 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:39.739531 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.739531 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.739531 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:39.739531 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.739531 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:39.740514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.740514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:39.740514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:39.740514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:39.740514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.740514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:39.740514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:39.740514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.740514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:39.740514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:39.740514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:39.740514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.741600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:39.741600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:39.741600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:39.741600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:39.741600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:39.741600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:39.741600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:39.741600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:39.741600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.741600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:39.741600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.741600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.741600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:39.742164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.742164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:39.742164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.742164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:39.742164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:39.742164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:39.742164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:39.742164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:39.742164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.742164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:39.742164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:39.742164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.742164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:39.742164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:39.742164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:39.742858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.743737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:39.743737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.743737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.743737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:39.743737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.743737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:39.769466 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:39.770096 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:39.770389 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:39.770706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:40:39.771188 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:39.771442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.772311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:39.772311 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.772311 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:39.772311 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.772311 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.772311 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:39.772311 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.772311 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:39.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:39.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:39.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:39.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:39.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:39.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:39.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:39.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:39.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:39.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:39.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:39.773128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:39.774950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:39.774950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:39.774950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.774950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:39.774950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.774950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.774950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:39.774950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.774950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:39.774950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.774950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:39.774950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:39.774950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:39.774950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.776325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:39.776325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:39.776325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:40:39.776325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:39.776325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:39.776325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.776325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:39.776325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:39.776325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:39.776325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.776325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:39.776325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:39.776325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:39.777438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:39.777438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:39.777438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:39.777438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:39.777438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:39.777438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.777438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:39.777438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.777438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.777438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:39.777438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.777438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:39.778093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.778093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:39.778093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:39.778093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:39.778093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:39.778093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:39.778093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.778093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:39.778093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:39.778093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.778093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:39.778093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:39.778093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.778093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:39.778093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:39.778093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:39.778965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:39.781151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.781151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:39.781151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.781151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.781151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:39.781151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.781151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:39.781151 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:39.781151 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:39.781151 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:39.782269 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:39.782269 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:39.782269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.782269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:39.782269 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.782269 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:39.782269 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.782269 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.782269 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:39.782269 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.782269 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:39.782269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:39.782815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.783128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:39.783128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.783128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.783128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:39.783128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.783128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:39.783128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.783128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:39.783128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:39.783128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:39.783128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.783128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:39.783128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:39.783407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:39.783407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:39.783407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.783407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:39.783407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:39.783407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:39.783407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.783407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:39.783407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:39.783407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:39.783407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:39.783407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:39.783407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:39.783631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:39.783631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:39.783631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.783631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:39.783631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.783631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.783631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:39.783631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.783631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:39.783631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.783631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:39.783631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.783922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.784242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:39.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:39.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:39.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:39.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:39.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:39.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:39.785991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.785991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:39.785991 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.785991 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:39.785991 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.785991 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.785991 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:39.785991 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.785991 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:39.786912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.786912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:39.786912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:39.786912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:39.786912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.786912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:39.786912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:39.786912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.786912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:39.786912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:39.786912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:39.786912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.787418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:39.787418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:39.787418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:39.787418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:39.787418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:39.787418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:39.787418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:39.787418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:39.787418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.787418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:39.787418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.787418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.787418 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:39.787911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.787911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:39.788028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.788028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:39.788028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:39.788028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:39.788028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:39.788028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:39.788028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.788028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:39.788028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:39.788028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.788028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:39.788028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:39.788028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.788028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:39.788028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:39.788028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:39.788341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:39.788749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:39.788749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:39.788749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:44.633670 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:44.634617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:44.634617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:44.635844 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:44.667201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:44.667506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.668129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:44.668129 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.668129 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:44.668129 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.668129 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.668129 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:44.668129 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.668129 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:44.669114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.669114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:44.669114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:44.669114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:44.669114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.669114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:44.669114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:44.669114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.669114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:44.669114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:44.669114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:44.669114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.669963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:44.669963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:44.669963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:44.669963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:44.669963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:44.669963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:44.669963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:44.669963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:44.669963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.669963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:44.669963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.669963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.669963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:44.670727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.670727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:44.670727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.670727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:44.670727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:44.670727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:44.670727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:44.670727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:44.670727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.670727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:44.670727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:44.670727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.670727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:44.670727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:44.670727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:44.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.672602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:44.672602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.672602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.672602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:44.672602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.672602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:44.737341 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:44.737896 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:44.737993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:44.738885 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:44.739233 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:44.739520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.740360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:44.740360 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.740360 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:44.740360 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.740360 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.740360 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:44.740360 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.740360 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:44.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:44.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:44.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:44.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:44.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:44.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:44.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:44.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:44.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.742249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:44.742249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:44.742249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:44.742249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:44.742249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:44.742249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:44.742249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:44.742249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:44.742249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.742249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:44.742249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.742249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.742249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:44.742612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.742612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:44.742612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.742612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:44.742612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:44.742612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:44.742612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:44.742612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:44.742612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.742612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:44.742612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:44.742612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.742612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:44.742612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:44.742612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:44.742888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.743252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:44.743252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.743252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.743252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:44.743252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.743252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:44.770039 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:44.770626 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:44.770857 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:44.771150 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:40:44.771862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:44.772203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.773082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:44.773082 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.773082 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:44.773082 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.773082 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.773082 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:44.773082 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.773082 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:44.774696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.774696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:44.774696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:44.774696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:44.774696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.774696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:44.774696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:44.774696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:44.774696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.774696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:44.774696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:44.774696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:44.774696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:44.774696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:44.774696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:44.776249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:44.776249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:44.776249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.776249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:44.776249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.776249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.776249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:44.776249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.776249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:44.777068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.777068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:44.777068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:44.777068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:44.777068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.777068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:44.777068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:44.777068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:40:44.777068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:44.777068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:44.777068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.777068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:44.777965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:44.777965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:44.777965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.777965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:44.777965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:44.777965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:44.777965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:44.777965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:44.777965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:44.777965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:44.777965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:44.777965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.777965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:44.777965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.779942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.779942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:44.779942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.779942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:44.779942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.779942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:44.779942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:44.779942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:44.779942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:44.779942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:44.779942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.779942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:44.779942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:44.779942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:44.781213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:44.781997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:44.781997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:44.781997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:44.781997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:44.781997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:44.781997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.781997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:44.781997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.781997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.781997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:44.781997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.781997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:44.781997 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:44.781997 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:44.782608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:44.782608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:44.782608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:44.782608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.782608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:44.782608 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.782608 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:44.782608 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.782608 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.782608 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:44.782608 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.782608 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:44.783237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.783237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:44.783237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:44.783237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:44.783237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.783237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:44.783237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:44.783237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:44.783237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.783237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:44.783237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:44.783237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:44.783237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:44.783237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:44.783237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:44.784049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:44.784049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:44.784049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.784049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:44.784049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.784049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.784049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:44.784049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.784049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:44.784332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.784332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:44.784332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:44.784332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:44.784332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.784332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:44.784332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:44.784332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:44.784332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:44.784332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.784332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:44.784595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:44.784595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:44.784595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.784595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:44.784595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:44.784595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:44.784595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:44.784595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:44.784595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:44.784595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:44.784595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:44.784595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.784595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:44.784595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.784925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.784925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:44.784925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.784925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:44.784925 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.785630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:44.786137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.786526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.786526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:44.786526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.786526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:44.786526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:44.786526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:44.786526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:44.786526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:44.786896 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:44.787116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.787849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:44.787849 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.787849 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:44.787849 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.787849 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.787849 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:44.787849 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.787849 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:44.788588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.788588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:44.788588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:44.788588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:44.788588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.788588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:44.788588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:44.788588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.788588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:44.788588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:44.788588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:44.788588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.789666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:44.789666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:44.789666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:44.789666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:44.789666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:44.789666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:44.789666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:44.789666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:44.789666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.789666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:44.789666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.789666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.789666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:44.790250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.790250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:44.790250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.790250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:44.790250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:44.790250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:44.790250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:44.790250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:44.790250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.790250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:44.790250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:44.790250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.790250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:44.790250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:44.790250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:44.790654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:44.791077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:44.791077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:44.791077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:44.791077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:44.791077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:44.791077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:49.634148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:49.635135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:49.635135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:49.635829 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:49.673842 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:49.674276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.675641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:49.675641 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.675641 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:49.675641 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.675641 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.675641 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:49.675641 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.675641 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:49.676695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.676695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:49.676695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:49.676695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:49.676695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.676695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:49.676695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:49.676695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.676695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:49.676695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:49.676695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:49.676695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.677612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:49.677612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:49.677612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:49.677612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:49.677612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:49.677612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:49.677612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:49.677612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:49.677612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.677612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:49.677612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.677612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.677612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:49.679840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.679840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:49.679840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.679840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:49.679840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:49.679840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:49.679840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:49.679840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:49.679840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.679840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:49.679840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:49.679840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.679840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:49.679840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:49.679840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:49.680929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.681867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:49.681867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.681867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.681867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:49.681867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.681867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:49.737883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:49.738344 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:49.738613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:49.739657 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:49.739900 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:49.740058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.740823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:49.740823 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.740823 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:49.740823 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.740823 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.740823 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:49.740823 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.740823 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:49.742299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.742299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:49.742299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:49.742299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:49.742299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.742299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:49.742299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:49.742299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.742299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:49.742299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:49.742299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:49.742299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.742678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:49.742678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:49.742678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:49.742678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:49.742678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:49.742678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:49.742678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:49.742678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:49.742678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.742678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:49.742678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.742678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.742678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:49.743122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.743122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:49.744223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.744223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:49.744223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:49.744223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:49.744223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:49.744223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:49.744223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.744223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:49.744223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:49.744223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.744223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:49.744223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:49.744223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.744223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:49.744223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:49.744223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.744829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.745736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:49.745736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.745736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:49.770660 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:49.771254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:49.771482 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:49.771754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:40:49.772400 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:49.772821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.773766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:49.773766 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.773766 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:49.773766 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.773766 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.773766 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:49.773766 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.773766 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:49.775312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.775312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:49.775312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:49.775312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:49.775312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.775312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:49.775312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:49.775312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:49.775312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.775312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:49.775312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:49.775312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:49.775312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:49.775312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:49.775312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:49.776357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:49.776357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:49.776357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.776357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:49.776357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.776357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.776357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:49.776357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.776357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:49.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:49.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:49.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:49.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:49.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:49.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:40:49.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:49.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:49.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.777631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:49.778544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:49.778544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:49.778544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.778544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:49.778544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:49.778544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:49.778544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:49.778544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:49.778544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:49.778544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:49.778544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:49.778544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.778544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:49.778544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.779549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.779549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:49.779549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.779549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:49.779930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.779930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:49.779930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:49.779930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:49.779930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:49.779930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:49.779930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.779930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:49.779930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:49.779930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.779930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:49.779930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:49.779930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.779930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:49.779930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:49.779930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:49.780551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:49.781144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.781144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:49.781144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.781144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.781144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:49.781144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.781144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:49.781144 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:49.781144 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:49.781534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:49.781534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:49.781793 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:49.782044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.782639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:49.782639 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.782639 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:49.782639 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.782639 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.782639 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:49.782639 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.782639 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:49.783325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.783325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:49.783325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:49.783325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:49.783325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.783325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:49.783325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:49.783325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:49.783325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.783325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:49.783325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:49.783325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:49.783325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:49.783325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:49.783325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:49.783873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:49.783873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:49.783873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.783873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:49.783873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.783873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.783873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:49.783873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.783873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:49.784287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.784287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:49.784287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:49.784287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:49.784287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.784287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:49.784287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:49.784287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:49.784287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:49.784287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.784287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:49.784670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:49.784670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:49.784670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.784670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:49.784670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:49.784670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:49.784670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:49.784670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:49.784670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:49.784670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:49.784670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:49.784670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.784670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:49.784670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.785070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.785070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:49.785070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.785070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.785192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:49.785731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.786252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.786252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:49.786252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.786252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:49.786252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:49.786252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:49.786252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:49.786252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:49.786675 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:49.786937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:49.787179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.787694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:49.787694 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.787694 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:49.787694 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.787694 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.787694 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:49.787694 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.787694 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:49.788381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.788381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:49.788381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:49.788381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:49.788381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.788381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:49.788381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:49.788381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.788381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:49.788381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:49.788381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:49.788381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.788858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:49.788858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:49.788858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:49.788858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:49.788858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:49.788858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:49.788858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:49.788858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:49.788858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.788858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:49.788858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.788858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.788858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:49.789229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.789229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:49.789296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.789296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:49.789296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:49.789296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:49.789296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:49.789296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:49.789296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.789296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:49.789296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:49.789296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.789296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:49.789296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:49.789296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.789296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:49.789296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:49.789296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:49.789850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:49.790483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:49.790483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:49.790483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:54.635116 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:54.635943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:54.635943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:54.637161 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:54.639177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=434 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:40:54.675493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:54.676550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.679654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:54.679654 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.679654 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:54.679654 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.679654 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.679654 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:54.679654 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.679654 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:54.679654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.679654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:54.679654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:54.679654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:54.679654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.679654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:54.679654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:54.680172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.680172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:54.680172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:54.680172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:54.680172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.680172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:54.680172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:54.680172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:54.680172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:54.680172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:54.680172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:54.680172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:54.680172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:54.680172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.680588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:54.680588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.680588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.680588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:54.680588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.680588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:54.680588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.680588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:54.680588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:54.680588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:54.680588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:54.680588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:54.680588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.680588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:54.680959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:54.681504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:54.681504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:54.681504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.681504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:54.681504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.681504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.681504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:54.681504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.681504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:54.738838 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:54.739844 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:54.740247 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:54.741624 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:54.741850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:54.742080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.746224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:54.746224 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.746224 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:54.746224 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.746224 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.746224 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:54.746224 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.746224 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:54.746224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.746224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:54.746224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:54.746224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:54.746224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.746224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:54.746224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:54.746914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.746914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:54.746914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:54.746914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:54.746914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.746914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:54.746914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:54.746914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:54.746914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:54.746914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:54.746914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:54.746914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:54.746914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:54.746914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.747378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:54.747378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.747378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.747378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:54.747378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.747378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:54.747378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.747378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:54.747378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:54.747378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:54.747378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:54.747378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:54.747378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.747378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:54.747798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:54.748341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:54.748341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:54.748341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:54.748341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.748341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:54.748341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.748341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.748341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:54.748341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.748341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:54.771613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:54.772804 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:54.773065 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:54.773291 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:40:54.774235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:54.774619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.775613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:54.775613 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.775613 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:54.775613 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.775613 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.775613 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:54.775613 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.775613 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:54.777529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.777529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:54.777529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:54.777529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:54.777529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.777529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:54.777529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:54.777529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:54.777529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.777529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:54.777529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:54.777529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:54.777529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:54.777529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:54.777529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:54.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:54.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:54.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:54.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:54.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:54.778689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.778689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:54.778689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:54.778689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:54.778689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.778689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:54.778689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:54.778689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:40:54.778689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:54.778689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:54.778689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.778689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:54.779051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:54.779051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:54.779051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.779051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:54.779051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:54.779051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:54.779051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:54.779051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:54.779051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:54.779051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:54.779051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:54.779051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.779051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:54.779051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.779464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.779464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:54.779464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.779464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:54.779791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.779791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:54.779791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:54.779791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:54.779791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:54.779791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:54.779791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.779791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:54.779791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:54.779791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.779791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:54.779791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:54.779791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.779791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:54.779791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:54.779791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:54.780258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:54.780807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.780807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:54.780807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.780807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.780807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:54.780807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.780807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:54.781127 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:54.781477 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:54.781588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:54.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:54.782303 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:54.782558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.783246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:54.783246 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.783246 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:54.783246 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.783246 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.783246 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:54.783246 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.783246 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:54.784142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.784142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:54.784142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:54.784142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:54.784142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.784142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:54.784142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:54.784142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:54.784142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.784142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:54.784142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:54.784142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:54.784142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:54.784142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:54.784142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:54.784575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:54.784575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:54.784575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.784575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:54.784575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.784575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.784575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:54.784575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.784575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:54.785123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.785123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:54.785123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:54.785123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:54.785123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.785123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:54.785123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:54.785123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:54.785123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:54.785123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.785123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:54.785480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:54.785480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:54.785480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.785480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:54.785480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:54.785480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:54.785480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:54.785480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:54.785480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:54.785480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:54.785480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:54.785480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.785480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:54.785480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.785861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.785861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:54.785861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.785861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.786431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:54.786920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.787459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.787459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:54.787459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.787459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:54.787459 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:54.787459 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:54.787459 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:54.787459 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:54.787709 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:54.787709 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:54.787781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.788268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:54.788268 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.788268 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:54.788268 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.788268 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.788268 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:54.788268 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.788268 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:54.789174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.789174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:54.789174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:54.789174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:54.789174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.789174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:54.789174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:54.789174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.789174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:54.789174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:54.789174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:54.789174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.789735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:54.789735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:54.789735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:54.789735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:54.789735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:54.789735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:54.789735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:54.789735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:54.789735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.789735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:54.789735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.789735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.789735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:54.790176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.790176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:54.790176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.790176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:54.790176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:54.790176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:54.790176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:54.790176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:54.790176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.790176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:54.790176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:54.790176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.790176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:54.790176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:54.790176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:54.790758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:54.791555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:54.791555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:54.791555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:54.791555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:54.791555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:54.791555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:59.635866 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:59.636784 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:59.637068 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:59.639072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:59.674017 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:59.674262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.675289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:59.675289 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.675289 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:59.675289 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.675289 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.675289 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:59.675289 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.675289 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:59.676150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.676150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:59.676150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:59.676150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:59.676150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.676150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:59.676150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:59.676150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.676150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:59.676150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:59.676150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:59.676150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.676971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:59.676971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:59.676971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:59.676971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:59.676971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:59.676971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:59.676971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:59.676971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:59.676971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.676971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:59.676971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.676971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.676971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:59.677676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.677676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:59.677676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.677676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:59.677676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:59.677676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:59.677676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:59.677676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:59.677676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.677676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:59.677676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:59.677676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.677676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:59.677676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:59.677676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:59.678484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.679356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:59.679356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.679356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.679356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:59.679356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.679356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:59.740104 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:59.740921 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:59.741099 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:59.742151 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:59.742418 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:59.742650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.743411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:59.743411 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.743411 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:59.743411 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.743411 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.743411 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:59.743411 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.743411 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:59.744967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.744967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:59.744967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:59.744967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:59.744967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.744967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:59.744967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:59.744967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.744967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:59.744967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:59.744967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:59.744967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.745828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:59.745828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:59.745828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:59.745828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:59.745828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:59.745828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:59.745828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:59.745828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:59.745828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.745828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:59.745828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.745828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.745828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:59.746699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.746699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:59.746699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.746699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:59.746699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:59.746699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:59.746699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:59.746699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:59.746699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.746699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:59.746699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:59.746699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.746699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:59.746699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:59.746699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:59.747653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.748652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:59.748652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.748652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.748652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:59.748652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.748652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:59.772561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:59.773215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:59.773469 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:59.773675 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:40:59.774565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:59.774966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.775961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:59.775961 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.775961 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:59.775961 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.775961 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.775961 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:59.775961 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.775961 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:59.777306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.777306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:59.777306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:59.777306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:59.777306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.777306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:59.777306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:59.777306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:59.777306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.777306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:59.777306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:59.777306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:59.777306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:59.777306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:59.777306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:59.778176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:59.778176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:59.778176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.778176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:59.778176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.778176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.778176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:59.778176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.778176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:59.778744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.778744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:59.778744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:59.778744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:59.778744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.778744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:59.778744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:59.778744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:40:59.778744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:59.778744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:59.778744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.778744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:59.779461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:59.779461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:59.779461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.779461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:59.779461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:59.779461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:59.779461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:59.779461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:59.779461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:59.779461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:59.779461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:59.779461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.779461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:59.779461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.780181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.780181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:59.780181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.780181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:59.780831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.780831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:59.780831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:59.780831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:59.780831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:59.780831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:59.780831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.780831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:59.780831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:59.780831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.780831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:59.780831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:59.780831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.780831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:59.780831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:59.780831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:59.781910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:59.782857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.782857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:59.782857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.782857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.782857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:59.782857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.782857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:59.782857 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:59.782857 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:59.782857 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:59.783382 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:59.783716 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:59.784201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.784936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:59.784936 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.784936 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:59.784936 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.784936 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.784936 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:59.784936 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.784936 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:59.785498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.785498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:40:59.785498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:59.785498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:59.785498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.785498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:59.785498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:59.785498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:59.785498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.785498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:40:59.785498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:59.785498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:40:59.785498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:59.785498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:40:59.785498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:40:59.785910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:59.785910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:40:59.785910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.785910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:40:59.785910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.785910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.785910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:40:59.785910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.785910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:40:59.786158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.786158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:59.786158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:59.786158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:59.786158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.786158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:59.786158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:59.786158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:59.786158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:59.786158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.786158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:59.786515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:59.786515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:59.786515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.786515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:59.786515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:59.786515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:59.786515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:59.786515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:59.786515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:59.786515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:59.786515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:59.786515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.786515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:59.786515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.786979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.786979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:59.786979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.786979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:59.786979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.786979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:59.786979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:59.786979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:59.786979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:59.786979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:59.786979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.786979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:59.786979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:59.786979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:59.787358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:59.787934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:59.787934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:59.787934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:59.787934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:59.787934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.787934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:59.787934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.787934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.787934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:59.787934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.787934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:40:59.787934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:40:59.787934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:40:59.788406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:40:59.788406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:40:59.788406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:59.788531 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:40:59.788685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.789283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:40:59.789283 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.789283 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:40:59.789283 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.789283 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.789283 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:40:59.789283 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.789283 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:40:59.789903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.789903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:40:59.789903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:59.789903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:40:59.789903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.789903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:59.789903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:59.789903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.789903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:59.789903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:59.789903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:59.789903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.790254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:40:59.790254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:59.790254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:40:59.790254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:59.790254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:40:59.790254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:40:59.790254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:59.790254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:40:59.790254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.790254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:40:59.790254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.790254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.790254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:40:59.790670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.790670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:40:59.790670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.790670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:40:59.790670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:40:59.790670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:40:59.790670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:40:59.790670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:40:59.790670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.790670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:40:59.790670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:40:59.790670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.790670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:40:59.790670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:40:59.790670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:40:59.791090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:40:59.791639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:40:59.791639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:40:59.791639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:40:59.791639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:40:59.791639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:40:59.791639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:04.636692 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:04.637702 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:04.637702 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:04.638649 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:04.675948 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:04.676325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.677309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:04.677309 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.677309 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:04.677309 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.677309 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.677309 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:04.677309 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.677309 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:04.678427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.678427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:04.678427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:04.678427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:04.678427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.678427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:04.678427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:04.678427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.678427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:04.678427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:04.678427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:04.678427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.679173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:04.679173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:04.679173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:04.679173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:04.679173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:04.679173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:04.679173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:04.679173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:04.679173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.679173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:04.679173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.679173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.679173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:04.679952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.679952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:04.679952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.679952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:04.679952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:04.679952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:04.679952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:04.679952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:04.679952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.679952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:04.679952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:04.679952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.679952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:04.679952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:04.679952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:04.680857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.681888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:04.681888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.681888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.681888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:04.681888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.681888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:04.740739 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:04.741308 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:04.741637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:04.742591 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:04.742794 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:04.742908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.743459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:04.743459 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.743459 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:04.743459 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.743459 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.743459 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:04.743459 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.743459 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:04.744472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.744472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:04.744472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:04.744472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:04.744472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.744472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:04.744472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:04.744472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.744472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:04.744472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:04.744472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:04.744472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.744879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:04.744879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:04.744879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:04.744879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:04.744879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:04.744879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:04.744879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:04.744879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:04.744879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.744879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:04.744879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.744879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.744879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:04.745250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.745250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:04.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:04.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:04.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:04.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:04.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:04.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:04.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:04.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:04.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:04.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:04.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:04.745793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.746294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.747256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:04.747256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.747256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:04.773017 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:04.773491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:04.773755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:04.774006 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:41:04.774791 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:04.775205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.776812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:04.776812 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.776812 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:04.776812 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.776812 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.776812 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:04.776812 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.776812 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:04.778101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.778101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:04.778101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:04.778101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:04.778101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.778101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:04.778101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:04.778101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:04.778101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.778101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:04.778101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:04.778101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:04.778101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:04.778101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:04.778101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:04.778922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:04.778922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:04.778922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.778922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:04.778922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.778922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.778922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:04.778922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.778922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:04.779353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.779353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:04.779353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:04.779353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:04.779353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.779353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:04.779353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:04.779353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:41:04.779353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:04.779353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:04.779353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.779353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:04.779908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:04.779908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:04.779908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.779908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:04.779908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:04.779908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:04.779908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:04.779908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:04.779908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:04.779908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:04.779908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:04.779908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.779908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:04.779908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.780587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.780587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:04.780587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.780587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:04.781768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.781768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:04.781768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:04.781768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:04.781768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:04.781768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:04.781768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.781768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:04.781768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:04.781768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.781768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:04.781768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:04.781768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.781768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:04.781768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:04.781768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:04.782471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:04.783234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.783234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:04.783234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.783234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.783234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:04.783234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.783234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:04.783234 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:04.783234 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:04.783234 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:04.783742 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:04.783742 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:04.783742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.783897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:04.783897 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.783897 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:04.783897 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.783897 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.783897 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:04.783897 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.783897 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:04.784854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.784854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:04.784854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:04.784854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:04.784854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.784854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:04.784854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:04.784854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:04.784854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.784854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:04.784854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:04.784854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:04.784854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:04.784854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:04.784854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:04.785763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:04.785763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:04.785763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.785763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:04.785763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.785763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.785763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:04.785763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.785763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:04.786159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.786159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:04.786159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:04.786159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:04.786159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.786159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:04.786159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:04.786159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:04.786159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:04.786159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.786159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:04.786756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:04.786756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:04.786756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.786756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:04.786756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:04.786756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:04.786756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:04.786756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:04.786756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:04.786756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:04.786756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:04.786756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.786756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:04.786756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.787386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.787386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:04.787386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.787386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:04.787386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.787386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:04.787386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:04.787386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:04.787386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:04.787386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:04.787386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.787386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:04.787386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:04.787386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:04.787989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:04.789085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:04.789085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:04.789085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:04.789085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:04.789085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.789085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:04.789085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.789085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.789085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:04.789085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.789085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:04.789085 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:04.789085 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:04.789693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:04.789693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:04.789693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:04.789693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:04.789693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.789693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:04.789693 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.789693 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:04.789693 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.789881 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.789881 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:04.789881 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.789881 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:04.790161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.790161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:04.790161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:04.790161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:04.790161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.790161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:04.790161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:04.790161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.790161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:04.790161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:04.790161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:04.790161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.790428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:04.790428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:04.790428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:04.790428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:04.790428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:04.790428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:04.790428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:04.790428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:04.790428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.790428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:04.790428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.790428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.790428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:04.790692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.790692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:04.791091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.791091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:04.791091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:04.791091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:04.791091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:04.791091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:04.791091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.791091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:04.791091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:04.791091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.791091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:04.791091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:04.791091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.791091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:04.791091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:04.791091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:04.791645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:04.792093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:04.792093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:04.792093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:09.637457 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:09.638359 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:09.638359 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:09.639527 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:09.678252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:09.678832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.679897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:09.679897 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.679897 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:09.679897 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.679897 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.679897 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:09.679897 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.679897 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:09.680987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.680987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:09.680987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:09.680987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:09.680987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.680987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:09.680987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:09.680987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.680987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:09.680987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:09.680987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:09.680987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.681736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:09.681736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:09.681736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:09.681736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:09.681736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:09.681736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:09.681736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:09.681736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:09.681736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.681736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:09.681736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.681736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.681736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:09.682463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.682463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:09.682463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.682463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:09.682463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:09.682463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:09.682463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:09.682463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:09.682463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.682463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:09.682463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:09.682463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.682463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:09.682463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:09.682463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:09.683402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.684507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:09.684507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.684507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.684507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:09.684507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.684507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:09.741501 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:09.741852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:09.741958 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:09.743245 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:09.743704 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:09.743978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.745013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:09.745013 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.745013 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:09.745013 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.745013 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.745013 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:09.745013 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.745013 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:09.767477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.767477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:09.767477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:09.767477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:09.767477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.767477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:09.767477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:09.767477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.767477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:09.767477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:09.767477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:09.767477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.768194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:09.768194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:09.768194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:09.768194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:09.768194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:09.768194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:09.768194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:09.768194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:09.768194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.768194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:09.768194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.768194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.768194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:09.768672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.768672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:09.768672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.768672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:09.768672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:09.768672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:09.768672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:09.768672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:09.768672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.768672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:09.768672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:09.768672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.768672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:09.768672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:09.768672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:09.768957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.769313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:09.769313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.769313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.769313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:09.769313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.769313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:09.773385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:09.773777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:09.773994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:09.774179 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:41:09.774866 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:09.775134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.775903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:09.775903 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.775903 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:09.775903 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.775903 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.775903 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:09.775903 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.775903 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:09.777209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.777209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:09.777209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:09.777209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:09.777209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.777209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:09.777209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:09.777209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:09.777209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.777209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:09.777209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:09.777209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:09.777209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:09.777209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:09.777209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:09.777647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:09.777647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:09.777647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.777647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:09.777647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.777647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.777647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:09.777647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.777647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:09.778635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.778635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:09.778635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:09.778635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:09.778635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.778635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:09.778635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:09.778635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:41:09.778635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:09.778635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:09.778635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.778635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:09.778992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:09.778992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:09.778992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.778992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:09.778992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:09.778992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:09.778992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:09.778992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:09.778992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:09.778992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:09.778992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:09.778992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.778992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:09.778992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.779346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.779346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:09.779346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.779346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:09.780381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.780381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:09.780381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:09.780381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:09.780381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:09.780381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:09.780381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.780381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:09.780381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:09.780381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.780381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:09.780381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:09.780381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.780381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:09.780381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:09.780381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:09.780853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:09.781350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.781350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:09.781350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.781350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.781350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:09.781350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.781350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:09.782461 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:09.782754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:09.782865 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:09.782992 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:09.783475 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:09.783729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.784354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:09.784354 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.784354 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:09.784354 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.784354 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.784354 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:09.784354 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.784354 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:09.785450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.785450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:09.785450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:09.785450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:09.785450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.785450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:09.785450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:09.785450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:09.785450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.785450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:09.785450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:09.785450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:09.785450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:09.785450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:09.785450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:09.785900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:09.785900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:09.785900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.785900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:09.785900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.785900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.785900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:09.785900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.785900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:09.786769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.786769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:09.786769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:09.786769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:09.786769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.786769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:09.786769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:09.786769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:09.786769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:09.786769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.786769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:09.787100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:09.787100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:09.787100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.787100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:09.787100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:09.787100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:09.787100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:09.787100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:09.787100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:09.787100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:09.787100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:09.787100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.787100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:09.787100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.787518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.787518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:09.787518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.787518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.788498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:09.788964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.789476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.789476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:09.789476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.789476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:09.789476 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:09.789476 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:09.789476 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:09.789682 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:09.790075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:09.790455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:09.790703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.791617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:09.791617 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.791617 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:09.791617 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.791617 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.791617 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:09.791617 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.791617 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:09.792588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.792588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:09.792588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:09.792588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:09.792588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.792588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:09.792588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:09.792588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.792588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:09.792588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:09.792588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:09.792588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.793066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:09.793066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:09.793066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:09.793066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:09.793066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:09.793066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:09.793066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:09.793066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:09.793066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.793066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:09.793066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.793066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.793066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:09.793474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.793474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:09.793474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.793474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:09.793474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:09.793474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:09.793474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:09.793474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:09.793474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.793474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:09.793474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:09.793474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.793474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:09.793474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:09.793474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:09.794044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:09.794622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:09.794622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:09.794622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:09.794622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:09.794622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:09.794622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:14.638078 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:14.638887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:14.638887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:14.640031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:14.673062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:14.673522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.674384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:14.674384 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.674384 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:14.674384 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.674384 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.674384 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:14.674384 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.674384 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:14.675393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.675393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:14.675393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:14.675393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:14.675393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.675393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:14.675393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:14.675393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.675393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:14.675393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:14.675393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:14.675393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.676242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:14.676242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:14.676242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:14.676242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:14.676242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:14.676242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:14.676242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:14.676242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:14.676242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.676242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:14.676242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.676242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.676242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:14.676917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.676917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:14.676917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.676917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:14.676917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:14.676917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:14.676917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:14.676917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:14.676917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.676917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:14.676917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:14.676917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.676917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:14.676917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:14.676917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:14.677802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.679245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:14.679245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.679245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.679245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:14.679245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.679245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:14.742150 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:14.742732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:14.743002 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:14.773885 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:14.783049 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:14.783049 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:14.783049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.783049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:14.783049 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.783049 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:14.783049 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.783049 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.783049 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:14.783049 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.783049 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:14.784321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.784321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:14.784321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:14.784321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:14.784321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.784321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:14.784321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:14.784321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.784321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:14.784321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:14.784321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:14.784321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.786006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:14.786006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:14.786006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:14.786006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:14.786006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:14.786006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:14.786006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:14.786006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:14.786006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.786006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:14.786006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.786006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.786006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:14.786674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.786674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:14.786674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:14.786674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.786674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:14.786674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:14.786674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:14.786674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:14.786674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:14.786674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.786674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:14.786674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:14.786674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:14.787315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:14.788307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:14.788307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:14.788307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.788307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:14.788307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.788307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.788307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:14.788307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.788307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:14.788307 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:14.788307 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:14.788307 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:41:14.788967 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:14.788967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.788967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:14.788967 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.788967 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:14.788967 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.788967 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.788967 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:14.788967 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.788967 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:14.788967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.788967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:14.788967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:14.788967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.789702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:14.790572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.790572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:14.790572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.790572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:14.790572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:14.790572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:14.790572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.790572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:14.790572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:14.790572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:41:14.790572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:14.790572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:14.791048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.791048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:14.791048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:14.791048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:14.791048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.791048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:14.791048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:14.791048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:14.791048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:14.791048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:14.791048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:14.791048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:14.791048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:14.791048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.791696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:14.791696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.791696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.791696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:14.791696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.791696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:14.791696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.791696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:14.791696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:14.791696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:14.791696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:14.791696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:14.791696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.791696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.792260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:14.792976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:14.792976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:14.792976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:14.792976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:14.792976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:14.792976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:14.792976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:14.792976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.792976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:14.792976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.792976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.792976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:14.792976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.792976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:14.792976 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:14.793532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:14.793532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:14.793532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:14.793532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:14.793532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.793762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:14.793762 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.793762 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:14.793762 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.793762 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.793762 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:14.793762 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.793762 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:14.794512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.794512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:14.794512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:14.794512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:14.794512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.794512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:14.794512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:14.794512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:14.794512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.794512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:14.794512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:14.794512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:14.794512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:14.794512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:14.794512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:14.794817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:14.794817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:14.794817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.794817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:14.794817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.794817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.794817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:14.794817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.794817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:14.795437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.795437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:14.795437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:14.795437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:14.795437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.795437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:14.795437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:14.795437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:14.795437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:14.795437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.795437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:14.795679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:14.795679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:14.795679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.795679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:14.795679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:14.795679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:14.795679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:14.795679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:14.795679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:14.795679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:14.795679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:14.795679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.795679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:14.795679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.795986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.795986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:14.795986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.795986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.796536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:14.796889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.797294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.797294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:14.797294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.797294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:14.797294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:14.797294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:14.797294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:14.797474 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:14.797783 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:14.797953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.798652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:14.798652 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.798652 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:14.798652 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.798652 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.798652 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:14.798652 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.798652 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:14.799532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.799532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:14.799532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:14.799532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:14.799532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.799532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:14.799532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:14.799532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.799532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:14.799532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:14.799532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:14.799532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.799797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:14.799797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:14.799797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:14.799797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:14.799797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:14.799797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:14.799797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:14.799797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:14.799797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.799797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:14.799797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.799797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.799797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:14.800077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.800077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:14.800516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.800516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:14.800516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:14.800516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:14.800516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:14.800516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:14.800516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.800516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:14.800516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:14.800516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.800516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:14.800516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:14.800516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.800516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:14.800516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:14.800516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:14.800826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:14.801231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:14.801231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:14.801231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:19.638664 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:19.639598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:19.639598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:19.640958 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:19.675289 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:19.675818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.676776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:19.676776 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.676776 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:19.676776 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.676776 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.676776 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:19.676776 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.676776 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:19.677942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.677942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:19.677942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:19.677942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:19.677942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.677942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:19.677942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:19.677942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.677942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:19.677942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:19.677942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:19.677942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.678591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:19.678591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:19.678591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:19.678591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:19.678591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:19.678591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:19.678591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:19.678591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:19.678591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.678591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:19.678591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.678591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.678591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:19.679707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.679707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:19.679707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.679707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:19.679707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:19.679707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:19.679707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:19.679707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:19.679707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.679707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:19.679707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:19.679707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.679707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:19.679707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:19.679707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:19.680185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.680810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:19.680810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.680810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.680810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:19.680810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.680810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:19.742765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:19.743254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:19.743609 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:19.744846 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:19.745218 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:19.745490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.746475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:19.746475 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.746475 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:19.746475 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.746475 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.746475 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:19.746475 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.746475 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:19.748576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.748576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:19.748576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:19.748576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:19.748576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.748576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:19.748576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:19.748576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.748576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:19.748576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:19.748576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:19.748576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.749560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:19.749560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:19.749560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:19.749560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:19.749560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:19.749560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:19.749560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:19.749560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:19.749560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.749560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:19.749560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.749560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.749560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:19.750550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.750550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:19.751148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.751148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:19.751148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:19.751148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:19.751148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:19.751148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:19.751148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.751148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:19.751148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:19.751148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.751148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:19.751148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:19.751148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.751148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:19.751148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:19.751148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.752185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.753442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:19.753442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.753442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:19.786220 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:19.786710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:19.786977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:19.787249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:41:19.788052 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:19.788439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.789383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:19.789383 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.789383 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:19.789383 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.789383 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.789383 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:19.789383 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.789383 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:19.791032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.791032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:19.791032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:19.791032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:19.791032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.791032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:19.791032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:19.791032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:19.791032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.791032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:19.791032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:19.791032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:19.791032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:19.791032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:19.791032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:19.792192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:19.792192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:19.792192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.792192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:19.792192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.792192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.792192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:19.792192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.792192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:19.792861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.792861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:19.792861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:19.792861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:19.792861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.792861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:19.792861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:19.792861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:41:19.792861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:19.792861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:19.792861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.792861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:19.793292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:19.793292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:19.793292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.793292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:19.793292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:19.793292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:19.793292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:19.793292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:19.793292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:19.793292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:19.793292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:19.793292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.793292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:19.793292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.793798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.793798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:19.793798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.793798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:19.793798 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:19.794739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.794739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:19.794739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:19.794739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:19.794739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:19.794739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:19.794739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.794739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:19.794739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:19.794739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.794739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:19.794739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:19.794739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.794739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:19.794739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:19.794739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:19.795801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:19.796674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.796674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:19.796674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.796674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.796674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:19.796674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.796674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:19.796674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:19.796674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:19.796674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:19.797237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:19.797237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.797237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:19.797237 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.797237 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:19.797237 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.797237 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.797237 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:19.797237 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.797237 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:19.797843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.797843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:19.797843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:19.797843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:19.797843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.797843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:19.797843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:19.797843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:19.797843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.797843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:19.797843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:19.797843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:19.797843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:19.797843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:19.797843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:19.798714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:19.798714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:19.798714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.798714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:19.798714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.798714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.798714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:19.798714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.798714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:19.798714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:19.799259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.799259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:19.799259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:19.799259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:19.799259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.799259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:19.799259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:19.799259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:19.799259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:19.799259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.799259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:19.799897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:19.799897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:19.799897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.799897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:19.799897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:19.799897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:19.799897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:19.799897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:19.799897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:19.799897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:19.799897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:19.799897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.799897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:19.799897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.800635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.800635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:19.800635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.800635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:19.800635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.800635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:19.800635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:19.800635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:19.800635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:19.800635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:19.800635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.800635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:19.800635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:19.800635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:19.801337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:19.802465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:19.802465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:19.802465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:19.802465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:19.802465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.802465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:19.802465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.802465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.802465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:19.802465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.802465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:19.802465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:19.802465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:19.803245 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:19.803245 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:19.803245 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:19.803245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.803245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:19.803245 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.803245 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:19.803245 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.803245 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.803245 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:19.803245 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.803245 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:19.803947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.803947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:19.803947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:19.803947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:19.803947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.803947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:19.803947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:19.803947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.803947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:19.803947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:19.803947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:19.803947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.804436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:19.804436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:19.804436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:19.804436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:19.804436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:19.804436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:19.804436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:19.804436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:19.804436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.804436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:19.804436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.804436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.804436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:19.804811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.804811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:19.804811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.804811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:19.804811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:19.804811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:19.804811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:19.804811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:19.804811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.804811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:19.804811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:19.804811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.804811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:19.804811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:19.804811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:19.805255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:19.805819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:19.805819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:19.805819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:19.805819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:19.805819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:19.805819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:24.639397 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:24.640493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:24.640493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:24.641213 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:24.677419 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:24.677823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.678710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:24.678710 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.678710 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:24.678710 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.678710 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.678710 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:24.678710 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.678710 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:24.679824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.679824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:24.679824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:24.679824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:24.679824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.679824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:24.679824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:24.679824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.679824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:24.679824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:24.679824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:24.679824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.680240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:24.680240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:24.680240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:24.680240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:24.680240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:24.680240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:24.680240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:24.680240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:24.680240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.680240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:24.680240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.680240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.680240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:24.681022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.681022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:24.681022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.681022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:24.681022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:24.681022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:24.681022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:24.681022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:24.681022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.681022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:24.681022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:24.681022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.681022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:24.681022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:24.681022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:24.682176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.683593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:24.683593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.683593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.683593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:24.683593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.683593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:24.743446 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:24.743876 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:24.744075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:24.744984 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:24.745299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:24.745578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.746548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:24.746548 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.746548 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:24.746548 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.746548 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.746548 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:24.746548 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.746548 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:24.748032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.748032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:24.748032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:24.748032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:24.748032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.748032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:24.748032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:24.748032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.748032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:24.748032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:24.748032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:24.748032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.748697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:24.748697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:24.748697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:24.748697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:24.748697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:24.748697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:24.748697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:24.748697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:24.748697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.748697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:24.748697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.748697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.748697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:24.749251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.749251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:24.749936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.749936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:24.749936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:24.749936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:24.749936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:24.749936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:24.749936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.749936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:24.749936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:24.749936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.749936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:24.749936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:24.749936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.749936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:24.749936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:24.749936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.750767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.751571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:24.751571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.751571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:24.786767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:24.787231 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:24.787472 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:24.787664 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:41:24.788240 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:24.788485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.789304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:24.789304 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.789304 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:24.789304 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.789304 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.789304 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:24.789304 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.789304 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:24.790467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.790467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:24.790467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:24.790467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:24.790467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.790467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:24.790467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:24.790467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:24.790467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.790467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:24.790467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:24.790467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:24.790467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:24.790467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:24.790467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:24.792762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:24.792762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:24.792762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.792762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:24.792762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.792762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.792762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:24.792762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.792762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:24.792762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.792762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:24.792762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:24.792762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:24.792762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.793601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:24.793601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:24.793601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:41:24.793601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:24.793601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:24.793601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.793601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:24.793601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:24.793601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:24.793601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.793601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:24.793601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:24.793601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:24.794280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:24.794280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:24.794280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:24.794280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:24.794280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:24.794280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.794280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:24.794280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.794280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.794280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:24.794280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.794280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:24.794655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.794655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:24.794655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:24.794655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:24.794655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:24.794655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:24.794655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.794655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:24.794655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:24.794655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.794655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:24.794655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:24.794655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.794655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:24.794655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:24.794655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:24.795055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:24.795537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.795537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:24.795537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.795537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.795537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:24.795537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.795537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:24.795537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:24.795537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:24.795787 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:24.795940 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:24.796596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:24.796926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.797551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:24.797551 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.797551 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:24.797551 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.797551 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.797551 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:24.797551 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.797551 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:24.798303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.798303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:24.798303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:24.798303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:24.798303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.798303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:24.798303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:24.798303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:24.798303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.798303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:24.798303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:24.798303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:24.798303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:24.798303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:24.798303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:24.798703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:24.798703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:24.798703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.798703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:24.798703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.798703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.798703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:24.798703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.798703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:24.799166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.799166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:24.799166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:24.799166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:24.799166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.799166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:24.799166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:24.799166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:24.799166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:24.799166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.799166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:24.799503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:24.799503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:24.799503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.799503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:24.799503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:24.799503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:24.799503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:24.799503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:24.799503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:24.799503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:24.799503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:24.799503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.799503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:24.799503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.799839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.799839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:24.799839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.799839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.800202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:24.800762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.801236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.801236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:24.801236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.801236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:24.801236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:24.801236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:24.801236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:24.801236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:24.801504 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:24.801504 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:24.801637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.802127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:24.802127 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.802127 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:24.802127 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.802127 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.802127 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:24.802127 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.802127 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:24.802936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.802936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:24.802936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:24.802936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:24.802936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.802936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:24.802936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:24.802936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.802936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:24.802936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:24.802936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:24.802936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.803311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:24.803311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:24.803311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:24.803311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:24.803311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:24.803311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:24.803311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:24.803311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:24.803311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.803311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:24.803311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.803311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.803311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:24.803678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.803678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:24.803869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.803869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:24.803869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:24.803869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:24.803869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:24.803869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:24.803869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.803869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:24.803869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:24.803869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.803869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:24.803869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:24.803869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.803869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:24.803869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:24.803869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:24.804322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:24.804889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:24.804889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:24.804889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:29.639882 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:29.641048 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:29.641048 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:29.643041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:29.675839 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:29.676343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.677314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:29.677314 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.677314 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:29.677314 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.677314 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.677314 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:29.677314 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.677314 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:29.678382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.678382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:29.678382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:29.678382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:29.678382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.678382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:29.678382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:29.678382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.678382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:29.678382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:29.678382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:29.678382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.679103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:29.679103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:29.679103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:29.679103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:29.679103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:29.679103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:29.679103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:29.679103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:29.679103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.679103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:29.679103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.679103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.679103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:29.679842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.679842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:29.679842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.679842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:29.679842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:29.679842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:29.679842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:29.679842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:29.679842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.679842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:29.679842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:29.679842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.679842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:29.679842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:29.679842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:29.680731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.682320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:29.682320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.682320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.682320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:29.682320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.682320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:29.744018 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:29.744675 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:29.744909 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:29.745825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:29.746164 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:29.746437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.747342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:29.747342 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.747342 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:29.747342 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.747342 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.747342 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:29.747342 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.747342 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:29.749177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.749177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:29.749177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:29.749177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:29.749177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.749177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:29.749177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:29.749177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.749177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:29.749177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:29.749177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:29.749177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.749776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:29.749776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:29.749776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:29.749776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:29.749776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:29.749776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:29.749776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:29.749776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:29.749776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.749776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:29.749776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.749776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.749776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:29.750460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.750460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:29.750652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.750652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:29.750652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:29.750652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:29.750652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:29.750652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:29.750652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.750652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:29.750652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:29.750652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.750652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:29.750652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:29.750652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.750652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:29.750652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:29.750652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.751670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.752584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:29.752584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.752584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:29.787450 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:29.787932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:29.788041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:29.788161 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:41:29.788772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:29.789092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.789903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:29.789903 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.789903 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:29.789903 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.789903 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.789903 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:29.789903 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.789903 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:29.791458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:29.791458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:29.791458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.791458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:29.791458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.791458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.791458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:29.791458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.791458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:29.792051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.792051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:29.792051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:29.792051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:29.792051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.792051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:29.792051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:29.792051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:41:29.792051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:29.792051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:29.792051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.792051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:29.792508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:29.792508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:29.792508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.792508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:29.792508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:29.792508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:29.792508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:29.792508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:29.792508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:29.792508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:29.792508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:29.792508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.792508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:29.792508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.792941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.792941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:29.792941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.792941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:29.794153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.794153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:29.794153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:29.794153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:29.794153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:29.794153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:29.794153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.794153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:29.794153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:29.794153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.794153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:29.794153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:29.794153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.794153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:29.794153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:29.794153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:29.794692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:29.795326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.795326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:29.795326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.795326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.795326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:29.795326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.795326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:29.795567 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:29.795967 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:29.796165 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:29.796384 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:29.796871 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:29.797213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.798096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:29.798096 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.798096 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:29.798096 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.798096 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.798096 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:29.798096 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.798096 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:29.798837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.798837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:29.798837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:29.798837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:29.798837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.798837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:29.798837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:29.798837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:29.798837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.798837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:29.798837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:29.798837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:29.798837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:29.798837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:29.798837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:29.799263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:29.799263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:29.799263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.799263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:29.799263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.799263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.799263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:29.799263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.799263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:29.799782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.799782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:29.799782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:29.799782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:29.799782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.799782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:29.799782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:29.799782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:29.799782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:29.799782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.799782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:29.800120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:29.800120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:29.800120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.800120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:29.800120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:29.800120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:29.800120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:29.800120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:29.800120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:29.800120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:29.800120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:29.800120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.800120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:29.800120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.800532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.800532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:29.800532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.800532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.800864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:29.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.801958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.801958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:29.801958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.801958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:29.801958 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:29.801958 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:29.801958 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:29.801958 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:29.802217 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:29.802388 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:29.802646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.803323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:29.803323 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.803323 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:29.803323 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.803323 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.803323 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:29.803323 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.803323 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:29.804268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.804268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:29.804268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:29.804268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:29.804268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.804268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:29.804268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:29.804268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.804268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:29.804268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:29.804268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:29.804268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.804778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:29.804778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:29.804778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:29.804778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:29.804778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:29.804778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:29.804778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:29.804778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:29.804778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.804778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:29.804778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.804778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.804778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:29.805282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.805282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:29.805352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.805352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:29.805352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:29.805352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:29.805352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:29.805352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:29.805352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.805352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:29.805352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:29.805352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.805352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:29.805352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:29.805352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.805352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:29.805352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:29.805352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:29.805834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:29.806327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:29.806327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:29.806327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:34.640940 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:34.641783 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:34.641783 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:34.642944 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:34.677184 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:34.677619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.678395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:34.678395 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.678395 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:34.678395 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.678395 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.678395 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:34.678395 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.678395 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:34.679147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.679147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:34.679147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:34.679147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:34.679147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.679147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:34.679147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:34.679147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.679147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:34.679147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:34.679147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:34.679147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.679708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:34.679708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:34.679708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:34.679708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:34.679708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:34.679708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:34.679708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:34.679708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:34.679708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.679708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:34.679708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.679708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.679708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:34.680745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.680745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:34.680745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.680745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:34.680745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:34.680745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:34.680745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:34.680745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:34.680745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.680745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:34.680745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:34.680745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.680745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:34.680745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:34.680745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:34.681734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.682252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:34.682252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.682252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.682252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:34.682252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.682252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:34.744929 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:34.745318 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:34.745318 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:34.746053 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:34.746397 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:34.746654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.747387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:34.747387 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.747387 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:34.747387 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.747387 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.747387 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:34.747387 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.747387 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:34.748057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.748057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:34.748057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:34.748057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:34.748057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.748057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:34.748057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:34.748057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.748057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:34.748057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:34.748057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:34.748057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.748635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:34.748635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:34.748635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:34.748635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:34.748635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:34.748635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:34.748635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:34.748635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:34.748635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.748635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:34.748635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.748635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.748635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:34.749202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.749202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:34.749202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.749202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:34.749202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:34.749202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:34.749202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:34.749202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:34.749202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.749202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:34.749202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:34.749202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.749202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:34.749202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:34.749202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:34.751065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.752142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:34.752142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.752142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.752142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:34.752142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.752142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:34.788878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:34.789151 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:34.789246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:34.789305 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:41:34.789836 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:34.790150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.790961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:34.790961 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.790961 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:34.790961 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.790961 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.790961 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:34.790961 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.790961 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:34.791548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.791548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:34.791548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:34.791548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:34.791548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.791548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:34.791548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:34.791548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:34.791548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.791548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:34.791548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:34.791548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:34.791548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:34.791548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:34.791548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:34.792810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:34.792810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:34.792810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.792810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:34.792810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.792810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.792810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:34.792810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.792810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:34.792810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.792810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:34.792810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:34.792810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:34.792810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.793436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:34.793436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:34.793436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:41:34.793436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:34.793436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:34.793436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.793436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:34.793436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:34.793436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:34.793436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.793436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:34.793436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:34.793436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:34.795134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:34.795134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:34.795134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:34.795134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:34.795134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:34.795134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.795134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:34.795134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.795134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.795134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:34.795134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.795134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:34.795704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.795704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:34.795704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:34.795704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:34.795704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:34.795704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:34.795704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.795704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:34.795704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:34.795704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.795704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:34.795704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:34.795704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.795704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:34.795704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:34.795704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:34.796314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:34.798600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.798600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:34.798600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.798600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.798600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:34.798600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.798600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:34.798600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:34.798600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:34.798600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:34.799092 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:34.799092 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:34.799092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.799092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:34.799092 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.799092 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:34.799092 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.799092 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.799092 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:34.799092 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.799092 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:34.799092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:34.799623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.800273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:34.800273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.800273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.800273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:34.800273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.800273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:34.800273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.800273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:34.800273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:34.800273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:34.800273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.800273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:34.800273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:34.802154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:34.802154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:34.802154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.802154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:34.802154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:34.802154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:34.802154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.802154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:34.802154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:34.802154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:34.802154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:34.802154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:34.802154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:34.803666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:34.803666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:34.803666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.803666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:34.803666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.803666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.803666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:34.803666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.803666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:34.803666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.803666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:34.803666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.804165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.804507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:34.804821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:34.804821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:34.804821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:34.804821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:34.804821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:34.804821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:34.804961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.804961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:34.804961 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.804961 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:34.804961 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.804961 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.804961 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:34.804961 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.804961 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:34.804961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.804961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:34.804961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:34.804961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:34.804961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.804961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:34.805232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:34.805232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.805232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:34.805232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:34.805232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:34.805232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.805232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:34.805232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:34.805232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:34.805232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:34.805232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:34.805232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:34.805232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:34.805232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:34.805715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.805715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:34.805715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.805715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.805715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:34.805715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.805715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:34.805715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.805715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:34.805715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:34.805715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:34.805715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:34.805715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:34.805971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:34.806329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:34.806329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:34.806329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:34.806329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:34.806329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:34.806329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:34.806329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:34.806329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:34.806329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:34.806329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:34.806329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:34.806329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:39.641642 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:39.642645 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:39.642645 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:39.643418 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:39.674349 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:39.674612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.675130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:39.675130 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.675130 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:39.675130 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.675130 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.675130 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:39.675130 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.675130 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:39.675803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.675803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:39.675803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:39.675803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:39.675803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.675803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:39.675803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:39.675803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.675803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:39.675803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:39.675803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:39.675803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.676532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:39.676532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:39.676532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:39.676532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:39.676532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:39.676532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:39.676532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:39.676532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:39.676532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.676532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:39.676532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.676532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.676532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:39.677181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.677181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:39.677181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.677181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:39.677181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:39.677181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:39.677181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:39.677181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:39.677181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.677181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:39.677181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:39.677181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.677181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:39.677181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:39.677181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:39.677956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.678881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:39.678881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.678881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.678881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:39.678881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.678881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:39.745546 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:39.745881 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:39.745993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:39.746798 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:39.747123 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:39.747480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.748382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:39.748382 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.748382 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:39.748382 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.748382 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.748382 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:39.748382 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.748382 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:39.749379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.749379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:39.749379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:39.749379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:39.749379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.749379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:39.749379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:39.749379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.749379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:39.749379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:39.749379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:39.749379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.749719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:39.749719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:39.749719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:39.749719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:39.749719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:39.749719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:39.749719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:39.749719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:39.749719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.749719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:39.749719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.749719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.749719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:39.750032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.750032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:39.750689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.750689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:39.750689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:39.750689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:39.750689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:39.750689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:39.750689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.750689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:39.750689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:39.750689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.750689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:39.750689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:39.750689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.750689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:39.750689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:39.750689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.751097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.751589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:39.751589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.751589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:39.789335 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:39.789820 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:39.790008 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:39.790191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:41:39.790672 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:39.791023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.791850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:39.791850 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.791850 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:39.791850 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.791850 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.791850 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:39.791850 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.791850 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:39.793033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.793033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:39.793033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:39.793033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:39.793033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.793033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:39.793033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:39.793033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:39.793033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.793033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:39.793033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:39.793033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:39.793033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:39.793033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:39.793033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:39.793533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:39.793533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:39.793533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.793533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:39.793533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.793533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.793533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:39.793533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.793533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:39.794425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.794425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:39.794425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:39.794425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:39.794425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.794425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:39.794425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:39.794425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:41:39.794425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:39.794425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:39.794425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.794425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:39.794765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:39.794765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:39.794765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.794765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:39.794765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:39.794765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:39.794765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:39.794765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:39.794765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:39.794765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:39.794765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:39.794765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.794765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:39.794765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.795102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.795102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:39.795102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.795102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:39.796296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.796296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:39.796296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:39.796296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:39.796296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:39.796296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:39.796296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.796296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:39.796296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:39.796296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.796296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:39.796296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:39.796296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.796296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:39.796296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:39.796296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:39.796727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:39.797176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.797176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:39.797176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.797176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.797176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:39.797176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.797176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:39.797176 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:39.797176 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:39.797176 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:39.797483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:39.798138 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:39.798138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.798600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:39.798600 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.798600 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:39.798600 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.798600 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.798600 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:39.798600 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.798600 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:39.799145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.799145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:39.799145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:39.799145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:39.799145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.799145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:39.799145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:39.799145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:39.799145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.799145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:39.799145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:39.799145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:39.799145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:39.799145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:39.799145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:39.800112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:39.800112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:39.800112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.800112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:39.800112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.800112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.800112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:39.800112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.800112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:39.800112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.800112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:39.800112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:39.800112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:39.800112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.800905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:39.800905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:39.800905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:39.800905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:39.800905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.800905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:39.800905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:39.800905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:39.800905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.800905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:39.800905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:39.800905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:39.800905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:39.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:39.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:39.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:39.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:39.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:39.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:39.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:39.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:39.801674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.802124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:39.802730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:39.802730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:39.802730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:39.802730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:39.802730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:39.802730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:39.802960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.803216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:39.803216 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.803216 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:39.803216 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.803216 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.803216 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:39.803216 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.803216 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:39.803773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.803773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:39.803773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:39.803773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:39.803773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.803773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:39.803773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:39.803773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.803773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:39.803773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:39.803773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:39.803773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.804493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:39.804493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:39.804493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:39.804493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:39.804493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:39.804493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:39.804493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:39.804493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:39.804493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.804493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:39.804493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.804493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.804493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:39.805183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.805183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:39.805183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.805183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:39.805183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:39.805183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:39.805183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:39.805183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:39.805183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.805183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:39.805183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:39.805183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.805183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:39.805183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:39.805183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:39.806017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:39.806853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:39.806853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:39.806853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:39.806853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:39.806853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:39.806853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:44.642138 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:44.643052 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:44.643052 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:44.644620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:44.677531 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:44.677876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.678656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:44.678656 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.678656 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:44.678656 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.678656 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.678656 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:44.678656 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.678656 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:44.679622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.679622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:44.679622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:44.679622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:44.679622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.679622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:44.679622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:44.679622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.679622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:44.679622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:44.679622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:44.679622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.680294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:44.680294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:44.680294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:44.680294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:44.680294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:44.680294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:44.680294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:44.680294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:44.680294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.680294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:44.680294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.680294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.680294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:44.681678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.681678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:44.681678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.681678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:44.681678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:44.681678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:44.681678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:44.681678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:44.681678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.681678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:44.681678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:44.681678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.681678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:44.681678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:44.681678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:44.683095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.684341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:44.684341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.684341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.684341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:44.684341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.684341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:44.746342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:44.746890 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:44.747082 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:44.748279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:44.748721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:44.748982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.749871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:44.749871 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.749871 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:44.749871 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.749871 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.749871 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:44.749871 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.749871 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:44.751472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.751472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:44.751472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:44.751472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:44.751472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.751472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:44.751472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:44.751472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.751472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:44.751472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:44.751472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:44.751472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.751976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:44.751976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:44.751976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:44.751976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:44.751976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:44.751976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:44.751976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:44.751976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:44.751976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.751976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:44.751976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.751976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.751976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:44.752484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.752484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:44.753274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.753274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:44.753274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:44.753274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:44.753274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:44.753274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:44.753274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.753274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:44.753274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:44.753274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.753274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:44.753274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:44.753274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.753274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:44.753274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:44.753274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.753788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.754415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:44.754415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.754415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:44.789947 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:44.790521 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:44.790748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:44.790976 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:41:44.791522 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:44.791935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.792740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:44.792740 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.792740 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:44.792740 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.792740 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.792740 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:44.792740 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.792740 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:44.794283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.794283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:44.794283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:44.794283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:44.794283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.794283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:44.794283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:44.794283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:44.794283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.794283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:44.794283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:44.794283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:44.794283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:44.794283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:44.794283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:44.794779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:44.794779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:44.794779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.794779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:44.794779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.794779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.794779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:44.794779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.794779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:44.796292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.796292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:44.796292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:44.796292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:44.796292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.796292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:44.796292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:44.796292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:41:44.796292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:44.796292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:44.796292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.796292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:44.796956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:44.796956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:44.796956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.796956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:44.796956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:44.796956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:44.796956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:44.796956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:44.796956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:44.796956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:44.796956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:44.796956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.796956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:44.796956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.797727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.797727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:44.797727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.797727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:44.798527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.798527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:44.798527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:44.798527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:44.798527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:44.798527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:44.798527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.798527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:44.798527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:44.798527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.798527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:44.798527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:44.798527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.798527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:44.798527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:44.798527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:44.799358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:44.800266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.800266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:44.800266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.800266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.800266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:44.800266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.800266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:44.800266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:44.800266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:44.800266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:44.800812 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:44.800812 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:44.800812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.801493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:44.801493 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.801493 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:44.801493 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.801493 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.801493 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:44.801493 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.801493 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:44.802959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.802959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:44.802959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:44.802959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:44.802959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.802959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:44.802959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:44.802959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:44.802959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.802959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:44.802959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:44.802959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:44.802959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:44.802959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:44.802959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:44.803505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:44.803505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:44.803505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.803505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:44.803505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.803505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.803505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:44.803505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.803505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:44.803505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:44.804156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.804156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:44.804156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:44.804156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:44.804156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.804156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:44.804156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:44.804156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:44.804156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:44.804156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.804156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:44.804526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:44.804526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:44.804526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.804526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:44.804526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:44.804526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:44.804526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:44.804526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:44.804526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:44.804526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:44.804526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:44.804526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.804526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:44.804526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.804928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.804928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:44.804928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.804928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.805315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:44.805855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.806382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.806382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:44.806382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.806382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:44.806382 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:44.806382 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:44.806382 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:44.806382 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:44.806641 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:44.806834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.807510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:44.807510 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.807510 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:44.807510 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.807510 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.807510 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:44.807510 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.807510 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:44.808325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.808325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:44.808325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:44.808325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:44.808325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.808325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:44.808325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:44.808325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.808325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:44.808325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:44.808325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:44.808325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.808713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:44.808713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:44.808713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:44.808713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:44.808713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:44.808713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:44.808713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:44.808713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:44.808713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.808713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:44.808713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.808713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.808713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:44.809055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.809055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:44.809317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.809317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:44.809317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:44.809317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:44.809317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:44.809317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:44.809317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.809317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:44.809317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:44.809317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.809317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:44.809317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:44.809317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.809317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:44.809317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:44.809317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:44.809846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:44.810403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:44.810403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:44.810403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:49.642825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:49.643803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:49.643803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:49.644449 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:49.680512 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:49.680751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.682015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:49.682015 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.682015 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:49.682015 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.682015 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.682015 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:49.682015 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.682015 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:49.682976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.682976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:49.682976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:49.682976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:49.682976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.682976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:49.682976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:49.682976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.682976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:49.682976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:49.682976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:49.682976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.683838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:49.683838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:49.683838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:49.683838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:49.683838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:49.683838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:49.683838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:49.683838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:49.683838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.683838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:49.683838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.683838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.683838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:49.684601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.684601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:49.684601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.684601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:49.684601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:49.684601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:49.684601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:49.684601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:49.684601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.684601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:49.684601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:49.684601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.684601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:49.684601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:49.684601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:49.685608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.686861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:49.686861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.686861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.686861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:49.686861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.686861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:49.746899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:49.747488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:49.747625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:49.748569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:49.748961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:49.749219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.750096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:49.750096 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.750096 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:49.750096 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.750096 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.750096 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:49.750096 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.750096 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:49.751863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.751863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:49.751863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:49.751863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:49.751863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.751863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:49.751863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:49.751863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.751863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:49.751863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:49.751863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:49.751863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.752533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:49.752533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:49.752533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:49.752533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:49.752533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:49.752533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:49.752533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:49.752533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:49.752533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.752533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:49.752533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.752533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.752533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:49.753486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.753486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:49.753878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.753878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:49.753878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:49.753878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:49.753878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:49.753878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:49.753878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.753878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:49.753878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:49.753878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.753878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:49.753878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:49.753878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.753878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:49.753878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:49.753878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.754323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.754918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:49.754918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.754918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:49.790570 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:49.791085 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:49.791206 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:49.791382 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:41:49.791927 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:49.792245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.793141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:49.793141 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.793141 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:49.793141 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.793141 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.793141 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:49.793141 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.793141 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:49.794348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.794348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:49.794348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:49.794348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:49.794348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.794348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:49.794348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:49.794348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:49.794348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.794348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:49.794348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:49.794348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:49.794348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:49.794348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:49.794348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:49.795511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:49.795511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:49.795511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.795511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:49.795511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.795511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.795511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:49.795511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.795511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:49.795898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.795898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:49.795898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:49.795898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:49.795898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.795898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:49.795898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:49.795898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:41:49.795898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:49.795898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:49.795898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.795898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:49.796483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:49.796483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:49.796483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.796483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:49.796483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:49.796483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:49.796483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:49.796483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:49.796483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:49.796483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:49.796483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:49.796483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.796483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:49.796483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.797305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.797305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:49.797305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.797305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:49.797305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.797305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:49.797305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:49.797305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:49.797305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:49.797305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:49.797305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.797305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:49.797305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:49.797305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:49.798261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:49.799160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:49.799160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:49.799160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:49.799160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:49.799160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:49.799160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.799160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:49.799160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.799160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.799160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:49.799160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.799160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:49.799160 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:49.799779 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:49.799779 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:49.799779 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:49.800113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:49.800322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.800879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:49.800879 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.800879 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:49.800879 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.800879 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.800879 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:49.800879 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.800879 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:49.801808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.801808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:49.801808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:49.801808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:49.801808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.801808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:49.801808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:49.801808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:49.801808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.801808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:49.801808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:49.801808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:49.801808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:49.801808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:49.801808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:49.802222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:49.802222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:49.802222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.802222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:49.802222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.802222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.802222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:49.802222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.802222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:49.802480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.802480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:49.802480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:49.802480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:49.802480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.802480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:49.802480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:49.802480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:49.802480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:49.802480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.802480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:49.802811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:49.802811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:49.802811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.802811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:49.802811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:49.802811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:49.802811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:49.802811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:49.802811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:49.802811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:49.802811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:49.802811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.802811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:49.802811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.803168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.803168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:49.803168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.803168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.803309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:49.803849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.804450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.804450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:49.804450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.804450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:49.805666 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:49.805901 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:49.806002 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:49.806174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:49.806461 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:49.806795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:49.807038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.807858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:49.807858 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.807858 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:49.807858 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.807858 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.807858 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:49.807858 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.807858 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:49.808612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.808612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:49.808612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:49.808612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:49.808612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.808612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:49.808612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:49.808612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.808612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:49.808612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:49.808612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:49.808612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.808964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:49.808964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:49.808964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:49.808964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:49.808964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:49.808964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:49.808964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:49.808964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:49.808964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.808964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:49.808964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.808964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.808964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:49.809494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.809494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:49.809494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.809494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:49.809494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:49.809494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:49.809494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:49.809494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:49.809494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.809494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:49.809494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:49.809494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.809494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:49.809494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:49.809494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:49.809923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:49.810809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:49.810809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:49.810809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:49.810809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:49.810809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:49.810809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:54.643694 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:54.644680 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:54.644680 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:54.645551 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:54.648160 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:41:54.678634 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:54.679181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.679957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:54.679957 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.679957 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:54.679957 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.679957 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.679957 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:54.679957 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.679957 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:54.680785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.680785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:54.680785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:54.680785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:54.680785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.680785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:54.680785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:54.680785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.680785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:54.680785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:54.680785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:54.680785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.681216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:54.681216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:54.681216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:54.681216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:54.681216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:54.681216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:54.681216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:54.681216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:54.681216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.681216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:54.681216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.681216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.681216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:54.681685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.681685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:54.681685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.681685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:54.681685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:54.681685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:54.681685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:54.681685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:54.681685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.681685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:54.681685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:54.681685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.681685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:54.681685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:54.681685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:54.682150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.684010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:54.684010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.684010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.684010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:54.684010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.684010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:54.748768 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:54.749268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:54.749557 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:54.750912 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:54.751184 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:54.751422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.752351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:54.752351 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.752351 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:54.752351 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.752351 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.752351 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:54.752351 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.752351 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:54.754053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.754053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:54.754053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:54.754053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:54.754053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.754053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:54.754053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:54.754053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.754053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:54.754053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:54.754053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:54.754053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.754931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:54.754931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:54.754931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:54.754931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:54.754931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:54.754931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:54.754931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:54.754931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:54.754931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.754931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:54.754931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.754931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.754931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:54.755781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.755781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:54.757025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.757025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:54.757025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:54.757025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:54.757025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:54.757025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:54.757025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.757025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:54.757025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:54.757025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.757025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:54.757025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:54.757025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.757025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:54.757025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:54.757025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.757440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.757886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:54.757886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.757886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:54.791157 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:54.791561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:54.791741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:54.791921 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:41:54.792588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:54.792836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:54.793606 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.793606 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:54.793606 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.793606 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.793606 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:54.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:54.794960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.794960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:54.794960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:54.794960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:54.794960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.794960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:54.794960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:54.794960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:54.794960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.794960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:54.794960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:54.794960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:54.794960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:54.794960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:54.794960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:54.796101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:54.796101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:54.796101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.796101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:54.796101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.796101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.796101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:54.796101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.796101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:54.796835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.796835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:54.796835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:54.796835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:54.796835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.796835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:54.796835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:54.796835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:41:54.796835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:54.796835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:54.796835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.796835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:54.797406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:54.797406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:54.797406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.797406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:54.797406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:54.797406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:54.797406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:54.797406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:54.797406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:54.797406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:54.797406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:54.797406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.797406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:54.797406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.798037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.798037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:54.798037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.798037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:54.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:54.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:54.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:54.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:54.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:54.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:54.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:54.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:54.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:54.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:54.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:54.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:54.798952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:54.799526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.799526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:54.799526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.799526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.799526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:54.799526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.799526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:54.799779 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:54.800198 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:54.800494 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:54.800742 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:54.801355 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:54.801970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.802871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:54.802871 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.802871 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:54.802871 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.802871 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.802871 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:54.802871 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.802871 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:54.804309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.804309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:54.804309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:54.804309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:54.804309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.804309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:54.804309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:54.804309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:54.804309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.804309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:54.804309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:54.804309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:54.804309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:54.804309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:54.804309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:54.805003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:54.805003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:54.805003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.805003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:54.805003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.805003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.805003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:54.805003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.805003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:54.806915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.806915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:54.806915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:54.806915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:54.806915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.806915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:54.806915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:54.806915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:54.806915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:54.806915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.806915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:54.807497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:54.807497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:54.807497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.807497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:54.807497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:54.807497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:54.807497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:54.807497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:54.807497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:54.807497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:54.807497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:54.807497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.807497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:54.807497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.808134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.808134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:54.808134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.808134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.809002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:54.809534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.810086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.810086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:54.810086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.810086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:54.810086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:54.810086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:54.810086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:54.810086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:54.810378 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:54.810453 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:54.810687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.811399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:54.811399 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.811399 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:54.811399 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.811399 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.811399 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:54.811399 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.811399 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:54.811999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.811999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:54.811999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:54.811999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:54.811999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.811999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:54.811999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:54.811999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.811999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:54.811999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:54.811999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:54.811999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.812665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:54.812665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:54.812665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:54.812665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:54.812665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:54.812665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:54.812665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:54.812665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:54.812665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.812665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:54.812665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.812665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.812665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:54.813402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.813402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:54.813402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.813402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:54.813402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:54.813402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:54.813402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:54.813402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:54.813402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.813402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:54.813402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:54.813402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.813402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:54.813402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:54.813402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:54.814073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:54.815045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:54.815045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:54.815045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:54.815045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:54.815045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:54.815045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:59.644588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:59.645435 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:59.645435 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:59.646344 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:59.681111 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:59.681562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.682294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:59.682294 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.682294 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:59.682294 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.682294 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.682294 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:59.682294 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.682294 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:59.683055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.683055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:59.683055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:59.683055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:59.683055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.683055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:59.683055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:59.683055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.683055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:59.683055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:59.683055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:59.683055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.683469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:59.683469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:59.683469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:59.683469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:59.683469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:59.683469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:59.683469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:59.683469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:59.683469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.683469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:59.683469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.683469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.683469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:59.683826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.683826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:59.683826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.683826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:59.683826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:59.683826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:59.683826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:59.683826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:59.683826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.683826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:59.683826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:59.683826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.683826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:59.683826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:59.683826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:59.684310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.685127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:59.685127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.685127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.685127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:59.685127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.685127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:59.749445 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:59.750102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:59.750286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:59.751277 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:59.751766 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:59.751988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.752901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:59.752901 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.752901 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:59.752901 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.752901 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.752901 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:59.752901 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.752901 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:59.754623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.754623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:59.754623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:59.754623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:59.754623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.754623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:59.754623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:59.754623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.754623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:59.754623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:59.754623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:59.754623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:59.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:59.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:59.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:59.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:59.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:59.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:59.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:59.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:59.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.755168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:59.755884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.755884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:59.756327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.756327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:59.756327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:59.756327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:59.756327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:59.756327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:59.756327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.756327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:59.756327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:59.756327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.756327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:59.756327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:59.756327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.756327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:59.756327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:59.756327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.757073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.757880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:59.757880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.757880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:59.791787 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:59.792261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:59.792388 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:59.792551 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:41:59.793089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:59.793397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.794207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:59.794207 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.794207 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:59.794207 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.794207 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.794207 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:59.794207 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.794207 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:59.795054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.795054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:59.795054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:59.795054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:59.795054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.795054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:59.795054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:59.795054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:59.795054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.795054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:59.795054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:59.795054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:59.795054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:59.795054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:59.795054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:59.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:59.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:59.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:59.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:59.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:59.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:59.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:59.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:59.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.796610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:59.796610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:59.796610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:41:59.796610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:59.796610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:59.796610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.796610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:59.796610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:59.796610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:59.796610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.796610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:59.796610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:59.796610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:59.797157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:59.797157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:59.797157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:59.797157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:59.797157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:59.797157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.797157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:59.797157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.797157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.797157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:59.797157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.797157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:59.797716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.797716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:59.797716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:59.797716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:59.797716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:59.797716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:59.797716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.797716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:59.797716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:59.797716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.797716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:59.797716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:59.797716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.797716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:59.797716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:59.797716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:59.798343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:59.799084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.799084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:59.799084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.799084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.799084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:59.799084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.799084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:59.800019 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:59.800267 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:59.800396 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:59.800558 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:59.800824 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:59.801042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.801543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:59.801543 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.801543 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:59.801543 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.801543 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.801543 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:59.801543 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.801543 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:59.802252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.802252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:41:59.802252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:59.802252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:59.802252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.802252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:59.802252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:59.802252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:59.802252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.802252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:41:59.802252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:59.802252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:41:59.802252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:59.802252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:41:59.802252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:41:59.802987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:59.802987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:41:59.802987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.802987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:41:59.802987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.802987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.802987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:41:59.802987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.802987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:41:59.803655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.803655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:59.803655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:59.803655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:59.803655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.803655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:59.803655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:59.803655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:59.803655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:59.803655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.803655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:59.804227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:59.804227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:59.804227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.804227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:59.804227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:59.804227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:59.804227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:59.804227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:59.804227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:59.804227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:59.804227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:59.804227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.804227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:59.804227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.804974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.804974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:59.804974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.804974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:59.804974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.804974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:59.804974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:59.804974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:59.804974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:59.804974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:59.804974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.804974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:59.804974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:59.804974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:59.805728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:59.806620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:59.806620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:59.806620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:59.806620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:59.806620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.806620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:59.806620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.806620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.806620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:59.806620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.806620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:41:59.809681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:41:59.810037 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:41:59.810137 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:41:59.810334 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:41:59.810749 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:59.811098 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:41:59.811333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.812240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:41:59.812240 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.812240 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:41:59.812240 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.812240 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.812240 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:41:59.812240 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.812240 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:41:59.813080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.813080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:41:59.813080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:59.813080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:41:59.813080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.813080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:59.813080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:59.813080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.813080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:59.813080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:59.813080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:59.813080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.813445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:41:59.813445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:59.813445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:41:59.813445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:59.813445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:41:59.813445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:41:59.813445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:59.813445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:41:59.813445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.813445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:41:59.813445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.813445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.813445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:41:59.813812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.813812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:41:59.814066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.814066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:41:59.814066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:41:59.814066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:41:59.814066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:41:59.814066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:41:59.814066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.814066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:41:59.814066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:41:59.814066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.814066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:41:59.814066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:41:59.814066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.814066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:41:59.814066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:41:59.814066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:41:59.814503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:41:59.814988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:41:59.814988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:41:59.814988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:04.645246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:04.646213 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:04.646213 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:04.647527 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:04.691050 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:04.691317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.691972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:04.691972 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.691972 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:04.691972 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.691972 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.691972 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:04.691972 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.691972 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:04.692792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.046 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.692792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:04.692792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:04.692792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:04.692792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.692792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:04.692792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:04.692792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.692792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:04.692792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:04.692792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:04.692792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.693341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:04.693341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:04.693341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:04.693341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:04.693341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:04.693341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:04.693341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:04.693341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:04.693341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.693341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:04.693341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.693341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.693341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:04.693938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.693938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:04.693938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.693938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:04.693938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:04.693938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:04.693938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:04.693938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:04.693938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.693938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:04.693938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:04.693938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.693938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:04.693938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:04.693938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:04.694653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.695604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:04.695604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.695604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.695604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:04.695604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.695604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:04.750083 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:04.750635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:04.750762 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:04.751587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:04.751862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:04.752003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.752690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:04.752690 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.752690 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:04.752690 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.752690 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.752690 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:04.752690 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.752690 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:04.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:04.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:04.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:04.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:04.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:04.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:04.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:04.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:04.754006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.754991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:04.754991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:04.754991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:04.754991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:04.754991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:04.754991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:04.754991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:04.754991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:04.754991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.754991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:04.754991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.754991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.754991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:04.755965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.755965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:04.755965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.755965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:04.755965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:04.755965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:04.755965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:04.755965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:04.755965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.755965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:04.755965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:04.755965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.755965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:04.755965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:04.755965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:04.756991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.757761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:04.757761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.757761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.757761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:04.757761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.757761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:04.792466 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:04.793298 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:04.793553 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:04.793794 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:42:04.794358 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:04.794699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:04.795571 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.795571 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:04.795571 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.795571 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.795571 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:04.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:04.796970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.796970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:04.796970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:04.796970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:04.796970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.796970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:04.796970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:04.796970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:04.796970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.796970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:04.796970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:04.796970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:04.796970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:04.796970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:04.796970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:04.797481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:04.797481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:04.797481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.797481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:04.797481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.797481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.797481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:04.797481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.797481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:04.798123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.798123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:04.798123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:04.798123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:04.798123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.798123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:04.798123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:04.798123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:42:04.798123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:04.798123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:04.798123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.798123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:04.798594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:04.798594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:04.798594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.798594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:04.798594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:04.798594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:04.798594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:04.798594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:04.798594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:04.798594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:04.798594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:04.798594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.798594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:04.798594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.798999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.798999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:04.798999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.798999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:04.799161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.799161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:04.799161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:04.799161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:04.799161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:04.799161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:04.799161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.799161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:04.799161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:04.799161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.799161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:04.799161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:04.799161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.799161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:04.799161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:04.799161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:04.799694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:04.800449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.800449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:04.800449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.800449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.800449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:04.800449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.800449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:04.800449 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:04.800844 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:04.800844 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:04.801041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:04.801476 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:04.801827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.802533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:04.802533 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.802533 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:04.802533 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.802533 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.802533 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:04.802533 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.802533 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:04.803315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.803315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:04.803315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:04.803315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:04.803315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.803315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:04.803315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:04.803315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:04.803315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.803315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:04.803315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:04.803315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:04.803315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:04.803315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:04.803315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:04.803905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:04.803905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:04.803905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.803905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:04.803905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.803905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.803905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:04.803905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.803905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:04.804432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.804432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:04.804432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:04.804432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:04.804432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.804432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:04.804432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:04.804432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:04.804432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:04.804432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.804432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:04.804864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:04.804864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:04.804864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.804864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:04.804864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:04.804864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:04.804864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:04.804864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:04.804864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:04.804864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:04.804864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:04.804864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.804864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:04.804864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.805339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.805339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:04.805339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.805339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.805786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:04.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.806889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.806889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:04.806889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.806889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:04.810202 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:04.810509 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:04.810655 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:04.810857 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:04.811229 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:04.811608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:04.811830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.812561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:04.812561 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.812561 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:04.812561 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.812561 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.812561 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:04.812561 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.812561 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:04.813494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.813494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:04.813494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:04.813494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:04.813494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.813494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:04.813494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:04.813494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.813494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:04.813494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:04.813494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:04.813494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.814005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:04.814005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:04.814005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:04.814005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:04.814005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:04.814005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:04.814005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:04.814005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:04.814005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.814005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:04.814005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.814005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.814005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:04.814536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.814536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:04.814804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.814804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:04.814804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:04.814804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:04.814804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:04.814804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:04.814804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.814804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:04.814804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:04.814804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.814804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:04.814804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:04.814804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.814804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:04.814804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:04.814804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:04.815451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:04.816139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:04.816139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:04.816139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:09.646183 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:09.647462 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:09.647462 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:09.647631 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:09.681586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:09.681981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.682912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:09.682912 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.682912 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:09.682912 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.682912 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.682912 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:09.682912 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.682912 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:09.683936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.683936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:09.683936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:09.683936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:09.683936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.683936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:09.683936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:09.683936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.683936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:09.683936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:09.683936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:09.683936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.684599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:09.684599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:09.684599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:09.684599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:09.684599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:09.684599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:09.684599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:09.684599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:09.684599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.684599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:09.684599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.684599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.684599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:09.685325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.685325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:09.685325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.685325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:09.685325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:09.685325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:09.685325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:09.685325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:09.685325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.685325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:09.685325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:09.685325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.685325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:09.685325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:09.685325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:09.686230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.687321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:09.687321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.687321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.687321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:09.687321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.687321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:09.750714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:09.751511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:09.751667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:09.752648 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:09.753050 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:09.753286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.754527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:09.754527 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.754527 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:09.754527 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.754527 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.754527 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:09.754527 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.754527 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:09.756846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.756846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:09.756846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:09.756846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:09.756846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.756846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:09.756846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:09.756846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.756846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:09.756846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:09.756846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:09.756846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.757655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:09.757655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:09.757655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:09.757655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:09.757655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:09.757655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:09.757655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:09.757655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:09.757655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.757655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:09.757655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.757655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.757655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:09.758300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.758300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:09.758789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.758789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:09.758789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:09.758789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:09.758789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:09.758789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:09.758789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.758789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:09.758789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:09.758789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.758789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:09.758789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:09.758789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.758789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:09.758789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:09.758789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.759548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.760127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:09.760127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.760127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:09.793303 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:09.793887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:09.794082 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:09.794315 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:42:09.794912 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:09.795294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.796224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:09.796224 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.796224 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:09.796224 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.796224 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.796224 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:09.796224 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.796224 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:09.797475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.797475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:09.797475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:09.797475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:09.797475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.797475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:09.797475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:09.797475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:09.797475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.797475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:09.797475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:09.797475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:09.797475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:09.797475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:09.797475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:09.798294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:09.798294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:09.798294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.798294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:09.798294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.798294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.798294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:09.798294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.798294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:09.798998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.798998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:09.798998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:09.798998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:09.798998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.798998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:09.798998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:09.798998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:42:09.798998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:09.798998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:09.798998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.798998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:09.799689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:09.799689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:09.799689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.799689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:09.799689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:09.799689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:09.799689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:09.799689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:09.799689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:09.799689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:09.799689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:09.799689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.799689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:09.799689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.800346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.800346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:09.800346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.800346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:09.800346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.800346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:09.800346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:09.800346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:09.800346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:09.800346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:09.800346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.800346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:09.800346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:09.800346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:09.801064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:09.801997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:09.801997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:09.801997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:09.801997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:09.801997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:09.801997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.801997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:09.801997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.801997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.801997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:09.801997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.801997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:09.801997 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:09.801997 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:09.802697 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:09.802697 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:09.802697 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:09.802697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.802958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:09.802958 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.802958 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:09.802958 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.802958 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.802958 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:09.802958 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.802958 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:09.803566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.803566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:09.803566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:09.803566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:09.803566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.803566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:09.803566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:09.803566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:09.803566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.803566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:09.803566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:09.803566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:09.803566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:09.803566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:09.803566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:09.804270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:09.804270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:09.804270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.804270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:09.804270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.804270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.804270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:09.804270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.804270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:09.804597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.804597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:09.804597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:09.804597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:09.804597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.804597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:09.804597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:09.804597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:09.804597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:09.804597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.804597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:09.804924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:09.804924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:09.804924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.804924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:09.804924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:09.804924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:09.804924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:09.804924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:09.804924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:09.804924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:09.804924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:09.804924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.804924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:09.804924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.805304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.805304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:09.805304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.805304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.805516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:09.805994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.806528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.806528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:09.806528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.806528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:09.810643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:09.810942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:09.811058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:09.811207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:09.811673 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:09.812035 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:09.812278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.812987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:09.812987 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.812987 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:09.812987 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.812987 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.812987 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:09.812987 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.812987 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:09.813848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.813848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:09.813848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:09.813848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:09.813848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.813848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:09.813848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:09.813848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.813848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:09.813848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:09.813848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:09.813848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.814560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:09.814560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:09.814560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:09.814560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:09.814560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:09.814560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:09.814560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:09.814560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:09.814560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.814560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:09.814560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.814560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.814560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:09.815240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.815240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:09.815240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.815240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:09.815240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:09.815240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:09.815240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:09.815240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:09.815240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.815240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:09.815240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:09.815240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.815240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:09.815240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:09.815240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:09.816099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:09.817021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:09.817021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:09.817021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:09.817021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:09.817021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:09.817021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:14.646738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:14.647627 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:14.647627 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:14.648552 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:14.678493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:14.678891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.679524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:14.679524 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.679524 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:14.679524 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.679524 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.679524 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:14.679524 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.679524 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:14.680561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.032 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.680561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:14.680561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:14.680561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:14.680561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.680561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:14.680561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:14.680561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.680561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:14.680561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:14.680561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:14.680561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.681267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:14.681267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:14.681267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:14.681267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:14.681267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:14.681267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:14.681267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:14.681267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:14.681267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.681267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:14.681267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.681267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.681267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:14.682071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.682071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:14.682071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.682071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:14.682071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:14.682071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:14.682071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:14.682071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:14.682071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.682071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:14.682071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:14.682071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.682071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:14.682071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:14.682071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:14.683045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.684147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:14.684147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.684147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.684147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:14.684147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.684147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:14.751630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:14.752079 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:14.752258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:14.753153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:14.753577 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:14.753885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.754711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:14.754711 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.754711 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:14.754711 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.754711 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.754711 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:14.754711 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.754711 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:14.755683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.755683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:14.755683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:14.755683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:14.755683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.755683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:14.755683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:14.755683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.755683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:14.755683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:14.755683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:14.755683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.756417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:14.756417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:14.756417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:14.756417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:14.756417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:14.756417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:14.756417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:14.756417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:14.756417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.756417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:14.756417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.756417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.756417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:14.757137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.757137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:14.757137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.757137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:14.757137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:14.757137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:14.757137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:14.757137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:14.757137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.757137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:14.757137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:14.757137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.757137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:14.757137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:14.757137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:14.758005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.758804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:14.758804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.758804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.758804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:14.758804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.758804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:14.793859 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:14.794279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:14.794496 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:14.794693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:42:14.795045 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:14.795237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.795791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:14.795791 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.795791 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:14.795791 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.795791 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.795791 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:14.795791 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.795791 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:14.796999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.796999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:14.796999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:14.796999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:14.796999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.796999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:14.796999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:14.796999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:14.796999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.796999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:14.796999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:14.796999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:14.796999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:14.796999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:14.796999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:14.797748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:14.797748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:14.797748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.797748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:14.797748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.797748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.797748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:14.797748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.797748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:14.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:14.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:14.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:14.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:14.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:14.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:42:14.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:14.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:14.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.798425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:14.799177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:14.799177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:14.799177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.799177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:14.799177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:14.799177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:14.799177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:14.799177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:14.799177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:14.799177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:14.799177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:14.799177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.799177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:14.799177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.800035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.800035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:14.800035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.800035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:14.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:14.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:14.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:14.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:14.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:14.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:14.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:14.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:14.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:14.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:14.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:14.800288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:14.801303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:14.802588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.802588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:14.802588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.802588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.802588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:14.802588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.802588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:14.802588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:14.802588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:14.802588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:14.803250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:14.803250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:14.803250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.803250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:14.803250 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.803250 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:14.803250 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.803250 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.803250 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:14.803250 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.803250 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:14.804009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.804009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:14.804009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:14.804009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:14.804009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.804009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:14.804009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:14.804009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:14.804009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.804009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:14.804009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:14.804009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:14.804009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:14.804009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:14.804009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:14.804954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:14.804954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:14.804954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.804954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:14.804954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.804954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.804954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:14.804954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.804954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:14.804954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.804954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:14.804954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:14.804954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:14.804954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.805943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:14.805943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:14.805943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:14.805943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:14.805943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.805943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:14.805943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:14.805943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:14.805943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.805943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:14.805943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:14.805943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:14.805943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:14.806687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:14.806687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:14.806687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:14.806687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:14.806687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.806687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:14.806687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.806687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.806687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:14.806687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.806687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:14.806687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:14.807002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.807653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:14.811017 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:14.811255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:14.811384 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:14.811530 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:14.811919 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:14.812257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:14.812499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.813090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:14.813090 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.813090 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:14.813090 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.813090 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.813090 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:14.813090 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.813090 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:14.813943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.813943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:14.813943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:14.813943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:14.813943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.813943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:14.813943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:14.813943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.813943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:14.813943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:14.813943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:14.813943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.814283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:14.814283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:14.814283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:14.814283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:14.814283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:14.814283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:14.814283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:14.814283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:14.814283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.814283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:14.814283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.814283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.814283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:14.814685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.814685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:14.814918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.814918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:14.814918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:14.814918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:14.814918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:14.814918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:14.814918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.814918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:14.814918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:14.814918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.814918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:14.814918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:14.814918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.814918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:14.814918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:14.814918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:14.815544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:14.816221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:14.816221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:14.816221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:19.647415 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:19.648194 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:19.648352 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:19.649670 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:19.683316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:19.683845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.684915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:19.684915 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.684915 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:19.684915 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.684915 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.684915 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:19.684915 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.684915 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:19.685778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.685778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:19.685778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:19.685778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:19.685778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.685778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:19.685778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:19.685778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.685778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:19.685778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:19.685778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:19.685778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.686393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:19.686393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:19.686393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:19.686393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:19.686393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:19.686393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:19.686393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:19.686393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:19.686393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.686393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:19.686393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.686393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.686393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:19.687274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.687274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:19.687274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.687274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:19.687274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:19.687274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:19.687274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:19.687274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:19.687274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.687274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:19.687274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:19.687274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.687274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:19.687274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:19.687274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:19.688082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.689342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:19.689342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.689342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.689342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:19.689342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.689342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:19.752336 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:19.753047 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:19.753292 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:19.754404 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:19.754743 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:19.754981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.755903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:19.755903 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.755903 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:19.755903 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.755903 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.755903 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:19.755903 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.755903 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:19.757056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.757056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:19.757056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:19.757056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:19.757056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.757056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:19.757056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:19.757056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.757056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:19.757056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:19.757056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:19.757056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.757825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:19.757825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:19.757825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:19.757825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:19.757825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:19.757825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:19.757825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:19.757825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:19.757825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.757825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:19.757825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.757825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.757825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:19.758736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.758736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:19.758736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.758736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:19.758736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:19.758736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:19.758736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:19.758736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:19.758736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.758736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:19.758736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:19.758736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.758736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:19.758736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:19.758736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:19.759855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.760992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:19.760992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.760992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.760992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:19.760992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.760992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:19.794463 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:19.795051 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:19.795186 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:19.795309 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:42:19.795876 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:19.796218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.797173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:19.797173 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.797173 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:19.797173 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.797173 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.797173 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:19.797173 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.797173 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:19.797994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.797994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:19.797994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:19.797994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:19.797994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.797994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:19.797994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:19.797994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:19.797994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.797994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:19.797994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:19.797994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:19.797994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:19.797994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:19.797994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:19.798624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:19.798624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:19.798624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.798624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:19.798624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.798624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.798624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:19.798624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.798624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:19.799106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.799106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:19.799106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:19.799106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:19.799106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.799106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:19.799106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:19.799106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:42:19.799106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:19.799106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:19.799106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.799106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:19.799530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:19.799530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:19.799530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.799530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:19.799530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:19.799530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:19.799530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:19.799530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:19.799530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:19.799530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:19.799530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:19.799530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.799530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:19.799530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.799942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.799942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:19.799942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.799942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:19.800485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.800485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:19.800485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:19.800485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:19.800485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:19.800485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:19.800485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.800485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:19.800485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:19.800485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.800485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:19.800485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:19.800485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.800485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:19.800485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:19.800485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:19.801122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:19.801822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.801822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:19.801822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.801822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.801822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:19.801822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.801822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:19.801822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:19.802073 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:19.802073 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:19.802150 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:19.802762 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:19.803099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.803817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:19.803817 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.803817 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:19.803817 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.803817 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.803817 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:19.803817 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.803817 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:19.804621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.804621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:19.804621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:19.804621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:19.804621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.804621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:19.804621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:19.804621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:19.804621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.804621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:19.804621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:19.804621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:19.804621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:19.804621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:19.804621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:19.805152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:19.805152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:19.805152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.805152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:19.805152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.805152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.805152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:19.805152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.805152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:19.805490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.805490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:19.805490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:19.805490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:19.805490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.805490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:19.805490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:19.805490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:19.805490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:19.805490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.805490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:19.805870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:19.805870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:19.805870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.805870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:19.805870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:19.805870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:19.805870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:19.805870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:19.805870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:19.805870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:19.805870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:19.805870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.805870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:19.805870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.806309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.806309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:19.806309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.806309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.806498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:19.807062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.807569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.807569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:19.807569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.807569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:19.811452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:19.812110 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:19.812310 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:19.812637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:19.813055 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:19.813404 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:19.813693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.814400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:19.814400 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.814400 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:19.814400 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.814400 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.814400 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:19.814400 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.814400 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:19.815237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.815237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:19.815237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:19.815237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:19.815237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.815237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:19.815237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:19.815237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.815237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:19.815237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:19.815237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:19.815237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.815763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:19.815763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:19.815763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:19.815763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:19.815763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:19.815763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:19.815763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:19.815763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:19.815763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.815763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:19.815763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.815763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.815763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:19.816302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.816302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:19.816302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.816302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:19.816302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:19.816302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:19.816302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:19.816302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:19.816302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.816302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:19.816302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:19.816302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.816302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:19.816302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:19.816302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:19.816852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:19.817550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:19.817550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:19.817550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:19.817550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:19.817550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:19.817550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:24.648182 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:24.649062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:24.649062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:24.650092 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:24.683345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:24.683721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.684487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:24.684487 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.684487 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:24.684487 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.684487 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.684487 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:24.684487 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.684487 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:24.685422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.685422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:24.685422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:24.685422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:24.685422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.685422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:24.685422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:24.685422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.685422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:24.685422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:24.685422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:24.685422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.686344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:24.686344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:24.686344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:24.686344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:24.686344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:24.686344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:24.686344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:24.686344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:24.686344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.686344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:24.686344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.686344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.686344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:24.687068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.687068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:24.687068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.687068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:24.687068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:24.687068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:24.687068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:24.687068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:24.687068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.687068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:24.687068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:24.687068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.687068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:24.687068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:24.687068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:24.688316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.688907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:24.688907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.688907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.688907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:24.688907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.688907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:24.752913 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:24.753343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:24.753580 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:24.754450 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:24.754769 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:24.755073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.755942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:24.755942 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.755942 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:24.755942 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.755942 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.755942 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:24.755942 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.755942 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:24.757473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.757473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:24.757473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:24.757473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:24.757473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.757473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:24.757473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:24.757473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.757473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:24.757473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:24.757473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:24.757473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.757823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:24.757823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:24.757823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:24.757823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:24.757823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:24.757823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:24.757823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:24.757823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:24.757823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.757823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:24.757823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.757823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.757823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:24.758191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.758191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:24.759189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.759189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:24.759189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:24.759189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:24.759189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:24.759189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:24.759189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.759189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:24.759189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:24.759189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.759189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:24.759189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:24.759189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.759189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:24.759189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:24.759189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.759711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.760209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:24.760209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.760209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:24.795191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:24.795826 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:24.796051 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:24.796256 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:42:24.796840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:24.797157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.798065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:24.798065 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.798065 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:24.798065 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.798065 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.798065 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:24.798065 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.798065 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:24.799464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.799464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:24.799464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:24.799464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:24.799464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.799464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:24.799464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:24.799464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:24.799464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.799464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:24.799464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:24.799464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:24.799464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:24.799464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:24.799464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:24.800275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:24.800275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:24.800275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.800275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:24.800275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.800275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.800275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:24.800275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.800275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:24.800889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.800889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:24.800889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:24.800889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:24.800889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.800889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:24.800889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:24.800889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:42:24.800889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:24.800889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:24.800889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.800889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:24.801504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:24.801504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:24.801504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.801504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:24.801504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:24.801504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:24.801504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:24.801504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:24.801504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:24.801504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:24.801504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:24.801504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.801504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:24.801504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.802193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.802193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:24.802193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.802193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:24.802772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.802772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:24.802772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:24.802772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:24.802772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:24.802772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:24.802772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.802772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:24.802772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:24.802772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.802772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:24.802772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:24.802772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.802772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:24.802772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:24.802772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:24.803587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:24.804438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.804438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:24.804438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.804438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.804438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:24.804438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.804438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:24.804438 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:24.804438 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:24.804438 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:24.804960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:24.804960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:24.804960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.805387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:24.805387 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.805387 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:24.805387 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.805387 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.805387 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:24.805387 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.805387 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:24.806029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.806029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:24.806029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:24.806029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:24.806029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.806029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:24.806029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:24.806029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:24.806029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.806029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:24.806029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:24.806029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:24.806029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:24.806029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:24.806029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:24.806777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:24.806777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:24.806777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.806777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:24.806777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.806777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.806777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:24.806777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.806777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:24.807152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.807152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:24.807152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:24.807152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:24.807152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.807152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:24.807152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:24.807152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:24.807152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:24.807152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.807152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:24.807559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:24.807559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:24.807559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.807559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:24.807559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:24.807559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:24.807559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:24.807559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:24.807559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:24.807559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:24.807559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:24.807559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.807559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:24.807559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.807942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.807942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:24.807942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.807942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.808098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:24.808651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.809146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.809146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:24.809146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.809146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:24.812185 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:24.812437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:24.812551 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:24.812695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:24.813098 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:24.813497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:24.813731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.814397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:24.814397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.814397 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:24.814397 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.814397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.814397 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:24.814397 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.814397 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:24.815281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.815281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:24.815281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:24.815281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:24.815281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.815281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:24.815281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:24.815281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.815281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:24.815281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:24.815281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:24.815281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.815702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:24.815702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:24.815702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:24.815702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:24.815702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:24.815702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:24.815702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:24.815702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:24.815702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.815702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:24.815702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.815702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.815702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:24.816069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.816069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:24.816288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.816288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:24.816288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:24.816288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:24.816288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:24.816288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:24.816288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.816288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:24.816288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:24.816288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.816288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:24.816288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:24.816288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.816288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:24.816288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:24.816288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:24.816768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:24.817283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:24.817283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:24.817283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:29.648714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:29.649703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:29.649703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:29.650983 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:29.680242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:29.680442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.680894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:29.680894 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.680894 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:29.680894 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.680894 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.680894 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:29.680894 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.680894 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:29.681637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.031 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.681637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:29.681637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:29.681637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:29.681637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.681637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:29.681637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:29.681637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.681637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:29.681637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:29.681637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:29.681637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.682113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:29.682113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:29.682113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:29.682113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:29.682113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:29.682113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:29.682113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:29.682113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:29.682113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.682113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:29.682113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.682113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.682113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:29.682606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.682606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:29.682606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.682606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:29.682606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:29.682606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:29.682606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:29.682606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:29.682606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.682606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:29.682606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:29.682606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.682606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:29.682606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:29.682606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:29.683142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.683781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:29.683781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.683781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.683781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:29.683781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.683781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:29.754242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:29.754242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:29.754607 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:29.755190 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:29.755385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:29.755599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.756290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:29.756290 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.756290 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:29.756290 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.756290 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.756290 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:29.756290 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.756290 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:29.758176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.758176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:29.758176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:29.758176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:29.758176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.758176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:29.758176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:29.758176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.758176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:29.758176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:29.758176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:29.758176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:29.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:29.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:29.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:29.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:29.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:29.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:29.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:29.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:29.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.758755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:29.759476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.759476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:29.759911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.759911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:29.759911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:29.759911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:29.759911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:29.759911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:29.759911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.759911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:29.759911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:29.759911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.759911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:29.759911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:29.759911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.759911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:29.759911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:29.759911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.760402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.760916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:29.760916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.760916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:29.795866 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:29.796233 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:29.796299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:29.796455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:42:29.796933 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:29.797233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.798032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:29.798032 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.798032 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:29.798032 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.798032 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.798032 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:29.798032 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.798032 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:29.798701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.798701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:29.798701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:29.798701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:29.798701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.798701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:29.798701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:29.798701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:29.798701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.798701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:29.798701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:29.798701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:29.798701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:29.798701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:29.798701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:29.799248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:29.799248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:29.799248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.799248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:29.799248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.799248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.799248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:29.799248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.799248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:29.799470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.799470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:29.799470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:29.799470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:29.799470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.799470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:29.799470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:29.799470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:42:29.799470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:29.799470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:29.799470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.799470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:29.799757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:29.799757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:29.799757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.799757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:29.799757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:29.799757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:29.799757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:29.799757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:29.799757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:29.799757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:29.799757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:29.799757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.799757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:29.799757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.800059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.800059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:29.800059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.800059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:29.800147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.800147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:29.800147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:29.800147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:29.800147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:29.800147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:29.800147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.800147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:29.800147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:29.800147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.800147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:29.800147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:29.800147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.800147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:29.800147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:29.800147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:29.800500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:29.800869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.800869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:29.800869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.800869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.800869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:29.800869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.800869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:29.803416 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:29.803676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:29.803791 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:29.803914 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:29.804221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:29.804467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.804919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:29.804919 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.804919 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:29.804919 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.804919 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.804919 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:29.804919 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.804919 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:29.805704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.805704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:29.805704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:29.805704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:29.805704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.805704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:29.805704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:29.805704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:29.805704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.805704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:29.805704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:29.805704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:29.805704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:29.805704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:29.805704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:29.806147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:29.806147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:29.806147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.806147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:29.806147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.806147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.806147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:29.806147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.806147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:29.806685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.806685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:29.806685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:29.806685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:29.806685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.806685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:29.806685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:29.806685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:29.806685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:29.806685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.806685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:29.807010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:29.807010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:29.807010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.807010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:29.807010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:29.807010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:29.807010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:29.807010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:29.807010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:29.807010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:29.807010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:29.807010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.807010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:29.807010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.807393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.807393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:29.807393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.807393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.807747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:29.808243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.808746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.808746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:29.808746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.808746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:29.812500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:29.812732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:29.812879 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:29.813048 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:29.813412 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:29.813731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:29.813873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.814361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:29.814361 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.814361 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:29.814361 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.814361 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.814361 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:29.814361 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.814361 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:29.815175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.815175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:29.815175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:29.815175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:29.815175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.815175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:29.815175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:29.815175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.815175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:29.815175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:29.815175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:29.815175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.815587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:29.815587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:29.815587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:29.815587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:29.815587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:29.815587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:29.815587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:29.815587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:29.815587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.815587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:29.815587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.815587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.815587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:29.815917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.815917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:29.816141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.816141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:29.816141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:29.816141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:29.816141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:29.816141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:29.816141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.816141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:29.816141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:29.816141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.816141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:29.816141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:29.816141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.816141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:29.816141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:29.816141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:29.816637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:29.817112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:29.817112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:29.817112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:34.649405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:34.650462 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:34.650462 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:34.651305 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:34.687883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:34.688293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.689003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:34.689003 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.689003 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:34.689003 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.689003 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.689003 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:34.689003 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.689003 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:34.689759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.689759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:34.689759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:34.689759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:34.689759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.689759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:34.689759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:34.689759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.689759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:34.689759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:34.689759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:34.689759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.691013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:34.691013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:34.691013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:34.691013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:34.691013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:34.691013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:34.691013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:34.691013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:34.691013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.691013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:34.691013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.691013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.691013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:34.691779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.691779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:34.691779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.691779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:34.691779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:34.691779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:34.691779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:34.691779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:34.691779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.691779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:34.691779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:34.691779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.691779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:34.691779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:34.691779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:34.692805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.693975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:34.693975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.693975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.693975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:34.693975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.693975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:34.754169 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:34.754532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:34.754711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:34.755532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:34.755848 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:34.756265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.757101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:34.757101 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.757101 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:34.757101 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.757101 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.757101 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:34.757101 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.757101 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:34.758864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.758864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:34.758864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:34.758864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:34.758864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.758864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:34.758864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:34.758864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.758864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:34.758864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:34.758864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:34.758864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.759810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:34.759810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:34.759810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:34.759810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:34.759810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:34.759810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:34.759810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:34.759810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:34.759810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.759810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:34.759810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.759810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.759810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:34.760687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.760687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:34.761025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.761025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:34.761025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:34.761025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:34.761025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:34.761025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:34.761025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.761025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:34.761025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:34.761025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.761025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:34.761025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:34.761025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.761025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:34.761025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:34.761025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.761566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.762080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:34.762080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.762080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:34.796572 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:34.797051 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:34.797294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:34.797605 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:42:34.798182 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:34.798568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.799340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:34.799340 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.799340 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:34.799340 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.799340 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.799340 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:34.799340 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.799340 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:34.800787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.800787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:34.800787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:34.800787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:34.800787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.800787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:34.800787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:34.800787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:34.800787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.800787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:34.800787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:34.800787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:34.800787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:34.800787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:34.800787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:34.802063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:34.802063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:34.802063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.802063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:34.802063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.802063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.802063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:34.802063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.802063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:34.802821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.802821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:34.802821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:34.802821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:34.802821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.802821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:34.802821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:34.802821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:42:34.802821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:34.802821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:34.802821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.802821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:34.803665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:34.803665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:34.803665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.803665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:34.803665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:34.803665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:34.803665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:34.803665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:34.803665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:34.803665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:34.803665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:34.803665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.803665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:34.803665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.804652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.804652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:34.804652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.804652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:34.805219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.805219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:34.805219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:34.805219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:34.805219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:34.805219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:34.805219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.805219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:34.805219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:34.805219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.805219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:34.805219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:34.805219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.805219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:34.805219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:34.805219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:34.806014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:34.806655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.806655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:34.806655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.806655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.806655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:34.806655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.806655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:34.806655 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:34.806655 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:34.806655 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:34.806971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:34.806971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:34.806971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.807686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:34.807686 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.807686 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:34.807686 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.807686 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.807686 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:34.807686 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.807686 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:34.808694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.808694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:34.808694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:34.808694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:34.808694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.808694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:34.808694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:34.808694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:34.808694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.808694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:34.808694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:34.808694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:34.808694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:34.808694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:34.808694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:34.809363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:34.809363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:34.809363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.809363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:34.809363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.809363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.809363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:34.809363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.809363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:34.810112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.810112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:34.810112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:34.810112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:34.810112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.810112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:34.810112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:34.810112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:34.810112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:34.810112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.810112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:34.810798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:34.810798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:34.810798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.810798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:34.810798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:34.810798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:34.810798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:34.810798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:34.810798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:34.810798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:34.810798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:34.810798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.810798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:34.810798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.811559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.811559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:34.811559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.811559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:34.811559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.811559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:34.811559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:34.811559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:34.811559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:34.811559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:34.811559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.811559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:34.811559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:34.811559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:34.811992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:34.812543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:34.812543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:34.812543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:34.812543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:34.812543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.812543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:34.812543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.812543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.812543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:34.812543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.812543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:34.812849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:34.813122 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:34.813250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:34.813498 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:34.813836 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:34.814160 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:34.814377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.814979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:34.814979 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.814979 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:34.814979 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.814979 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.814979 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:34.814979 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.814979 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:34.815638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.815638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:34.815638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:34.815638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:34.815638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.815638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:34.815638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:34.815638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.815638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:34.815638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:34.815638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:34.815638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.816029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:34.816029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:34.816029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:34.816029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:34.816029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:34.816029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:34.816029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:34.816029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:34.816029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.816029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:34.816029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.816029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.816029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:34.816472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.816472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:34.816661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.816661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:34.816661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:34.816661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:34.816661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:34.816661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:34.816661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.816661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:34.816661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:34.816661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.816661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:34.816661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:34.816661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.816661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:34.816661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:34.816661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:34.817009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:34.817397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:34.817397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:34.817397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:39.650232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:39.651152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:39.651152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:39.652606 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:39.684172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:39.684443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.685086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:39.685086 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.685086 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:39.685086 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.685086 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.685086 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:39.685086 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.685086 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:39.685886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.685886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:39.685886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:39.685886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:39.685886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.685886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:39.685886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:39.685886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.685886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:39.685886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:39.685886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:39.685886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.686313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:39.686313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:39.686313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:39.686313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:39.686313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:39.686313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:39.686313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:39.686313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:39.686313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.686313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:39.686313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.686313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.686313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:39.686949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.686949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:39.686949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.686949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:39.686949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:39.686949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:39.686949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:39.686949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:39.686949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.686949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:39.686949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:39.686949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.686949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:39.686949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:39.686949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:39.687472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.688037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:39.688037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.688037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.688037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:39.688037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.688037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:39.754818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:39.755394 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:39.755635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:39.756511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:39.756825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:39.756993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.757766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:39.757766 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.757766 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:39.757766 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.757766 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.757766 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:39.757766 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.757766 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:39.759534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.759534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:39.759534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:39.759534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:39.759534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.759534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:39.759534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:39.759534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.759534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:39.759534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:39.759534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:39.759534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.759908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:39.759908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:39.759908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:39.759908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:39.759908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:39.759908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:39.759908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:39.759908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:39.759908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.759908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:39.759908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.759908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.759908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:39.760321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.760321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:39.761181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.761181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:39.761181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:39.761181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:39.761181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:39.761181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:39.761181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.761181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:39.761181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:39.761181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.761181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:39.761181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:39.761181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.761181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:39.761181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:39.761181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.761722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.762209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:39.762209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.762209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:39.797112 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:39.797526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:39.797717 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:39.797922 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:42:39.798575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:39.798954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.800111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:39.800111 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.800111 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:39.800111 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.800111 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.800111 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:39.800111 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.800111 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:39.801299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.801299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:39.801299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:39.801299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:39.801299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.801299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:39.801299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:39.801299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:39.801299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.801299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:39.801299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:39.801299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:39.801299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:39.801299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:39.801299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:39.802265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:39.802265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:39.802265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.802265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:39.802265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.802265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.802265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:39.802265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.802265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:39.802843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.802843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:39.802843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:39.802843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:39.802843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.802843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:39.802843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:39.802843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:42:39.802843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:39.802843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:39.802843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.802843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:39.803534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:39.803534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:39.803534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.803534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:39.803534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:39.803534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:39.803534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:39.803534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:39.803534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:39.803534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:39.803534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:39.803534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.803534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:39.803534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.804409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.804409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:39.804409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.804409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:39.804409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.804409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:39.804409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:39.804409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:39.804409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:39.804409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:39.804409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.804409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:39.804409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:39.804409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:39.805295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:39.806261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:39.806261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:39.806261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:39.806261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:39.806261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:39.806261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.806261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:39.806261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.806261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.806261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:39.806261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.806261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:39.806261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:39.806261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:39.807238 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:39.807238 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:39.807238 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:39.807238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.807821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:39.807821 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.807821 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:39.807821 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.807821 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.807821 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:39.807821 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.807821 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:39.808990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.808990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:39.808990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:39.808990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:39.808990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.808990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:39.808990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:39.808990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:39.808990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.808990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:39.808990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:39.808990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:39.808990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:39.808990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:39.808990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:39.809635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:39.809635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:39.809635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.809635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:39.809635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.809635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.809635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:39.809635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.809635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:39.810329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.810329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:39.810329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:39.810329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:39.810329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.810329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:39.810329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:39.810329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:39.810329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:39.810329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.810329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:39.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:39.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:39.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:39.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:39.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:39.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:39.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:39.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:39.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:39.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:39.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:39.810885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.811335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.811335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:39.811335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.811335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.811947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:39.812509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.813068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.813068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:39.813068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.813068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:39.813244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:39.813565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:39.813684 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:39.813822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:39.814156 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:39.814447 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:39.814616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.815177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:39.815177 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.815177 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:39.815177 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.815177 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.815177 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:39.815177 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.815177 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:39.816035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.816035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:39.816035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:39.816035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:39.816035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.816035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:39.816035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:39.816035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.816035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:39.816035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:39.816035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:39.816035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.816452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:39.816452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:39.816452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:39.816452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:39.816452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:39.816452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:39.816452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:39.816452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:39.816452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.816452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:39.816452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.816452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.816452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:39.816849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.816849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:39.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:39.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:39.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:39.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:39.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:39.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:39.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:39.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:39.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:39.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:39.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:39.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:39.817569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:39.818175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:39.818175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:39.818175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:44.650818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:44.652148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:44.652148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:44.652689 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:44.684919 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:44.686179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.686455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:44.686455 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.686455 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:44.686455 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.686455 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.686455 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:44.686455 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.686455 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:44.687333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.687333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:44.687333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:44.687333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:44.687333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.687333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:44.687333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:44.687333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.687333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:44.687333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:44.687333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:44.687333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.687812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:44.687812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:44.687812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:44.687812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:44.687812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:44.687812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:44.687812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:44.687812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:44.687812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.687812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:44.687812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.687812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.687812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:44.688292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.688292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:44.688292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.688292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:44.688292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:44.688292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:44.688292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:44.688292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:44.688292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.688292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:44.688292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:44.688292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.688292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:44.688292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:44.688292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:44.688812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.689462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:44.689462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.689462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.689462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:44.689462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.689462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:44.756070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:44.756536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:44.756668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:44.758915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:44.759486 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:44.759813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.761211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:44.761211 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.761211 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:44.761211 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.761211 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.761211 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:44.761211 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.761211 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:44.762328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.762328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:44.762328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:44.762328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:44.762328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.762328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:44.762328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:44.762328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.762328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:44.762328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:44.762328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:44.762328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.762908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:44.762908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:44.762908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:44.762908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:44.762908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:44.762908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:44.762908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:44.762908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:44.762908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.762908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:44.762908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.762908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.762908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:44.763481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.763481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:44.763631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.763631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:44.763631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:44.763631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:44.763631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:44.763631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:44.763631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.763631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:44.763631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:44.763631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.763631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:44.763631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:44.763631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.763631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:44.763631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:44.763631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.764284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.765031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:44.765031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.765031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:44.797844 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:44.798555 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:44.798705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:44.798863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:42:44.799398 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:44.799640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.800304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:44.800304 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.800304 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:44.800304 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.800304 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.800304 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:44.800304 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.800304 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:44.801336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.801336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:44.801336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:44.801336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:44.801336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.801336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:44.801336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:44.801336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:44.801336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.801336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:44.801336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:44.801336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:44.801336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:44.801336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:44.801336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:44.802094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:44.802094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:44.802094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.802094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:44.802094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.802094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.802094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:44.802094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.802094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:44.802560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.802560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:44.802560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:44.802560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:44.802560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.802560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:44.802560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:44.802560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:42:44.802560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:44.802560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:44.802560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.802560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:44.803063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:44.803063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:44.803063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.803063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:44.803063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:44.803063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:44.803063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:44.803063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:44.803063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:44.803063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:44.803063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:44.803063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.803063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:44.803063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.803628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.803628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:44.803628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.803628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:44.803801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.803801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:44.803801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:44.803801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:44.803801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:44.803801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:44.803801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.803801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:44.803801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:44.803801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.803801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:44.803801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:44.803801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.803801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:44.803801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:44.803801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:44.804875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:44.805865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.805865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:44.805865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.805865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.805865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:44.805865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.805865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:44.806220 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:44.806558 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:44.806705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:44.806868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:44.807287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:44.807557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.808219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:44.808219 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.808219 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:44.808219 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.808219 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.808219 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:44.808219 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.808219 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:44.808991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.808991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:44.808991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:44.808991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:44.808991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.808991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:44.808991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:44.808991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:44.808991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.808991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:44.808991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:44.808991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:44.808991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:44.808991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:44.808991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:44.809596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:44.809596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:44.809596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.809596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:44.809596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.809596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.809596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:44.809596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.809596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:44.810025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.810025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:44.810025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:44.810025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:44.810025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.810025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:44.810025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:44.810025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:44.810025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:44.810025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.810025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:44.810400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:44.810400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:44.810400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.810400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:44.810400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:44.810400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:44.810400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:44.810400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:44.810400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:44.810400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:44.810400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:44.810400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.810400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:44.810400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.810837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.810837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:44.810837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.810837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.811426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:44.813112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.813930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.813930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:44.813930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.813930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:44.813930 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:44.814130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:44.814262 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:44.814417 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:44.814890 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:44.815221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:44.815472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.816202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:44.816202 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.816202 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:44.816202 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.816202 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.816202 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:44.816202 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.816202 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:44.817187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.817187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:44.817187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:44.817187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:44.817187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.817187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:44.817187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:44.817187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.817187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:44.817187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:44.817187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:44.817187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.817692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:44.817692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:44.817692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:44.817692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:44.817692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:44.817692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:44.817692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:44.817692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:44.817692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.817692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:44.817692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.817692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.817692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:44.818168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.818168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:44.818519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.818519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:44.818519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:44.818519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:44.818519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:44.818519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:44.818519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.818519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:44.818519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:44.818519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.818519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:44.818519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:44.818519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.818519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:44.818519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:44.818519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:44.819153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:44.819910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:44.819910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:44.819910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:49.651659 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:49.652899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:49.653124 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:49.654525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:49.687393 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:49.687599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.688105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:49.688105 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.688105 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:49.688105 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.688105 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.688105 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:49.688105 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.688105 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:49.688815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.688815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:49.688815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:49.688815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:49.688815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.688815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:49.688815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:49.688815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.688815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:49.688815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:49.688815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:49.688815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.689355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:49.689355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:49.689355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:49.689355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:49.689355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:49.689355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:49.689355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:49.689355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:49.689355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.689355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:49.689355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.689355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.689355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:49.689964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.689964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:49.689964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.689964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:49.689964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:49.689964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:49.689964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:49.689964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:49.689964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.689964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:49.689964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:49.689964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.689964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:49.689964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:49.689964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:49.691230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.692010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:49.692010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.692010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.692010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:49.692010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.692010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:49.756405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:49.756855 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:49.757050 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:49.758386 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:49.758885 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:49.758994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.759957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:49.759957 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.759957 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:49.759957 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.759957 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.759957 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:49.759957 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.759957 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:49.761650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.761650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:49.761650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:49.761650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:49.761650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.761650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:49.761650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:49.761650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.761650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:49.761650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:49.761650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:49.761650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.762241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:49.762241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:49.762241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:49.762241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:49.762241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:49.762241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:49.762241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:49.762241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:49.762241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.762241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:49.762241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.762241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.762241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:49.762947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.762947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:49.763459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.763459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:49.763459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:49.763459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:49.763459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:49.763459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:49.763459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.763459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:49.763459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:49.763459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.763459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:49.763459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:49.763459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.763459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:49.763459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:49.763459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.764252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.765035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:49.765035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.765035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:49.798315 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:49.798668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:49.798846 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:49.799060 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:42:49.799770 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:49.800083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.801239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:49.801239 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.801239 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:49.801239 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.801239 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.801239 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:49.801239 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.801239 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:49.802598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.802598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:49.802598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:49.802598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:49.802598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.802598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:49.802598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:49.802598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:49.802598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.802598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:49.802598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:49.802598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:49.802598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:49.802598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:49.802598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:49.803310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:49.803310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:49.803310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.803310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:49.803310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.803310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.803310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:49.803310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.803310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:49.804206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.804206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:49.804206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:49.804206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:49.804206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.804206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:49.804206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:49.804206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:42:49.804206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:49.804206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:49.804206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.804206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:49.805362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:49.805362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:49.805362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.805362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:49.805362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:49.805362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:49.805362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:49.805362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:49.805362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:49.805362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:49.805362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:49.805362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.805362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:49.805362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.806578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.806578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:49.806578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.806578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:49.806578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.806578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:49.806578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:49.806578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:49.806578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:49.806578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:49.806578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.806578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:49.806578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:49.806578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:49.807227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:49.808020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:49.808020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:49.808020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:49.808020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:49.808020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:49.808020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.808020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:49.808020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.808020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.808020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:49.808020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.808020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:49.808020 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:49.808020 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:49.809421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:49.809421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:49.809421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:49.809421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.809421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:49.809421 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.809421 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:49.809421 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.809421 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.809421 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:49.809421 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.809421 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:49.810538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.810538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:49.810538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:49.810538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:49.810538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.810538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:49.810538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:49.810538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:49.810538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.810538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:49.810538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:49.810538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:49.810538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:49.810538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:49.810538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:49.811951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:49.811951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:49.811951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.811951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:49.811951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.811951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.811951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:49.811951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.811951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:49.811951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.811951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:49.811951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:49.811951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:49.811951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.813097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:49.813097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:49.813097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:49.813097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:49.813097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.813097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:49.813097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:49.813097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:49.813097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.813097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:49.813097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:49.813097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:49.813097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:49.813471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:49.813471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:49.813471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:49.813471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:49.813471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.813471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:49.813471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.813471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.813471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:49.813471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.813471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:49.813471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:49.813874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.814670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:49.815046 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:49.815046 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:49.815046 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:49.815046 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:49.815046 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:49.815489 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:49.815639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.816666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:49.816666 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.816666 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:49.816666 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.816666 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.816666 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:49.816666 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.816666 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:49.817575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.817575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:49.817575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:49.817575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:49.817575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.817575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:49.817575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:49.817575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.817575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:49.817575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:49.817575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:49.817575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.817924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:49.817924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:49.817924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:49.817924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:49.817924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:49.817924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:49.817924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:49.817924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:49.817924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.817924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:49.817924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.817924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.817924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:49.818150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.818150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:49.818509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.818509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:49.818509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:49.818509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:49.818509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:49.818509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:49.818509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.818509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:49.818509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:49.818509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.818509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:49.818509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:49.818509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.818509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:49.818509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:49.818509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:49.818839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:49.819242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:49.819242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:49.819242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:54.653109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:54.653792 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:54.653792 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:54.655041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:54.656933 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:42:54.693535 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:54.693956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.695095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:54.695095 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.695095 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:54.695095 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.695095 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.695095 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:54.695095 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.695095 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:54.696390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.696390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:54.696390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:54.696390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:54.696390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.696390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:54.696390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:54.696390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.696390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:54.696390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:54.696390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:54.696390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.697578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:54.697578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:54.697578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:54.697578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:54.697578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:54.697578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:54.697578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:54.697578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:54.697578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.697578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:54.697578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.697578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.697578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:54.698258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.698258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:54.698258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.698258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:54.698258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:54.698258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:54.698258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:54.698258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:54.698258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.698258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:54.698258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:54.698258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.698258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:54.698258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:54.698258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:54.699126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.699711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:54.699711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.699711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.699711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:54.699711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.699711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:54.757029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:54.757732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:54.757946 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:54.759085 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:54.759498 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:54.759801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.760650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:54.760650 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.760650 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:54.760650 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.760650 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.760650 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:54.760650 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.760650 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:54.762127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.762127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:54.762127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:54.762127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:54.762127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.762127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:54.762127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:54.762127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.762127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:54.762127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:54.762127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:54.762127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.763416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:54.763416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:54.763416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:54.763416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:54.763416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:54.763416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:54.763416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:54.763416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:54.763416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.763416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:54.763416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.763416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.763416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:54.764586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.764586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:54.764586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.764586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:54.764586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:54.764586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:54.764586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:54.764586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:54.764586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.764586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:54.764586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:54.764586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.764586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:54.764586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:54.764586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:54.765981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.767226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:54.767226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.767226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.767226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:54.767226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.767226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:54.798913 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:54.799482 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:54.799732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:54.799996 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:42:54.800709 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:54.801023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.801916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:54.801916 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.801916 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:54.801916 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.801916 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.801916 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:54.801916 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.801916 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:54.803584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.803584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:54.803584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:54.803584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:54.803584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.803584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:54.803584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:54.803584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:54.803584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.803584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:54.803584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:54.803584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:54.803584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:54.803584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:54.803584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:54.804627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:54.804627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:54.804627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.804627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:54.804627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.804627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.804627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:54.804627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.804627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:54.805290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.805290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:54.805290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:54.805290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:54.805290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.805290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:54.805290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:54.805290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:42:54.805290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:54.805290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:54.805290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.805290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:54.806066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:54.806066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:54.806066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.806066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:54.806066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:54.806066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:54.806066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:54.806066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:54.806066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:54.806066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:54.806066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:54.806066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.806066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:54.806066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.807333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.807333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:54.807333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.807333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:54.807622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.807622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:54.807622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:54.807622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:54.807622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:54.807622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:54.807622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.807622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:54.807622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:54.807622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.807622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:54.807622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:54.807622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.807622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:54.807622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:54.807622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:54.808328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:54.808826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.808826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:54.808826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.808826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.808826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:54.808826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.808826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:54.808826 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:54.808826 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:54.808826 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:54.809110 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:54.809110 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:54.809538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.809943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:54.809943 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.809943 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:54.809943 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.809943 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.809943 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:54.809943 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.809943 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:54.810863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.810863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:54.810863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:54.810863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:54.810863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.810863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:54.810863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:54.810863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:54.810863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.810863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:54.810863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:54.810863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:54.810863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:54.810863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:54.810863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:54.811760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:54.811760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:54.811760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.811760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:54.811760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.811760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.811760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:54.811760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.811760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:54.812266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.812266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:54.812266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:54.812266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:54.812266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.812266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:54.812266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:54.812266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:54.812266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:54.812266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.812266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:54.812651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:54.812651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:54.812651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.812651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:54.812651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:54.812651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:54.812651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:54.812651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:54.812651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:54.812651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:54.812651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:54.812651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.812651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:54.812651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.812980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.812980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:54.812980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.812980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.813425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:54.814395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.815109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.815109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:54.815109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.815109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:54.815109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:54.815109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:54.815109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:54.815109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:54.815587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:54.815881 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:54.816102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.816794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:54.816794 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.816794 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:54.816794 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.816794 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.816794 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:54.816794 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.816794 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:54.817717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.817717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:54.817717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:54.817717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:54.817717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.817717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:54.817717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:54.817717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.817717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:54.817717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:54.817717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:54.817717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.818212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:54.818212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:54.818212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:54.818212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:54.818212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:54.818212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:54.818212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:54.818212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:54.818212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.818212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:54.818212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.818212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.818212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:54.818610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.818610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:54.818977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.818977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:54.818977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:54.818977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:54.818977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:54.818977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:54.818977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.818977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:54.818977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:54.818977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.818977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:54.818977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:54.818977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.818977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:54.818977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:54.818977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:54.819358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:54.819723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:54.819723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:54.819723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:59.653862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:59.654686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:59.654966 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:59.656473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:59.692505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:59.692911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.694034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:59.694034 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.694034 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:59.694034 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.694034 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.694034 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:59.694034 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.694034 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:59.694968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.694968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:59.694968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:59.694968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:59.694968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.694968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:59.694968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:59.694968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.694968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:59.694968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:59.694968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:59.694968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.695346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:59.695346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:59.695346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:59.695346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:59.695346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:59.695346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:59.695346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:59.695346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:59.695346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.695346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:59.695346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.695346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.695346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:59.695765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.695765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:59.696108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.696108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:59.696108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:59.696108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:59.696108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:59.696108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:59.696108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.696108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:59.696108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:59.696108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.696108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:59.696108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:59.696108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.696108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:59.696108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:59.696108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.696658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.697192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:59.697192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.697192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:59.757997 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:59.758539 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:59.758641 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:59.759652 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:59.759972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:59.760224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.761040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:59.761040 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.761040 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:59.761040 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.761040 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.761040 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:59.761040 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.761040 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:59.762153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.762153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:59.762153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:59.762153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:59.762153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.762153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:59.762153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:59.762153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.762153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:59.762153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:59.762153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:59.762153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.762632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:59.762632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:59.762632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:59.762632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:59.762632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:59.762632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:59.762632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:59.762632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:59.762632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.762632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:59.762632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.762632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.762632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:59.763099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.763099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:59.763806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.763806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:59.763806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:59.763806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:59.763806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:59.763806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:59.763806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.763806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:59.763806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:59.763806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.763806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:59.763806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:59.763806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.763806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:59.763806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:59.763806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.764432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.765103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:59.765103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.765103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:59.799477 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:59.799985 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:59.800193 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:59.800476 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:42:59.800968 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:59.801260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.802112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:59.802112 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.802112 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:59.802112 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.802112 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.802112 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:59.802112 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.802112 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:59.803486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.803486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:59.803486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:59.803486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:59.803486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.803486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:59.803486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:59.803486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:59.803486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.803486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:59.803486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:59.803486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:59.803486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:59.803486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:59.803486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:59.804701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:59.804701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:59.804701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.804701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:59.804701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.804701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.804701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:59.804701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.804701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:59.805449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.805449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:59.805449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:59.805449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:59.805449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.805449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:59.805449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:59.805449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:42:59.805449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:59.805449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:59.805449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.805449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:59.806244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:59.806244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:59.806244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.806244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:59.806244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:59.806244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:59.806244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:59.806244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:59.806244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:59.806244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:59.806244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:59.806244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.806244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:59.806244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.807128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.807128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:59.807128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.807128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:59.807128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.807128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:59.807128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:59.807128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:59.807128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:59.807128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:59.807128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.807128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:59.807128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:59.807128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:59.808051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:59.809255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:59.809255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:59.809255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:59.809255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:59.809255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:59.809255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.809255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:59.809255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.809255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.809255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:59.809255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.809255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:59.809255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:59.809255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:59.810281 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:59.810281 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:59.810281 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:59.810281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.810865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:59.810865 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.810865 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:59.810865 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.810865 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.810865 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:59.810865 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.810865 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:59.811835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.811835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:42:59.811835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:59.811835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:59.811835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.811835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:59.811835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:59.811835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:59.811835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.811835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:42:59.811835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:59.811835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:42:59.811835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:59.811835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:42:59.811835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:42:59.812233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:59.812233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:42:59.812233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.812233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:42:59.812233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.812233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.812233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:42:59.812233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.812233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:42:59.812709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.812709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:59.812709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:59.812709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:59.812709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.812709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:59.812709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:59.812709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:59.812709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:59.812709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.812709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:59.813026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:59.813026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:59.813026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.813026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:59.813026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:59.813026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:59.813026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:59.813026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:59.813026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:59.813026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:59.813026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:59.813026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.813026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:59.813026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.813447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.813447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:59.813447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.813447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.813801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:59.814276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.814808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.814808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:59.814808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.814808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:42:59.814926 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:42:59.815141 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:42:59.815251 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:42:59.815432 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:42:59.815835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:59.816169 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:42:59.816395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.817076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:42:59.817076 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.817076 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:42:59.817076 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.817076 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.817076 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:42:59.817076 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.817076 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:42:59.817936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.817936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:42:59.817936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:59.817936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:42:59.817936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.817936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:59.817936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:59.817936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.817936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:59.817936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:59.817936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:59.817936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.818290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:42:59.818290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:59.818290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:42:59.818290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:59.818290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:42:59.818290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:42:59.818290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:59.818290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:42:59.818290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.818290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:42:59.818290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.818290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.818290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:42:59.818809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.818809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:42:59.818915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.818915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:42:59.818915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:42:59.818915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:42:59.818915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:42:59.818915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:42:59.818915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.818915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:42:59.818915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:42:59.818915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.818915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:42:59.818915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:42:59.818915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.818915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:42:59.818915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:42:59.818915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:42:59.819569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:42:59.820268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:42:59.820268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:42:59.820268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:04.654703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:04.655521 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:04.655521 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:04.656273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:04.690137 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:04.690442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.691051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:04.691051 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.691051 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:04.691051 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.691051 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.691051 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:04.691051 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.691051 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:04.691967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.691967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:04.691967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:04.691967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:04.691967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.691967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:04.691967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:04.691967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.691967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:04.691967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:04.691967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:04.691967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.692358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:04.692358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:04.692358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:04.692358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:04.692358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:04.692358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:04.692358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:04.692358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:04.692358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.692358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:04.692358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.692358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.692358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:04.692791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.692791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:04.693115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.693115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:04.693115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:04.693115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:04.693115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:04.693115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:04.693115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.693115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:04.693115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:04.693115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.693115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:04.693115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:04.693115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.693115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:04.693115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:04.693115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.694528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.695166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:04.695166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.695166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:04.758760 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:04.759343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:04.759553 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:04.760332 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:04.760504 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:04.760620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.761200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:04.761200 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.761200 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:04.761200 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.761200 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.761200 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:04.761200 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.761200 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:04.762614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.762614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:04.762614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:04.762614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:04.762614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.762614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:04.762614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:04.762614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.762614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:04.762614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:04.762614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:04.762614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.762984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:04.762984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:04.762984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:04.762984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:04.762984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:04.762984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:04.762984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:04.762984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:04.762984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.762984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:04.762984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.762984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.762984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:04.763353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.763353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:04.764343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.764343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:04.764343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:04.764343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:04.764343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:04.764343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:04.764343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.764343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:04.764343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:04.764343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.764343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:04.764343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:04.764343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.764343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:04.764343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:04.764343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.764842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.765357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:04.765357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.765357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:04.800027 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:04.800701 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:04.800876 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:04.801055 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:43:04.801662 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:04.801950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.802788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:04.802788 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.802788 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:04.802788 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.802788 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.802788 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:04.802788 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.802788 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:04.804006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.804006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:04.804006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:04.804006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:04.804006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.804006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:04.804006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:04.804006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:04.804006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.804006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:04.804006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:04.804006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:04.804006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:04.804006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:04.804006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:04.804926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:04.804926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:04.804926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.804926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:04.804926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.804926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.804926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:04.804926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.804926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:04.805566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.805566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:04.805566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:04.805566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:04.805566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.805566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:04.805566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:04.805566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:43:04.805566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:04.805566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:04.805566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.805566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:04.806129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:04.806129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:04.806129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.806129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:04.806129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:04.806129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:04.806129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:04.806129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:04.806129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:04.806129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:04.806129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:04.806129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.806129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:04.806129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.806910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.806910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:04.806910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.806910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:04.806910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.806910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:04.806910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:04.806910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:04.806910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:04.806910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:04.806910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.806910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:04.806910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:04.806910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:04.807549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:04.808482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:04.808482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:04.808482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:04.808482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:04.808482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:04.808482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.808482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:04.808482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.808482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.808482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:04.808482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.808482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:04.809035 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:04.809035 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:04.809035 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:04.809221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:04.809532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:04.809753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.810229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:04.810229 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.810229 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:04.810229 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.810229 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.810229 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:04.810229 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.810229 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:04.811124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.811124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:04.811124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:04.811124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:04.811124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.811124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:04.811124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:04.811124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:04.811124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.811124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:04.811124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:04.811124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:04.811124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:04.811124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:04.811124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:04.811656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:04.811656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:04.811656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.811656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:04.811656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.811656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.811656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:04.811656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.811656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:04.812058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.812058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:04.812058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:04.812058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:04.812058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.812058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:04.812058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:04.812058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:04.812058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:04.812058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.812058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:04.812489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:04.812489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:04.812489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.812489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:04.812489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:04.812489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:04.812489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:04.812489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:04.812489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:04.812489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:04.812489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:04.812489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.812489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:04.812489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.812953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.812953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:04.812953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.812953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.813270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:04.813845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.814462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.814462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:04.814462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.814462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:04.815239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:04.815497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:04.815608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:04.815762 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:04.816274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:04.816520 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:04.816662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.817261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:04.817261 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.817261 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:04.817261 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.817261 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.817261 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:04.817261 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.817261 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:04.818714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.818714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:04.818714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:04.818714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:04.818714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.818714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:04.818714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:04.818714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.818714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:04.818714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:04.818714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:04.818714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.819198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:04.819198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:04.819198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:04.819198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:04.819198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:04.819198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:04.819198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:04.819198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:04.819198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.819198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:04.819198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.819198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.819198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:04.819737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.819737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:04.820544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.820544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:04.820544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:04.820544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:04.820544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:04.820544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:04.820544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.820544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:04.820544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:04.820544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.820544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:04.820544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:04.820544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.820544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:04.820544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:04.820544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:04.821060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:04.821633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:04.821633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:04.821633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:09.655515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:09.656610 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:09.656610 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:09.657995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:09.687844 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:09.688275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.689260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:09.689260 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.689260 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:09.689260 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.689260 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.689260 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:09.689260 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.689260 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:09.690029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.690029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:09.690029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:09.690029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:09.690029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.690029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:09.690029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:09.690029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.690029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:09.690029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:09.690029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:09.690029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.690427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:09.690427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:09.690427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:09.690427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:09.690427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:09.690427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:09.690427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:09.690427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:09.690427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.690427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:09.690427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.690427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.690427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:09.690781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.690781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:09.690781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.690781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:09.690781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:09.690781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:09.690781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:09.690781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:09.690781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.690781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:09.690781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:09.690781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.690781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:09.690781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:09.690781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:09.691219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.692041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:09.692041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.692041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.692041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:09.692041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.692041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:09.759484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:09.759994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:09.760200 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:09.761384 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:09.761825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:09.762090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.763114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:09.763114 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.763114 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:09.763114 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.763114 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.763114 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:09.763114 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.763114 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:09.765061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.765061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:09.765061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:09.765061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:09.765061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.765061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:09.765061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:09.765061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.765061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:09.765061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:09.765061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:09.765061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.765466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:09.765466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:09.765466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:09.765466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:09.765466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:09.765466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:09.765466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:09.765466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:09.765466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.765466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:09.765466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.765466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.765466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:09.765797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.765797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:09.767175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.767175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:09.767175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:09.767175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:09.767175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:09.767175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:09.767175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.767175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:09.767175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:09.767175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.767175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:09.767175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:09.767175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.767175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:09.767175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:09.767175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.768082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.768582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:09.768582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.768582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:09.800553 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:09.800909 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:09.801082 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:09.801293 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:43:09.802068 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:09.802426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.803405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:09.803405 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.803405 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:09.803405 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.803405 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.803405 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:09.803405 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.803405 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:09.804691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.804691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:09.804691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:09.804691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:09.804691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.804691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:09.804691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:09.804691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:09.804691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.804691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:09.804691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:09.804691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:09.804691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:09.804691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:09.804691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:09.805443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:09.805443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:09.805443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.805443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:09.805443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.805443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.805443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:09.805443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.805443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:09.805997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.805997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:09.805997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:09.805997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:09.805997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.805997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:09.805997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:09.805997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:43:09.805997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:09.805997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:09.805997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.805997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:09.806785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:09.806785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:09.806785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.806785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:09.806785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:09.806785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:09.806785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:09.806785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:09.806785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:09.806785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:09.806785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:09.806785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.806785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:09.806785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.808090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.808090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:09.808090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.808090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:09.808090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.808090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:09.808090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:09.808090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:09.808090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:09.808090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:09.808090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.808090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:09.808090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:09.808090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:09.808659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:09.809134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:09.809134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:09.809134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:09.809134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:09.809134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:09.809134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.809134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:09.809134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.809134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.809134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:09.809134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.809134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:09.809134 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:09.809505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:09.809559 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:09.809769 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:09.810260 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:09.810804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.811811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:09.811811 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.811811 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:09.811811 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.811811 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.811811 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:09.811811 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.811811 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:09.812954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.812954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:09.812954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:09.812954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:09.812954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.812954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:09.812954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:09.812954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:09.812954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.812954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:09.812954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:09.812954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:09.812954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:09.812954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:09.812954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:09.813805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:09.813805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:09.813805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.813805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:09.813805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.813805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.813805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:09.813805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.813805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:09.814291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.814291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:09.814291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:09.814291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:09.814291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.814291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:09.814291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:09.814291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:09.814291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:09.814291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.814291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:09.814937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:09.814937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:09.814937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.814937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:09.814937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:09.814937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:09.814937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:09.814937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:09.814937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:09.814937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:09.814937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:09.814937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.814937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:09.814937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.815303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.815303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:09.815303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.815303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.816013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:09.816544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.817008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.817008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:09.817008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.817008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:09.817008 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:09.817008 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:09.817008 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:09.817310 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:09.817740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:09.818087 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:09.818312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.819090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:09.819090 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.819090 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:09.819090 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.819090 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.819090 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:09.819090 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.819090 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:09.820749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.820749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:09.820749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:09.820749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:09.820749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.820749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:09.820749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:09.820749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.820749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:09.820749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:09.820749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:09.820749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.821451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:09.821451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:09.821451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:09.821451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:09.821451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:09.821451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:09.821451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:09.821451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:09.821451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.821451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:09.821451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.821451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.821451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:09.822114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.822114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:09.822590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.822590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:09.822590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:09.822590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:09.822590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:09.822590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:09.822590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.822590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:09.822590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:09.822590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.822590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:09.822590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:09.822590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.822590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:09.822590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:09.822590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:09.823423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:09.823958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:09.823958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:09.823958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:14.656222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:14.656803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:14.656803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:14.658242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:14.691297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:14.691810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.692714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:14.692714 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.692714 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:14.692714 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.692714 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.692714 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:14.692714 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.692714 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:14.693695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.693695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:14.693695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:14.693695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:14.693695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.693695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:14.693695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:14.693695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.693695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:14.693695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:14.693695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:14.693695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.694047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:14.694047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:14.694047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:14.694047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:14.694047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:14.694047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:14.694047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:14.694047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:14.694047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.694047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:14.694047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.694047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.694047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:14.694414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.694414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:14.694751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.694751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:14.694751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:14.694751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:14.694751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:14.694751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:14.694751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.694751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:14.694751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:14.694751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.694751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:14.694751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:14.694751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.694751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:14.694751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:14.694751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.695244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.695728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:14.695728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.695728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:14.760515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:14.760732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:14.760930 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:14.761963 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:14.762185 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:14.762301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.762990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:14.762990 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.762990 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:14.762990 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.762990 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.762990 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:14.762990 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.762990 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:14.764638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.764638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:14.764638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:14.764638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:14.764638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.764638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:14.764638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:14.764638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.764638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:14.764638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:14.764638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:14.764638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.765050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:14.765050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:14.765050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:14.765050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:14.765050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:14.765050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:14.765050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:14.765050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:14.765050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.765050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:14.765050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.765050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.765050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:14.765443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.765443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:14.766379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.766379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:14.766379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:14.766379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:14.766379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:14.766379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:14.766379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.766379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:14.766379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:14.766379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.766379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:14.766379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:14.766379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.766379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:14.766379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:14.766379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.766979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.767593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:14.767593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.767593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:14.801311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:14.801637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:14.801762 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:14.801894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:43:14.802504 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:14.802807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.803719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:14.803719 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.803719 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:14.803719 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.803719 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.803719 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:14.803719 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.803719 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:14.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:14.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:14.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:14.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:14.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:14.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:14.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:14.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:14.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:14.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:14.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:14.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:14.805407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:14.805407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:14.805407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.805407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:14.805407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.805407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.805407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:14.805407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.805407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:14.806340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.806340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:14.806340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:14.806340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:14.806340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.806340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:14.806340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:14.806340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:43:14.806340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:14.806340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:14.806340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.806340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:14.806641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:14.806641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:14.806641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.806641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:14.806641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:14.806641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:14.806641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:14.806641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:14.806641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:14.806641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:14.806641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:14.806641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.806641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:14.806641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.806948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.806948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:14.806948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.806948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:14.808088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.808088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:14.808088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:14.808088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:14.808088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:14.808088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:14.808088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.808088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:14.808088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:14.808088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.808088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:14.808088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:14.808088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.808088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:14.808088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:14.808088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:14.808503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:14.808846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.808846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:14.808846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.808846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.808846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:14.808846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.808846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:14.809446 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:14.809746 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:14.809920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:14.810115 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:14.810623 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:14.811009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.811797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:14.811797 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.811797 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:14.811797 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.811797 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.811797 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:14.811797 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.811797 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:14.812569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.812569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:14.812569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:14.812569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:14.812569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.812569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:14.812569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:14.812569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:14.812569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.812569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:14.812569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:14.812569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:14.812569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:14.812569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:14.812569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:14.813077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:14.813077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:14.813077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.813077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:14.813077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.813077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.813077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:14.813077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.813077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:14.813496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.813496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:14.813496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:14.813496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:14.813496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.813496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:14.813496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:14.813496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:14.813496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:14.813496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.813496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:14.813888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:14.813888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:14.813888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.813888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:14.813888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:14.813888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:14.813888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:14.813888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:14.813888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:14.813888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:14.813888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:14.813888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.813888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:14.813888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.814355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.814355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:14.814355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.814355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.814580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:14.815398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.816179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.816179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:14.816179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.816179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:14.816962 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:14.817168 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:14.817281 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:14.817436 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:14.818055 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:14.818373 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:14.818590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.819201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:14.819201 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.819201 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:14.819201 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.819201 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.819201 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:14.819201 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.819201 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:14.820019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.820019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:14.820019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:14.820019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:14.820019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.820019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:14.820019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:14.820019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.820019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:14.820019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:14.820019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:14.820019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.820593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:14.820593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:14.820593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:14.820593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:14.820593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:14.820593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:14.820593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:14.820593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:14.820593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.820593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:14.820593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.820593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.820593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:14.821119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.821119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:14.821119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.821119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:14.821119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:14.821119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:14.821119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:14.821119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:14.821119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.821119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:14.821119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:14.821119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.821119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:14.821119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:14.821119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:14.821619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:14.822466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:14.822466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:14.822466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:14.822466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:14.822466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:14.822466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:19.656859 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:19.657879 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:19.658174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:19.659522 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:19.687809 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:19.688355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.689396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:19.689396 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.689396 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:19.689396 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.689396 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.689396 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:19.689396 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.689396 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:19.690126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.031 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.690126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:19.690126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:19.690126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:19.690126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.690126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:19.690126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:19.690126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.690126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:19.690126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:19.690126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:19.690126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.690810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:19.690810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:19.690810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:19.690810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:19.690810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:19.690810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:19.690810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:19.690810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:19.690810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.690810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:19.690810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.690810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.690810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:19.691556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.691556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:19.691556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.691556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:19.691556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:19.691556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:19.691556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:19.691556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:19.691556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.691556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:19.691556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:19.691556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.691556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:19.691556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:19.691556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:19.692298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.692878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:19.692878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.692878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.692878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:19.692878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.692878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:19.760910 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:19.761591 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:19.761798 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:19.763140 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:19.763699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:19.763991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.764778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:19.764778 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.764778 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:19.764778 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.764778 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.764778 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:19.764778 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.764778 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:19.765695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.765695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:19.765695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:19.765695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:19.765695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.765695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:19.765695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:19.765695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.765695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:19.765695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:19.765695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:19.765695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.766098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:19.766098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:19.766098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:19.766098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:19.766098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:19.766098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:19.766098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:19.766098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:19.766098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.766098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:19.766098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.766098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.766098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:19.766491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.766491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:19.767272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.767272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:19.767272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:19.767272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:19.767272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:19.767272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:19.767272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.767272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:19.767272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:19.767272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.767272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:19.767272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:19.767272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.767272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:19.767272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:19.767272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.767839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.768607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:19.768607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.768607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:19.801888 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:19.802475 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:19.802607 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:19.802747 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:43:19.803393 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:19.804114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.805033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:19.805033 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.805033 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:19.805033 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.805033 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.805033 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:19.805033 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.805033 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:19.805982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.805982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:19.805982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:19.805982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:19.805982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.805982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:19.805982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:19.805982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:19.805982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.805982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:19.805982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:19.805982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:19.805982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:19.805982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:19.805982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:19.807796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:19.807796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:19.807796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.807796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:19.807796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.807796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.807796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:19.807796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.807796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:19.807796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.807796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:19.807796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:19.807796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:19.807796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.808549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:19.808549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:19.808549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:43:19.808549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:19.808549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:19.808549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.808549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:19.808549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:19.808549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:19.808549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.808549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:19.808549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:19.808549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:19.809116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:19.809116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:19.809116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:19.809116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:19.809116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:19.809116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.809116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:19.809116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.809116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.809116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:19.809116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.809116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:19.809879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.809879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:19.809879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:19.809879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:19.809879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:19.809879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:19.809879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.809879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:19.809879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:19.809879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.809879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:19.809879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:19.809879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.809879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:19.809879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:19.809879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:19.810571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:19.811386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.811386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:19.811386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.811386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.811386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:19.811386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.811386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:19.811386 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:19.811386 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:19.811386 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:19.811902 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:19.811902 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:19.811902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.812595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:19.812595 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.812595 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:19.812595 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.812595 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.812595 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:19.812595 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.812595 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:19.813669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.813669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:19.813669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:19.813669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:19.813669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.813669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:19.813669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:19.813669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:19.813669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.813669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:19.813669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:19.813669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:19.813669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:19.813669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:19.813669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:19.814097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:19.814097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:19.814097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.814097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:19.814097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.814097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.814097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:19.814097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.814097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:19.814949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.814949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:19.814949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:19.814949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:19.814949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.814949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:19.814949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:19.814949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:19.814949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:19.814949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.814949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:19.815329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:19.815329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:19.815329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.815329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:19.815329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:19.815329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:19.815329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:19.815329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:19.815329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:19.815329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:19.815329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:19.815329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.815329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:19.815329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.815756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.815756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:19.815756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.815756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.816427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:19.816930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.817474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.817474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:19.817474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.817474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:19.817474 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:19.817474 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:19.817669 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:19.817782 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:19.818221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:19.818620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:19.818857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.819532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:19.819532 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.819532 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:19.819532 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.819532 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.819532 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:19.819532 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.819532 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:19.820207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.820207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:19.820207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:19.820207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:19.820207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.820207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:19.820207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:19.820207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.820207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:19.820207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:19.820207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:19.820207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.820601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:19.820601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:19.820601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:19.820601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:19.820601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:19.820601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:19.820601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:19.820601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:19.820601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.820601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:19.820601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.820601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.820601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:19.820958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.820958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:19.820958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.820958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:19.820958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:19.820958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:19.820958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:19.820958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:19.820958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.820958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:19.820958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:19.820958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.820958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:19.820958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:19.820958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:19.821400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:19.822023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:19.822023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:19.822023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:19.822023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:19.822023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:19.822023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:24.657668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:24.658511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:24.658511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:24.659714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:24.695547 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:24.695547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.696066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:24.696066 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.696066 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:24.696066 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.696066 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.696066 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:24.696066 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.696066 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:24.697346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.697346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:24.697346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:24.697346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:24.697346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.697346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:24.697346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:24.697346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.697346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:24.697346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:24.697346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:24.697346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.697941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:24.697941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:24.697941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:24.697941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:24.697941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:24.697941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:24.697941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:24.697941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:24.697941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.697941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:24.697941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.697941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.697941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:24.698349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.698349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:24.698500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.698500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:24.698500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:24.698500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:24.698500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:24.698500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:24.698500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.698500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:24.698500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:24.698500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.698500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:24.698500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:24.698500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.698500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:24.698500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:24.698500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.699204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.699954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:24.699954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.699954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:24.761657 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:24.762342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:24.762485 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:24.763382 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:24.763675 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:24.763828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.764485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:24.764485 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.764485 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:24.764485 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.764485 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.764485 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:24.764485 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.764485 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:24.765505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.765505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:24.765505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:24.765505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:24.765505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.765505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:24.765505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:24.765505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.765505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:24.765505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:24.765505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:24.765505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.766151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:24.766151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:24.766151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:24.766151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:24.766151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:24.766151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:24.766151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:24.766151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:24.766151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.766151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:24.766151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.766151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.766151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:24.766818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.766818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:24.766818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.766818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:24.766818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:24.766818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:24.766818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:24.766818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:24.766818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.766818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:24.766818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:24.766818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.766818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:24.766818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:24.766818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:24.767630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.768491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:24.768491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.768491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.768491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:24.768491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.768491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:24.802447 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:24.802746 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:24.802859 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:24.802960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:43:24.803563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:24.803779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.804335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:24.804335 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.804335 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:24.804335 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.804335 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.804335 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:24.804335 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.804335 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:24.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:24.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:24.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:24.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:24.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:24.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:24.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:24.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:24.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:24.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:24.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:24.805061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:24.805916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:24.805916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:24.805916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.805916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:24.805916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.805916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.805916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:24.805916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.805916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:24.805916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.805916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:24.805916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:24.805916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:24.805916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.806636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:24.806636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:24.806636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:43:24.806636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:24.806636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:24.806636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.806636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:24.806636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:24.806636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:24.806636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.806636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:24.806636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:24.806636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:24.807196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:24.807196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:24.807196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:24.807196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:24.807196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:24.807196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.807196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:24.807196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.807196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.807196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:24.807196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.807196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:24.807732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.807732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:24.807732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:24.807732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:24.807732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:24.807732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:24.807732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.807732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:24.807732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:24.807732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.807732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:24.807732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:24.807732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.807732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:24.807732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:24.807732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:24.808461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:24.809252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.809252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:24.809252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.809252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.809252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:24.809252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.809252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:24.810694 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:24.810943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:24.811024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:24.811172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:24.811554 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:24.811790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.812323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:24.812323 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.812323 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:24.812323 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.812323 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.812323 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:24.812323 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.812323 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:24.813048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.813048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:24.813048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:24.813048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:24.813048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.813048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:24.813048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:24.813048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:24.813048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.813048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:24.813048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:24.813048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:24.813048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:24.813048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:24.813048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:24.813475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:24.813475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:24.813475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.813475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:24.813475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.813475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.813475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:24.813475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.813475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:24.813915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.813915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:24.813915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:24.813915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:24.813915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.813915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:24.813915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:24.813915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:24.813915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:24.813915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.813915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:24.814254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:24.814254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:24.814254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.814254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:24.814254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:24.814254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:24.814254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:24.814254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:24.814254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:24.814254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:24.814254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:24.814254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.814254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:24.814254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.814669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.814669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:24.814669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.814669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.814948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:24.815522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.816019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.816019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:24.816019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.816019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:24.817658 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:24.817937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:24.818043 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:24.818190 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:24.818528 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:24.818739 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:24.818884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.819386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:24.819386 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.819386 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:24.819386 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.819386 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.819386 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:24.819386 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.819386 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:24.820188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.820188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:24.820188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:24.820188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:24.820188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.820188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:24.820188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:24.820188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.820188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:24.820188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:24.820188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:24.820188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.820607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:24.820607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:24.820607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:24.820607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:24.820607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:24.820607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:24.820607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:24.820607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:24.820607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.820607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:24.820607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.820607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.820607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:24.820974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.820974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:24.821149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.821149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:24.821149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:24.821149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:24.821149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:24.821149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:24.821149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.821149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:24.821149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:24.821149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.821149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:24.821149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:24.821149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.821149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:24.821149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:24.821149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:24.821696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:24.822225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:24.822225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:24.822225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:29.658284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:29.659199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:29.659199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:29.659998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:29.696727 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:29.697156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.698070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:29.698070 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.698070 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:29.698070 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.698070 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.698070 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:29.698070 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.698070 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:29.699101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.699101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:29.699101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:29.699101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:29.699101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.699101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:29.699101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:29.699101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.699101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:29.699101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:29.699101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:29.699101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.700057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:29.700057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:29.700057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:29.700057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:29.700057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:29.700057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:29.700057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:29.700057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:29.700057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.700057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:29.700057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.700057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.700057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:29.700766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.700766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:29.700766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.700766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:29.700766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:29.700766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:29.700766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:29.700766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:29.700766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.700766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:29.700766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:29.700766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.700766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:29.700766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:29.700766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:29.701627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.702749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:29.702749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.702749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.702749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:29.702749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.702749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:29.762333 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:29.762900 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:29.763101 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:29.764204 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:29.764475 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:29.764627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.765307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:29.765307 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.765307 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:29.765307 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.765307 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.765307 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:29.765307 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.765307 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:29.766902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.766902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:29.766902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:29.766902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:29.766902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.766902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:29.766902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:29.766902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.766902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:29.766902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:29.766902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:29.766902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.767500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:29.767500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:29.767500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:29.767500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:29.767500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:29.767500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:29.767500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:29.767500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:29.767500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.767500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:29.767500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.767500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.767500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:29.768058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.768058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:29.768705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.768705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:29.768705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:29.768705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:29.768705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:29.768705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:29.768705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.768705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:29.768705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:29.768705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.768705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:29.768705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:29.768705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.768705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:29.768705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:29.768705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.769465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.770251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:29.770251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.770251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:29.803036 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:29.803547 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:29.803732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:29.803915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:43:29.804632 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:29.804975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.805910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:29.805910 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.805910 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:29.805910 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.805910 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.805910 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:29.805910 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.805910 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:29.807095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.807095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:29.807095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:29.807095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:29.807095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.807095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:29.807095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:29.807095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:29.807095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.807095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:29.807095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:29.807095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:29.807095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:29.807095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:29.807095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:29.808028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:29.808028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:29.808028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.808028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:29.808028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.808028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.808028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:29.808028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.808028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:29.808649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.808649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:29.808649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:29.808649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:29.808649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.808649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:29.808649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:29.808649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:43:29.808649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:29.808649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:29.808649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.808649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:29.808976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:29.808976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:29.808976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.808976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:29.808976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:29.808976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:29.808976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:29.808976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:29.808976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:29.808976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:29.808976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:29.808976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.808976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:29.808976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.809348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.809348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:29.809348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.809348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:29.809732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.809732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:29.809732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:29.809732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:29.809732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:29.809732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:29.809732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.809732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:29.809732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:29.809732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.809732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:29.809732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:29.809732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.809732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:29.809732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:29.809732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:29.810146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:29.810749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.810749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:29.810749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.810749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.810749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:29.810749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.810749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:29.811100 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:29.811527 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:29.811639 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:29.811777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:29.812389 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:29.812695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.813279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:29.813279 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.813279 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:29.813279 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.813279 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.813279 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:29.813279 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.813279 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:29.814776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.814776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:29.814776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:29.814776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:29.814776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.814776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:29.814776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:29.814776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:29.814776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.814776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:29.814776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:29.814776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:29.814776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:29.814776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:29.814776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:29.815277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:29.815277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:29.815277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.815277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:29.815277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.815277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.815277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:29.815277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.815277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:29.816773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.816773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:29.816773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:29.816773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:29.816773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.816773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:29.816773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:29.816773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:29.816773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:29.816773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.816773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:29.817170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:29.817170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:29.817170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.817170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:29.817170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:29.817170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:29.817170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:29.817170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:29.817170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:29.817170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:29.817170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:29.817170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.817170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:29.817170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.817558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.817558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:29.817558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.817558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.817882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:29.818419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.818944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.818944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:29.818944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.818944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:29.818944 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:29.818944 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:29.818944 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:29.818944 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:29.819226 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:29.819356 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:29.819550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.820324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:29.820324 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.820324 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:29.820324 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.820324 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.820324 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:29.820324 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.820324 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:29.821247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.821247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:29.821247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:29.821247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:29.821247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.821247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:29.821247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:29.821247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.821247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:29.821247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:29.821247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:29.821247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.821611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:29.821611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:29.821611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:29.821611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:29.821611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:29.821611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:29.821611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:29.821611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:29.821611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.821611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:29.821611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.821611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.821611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:29.821933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.821933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:29.822499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.822499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:29.822499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:29.822499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:29.822499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:29.822499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:29.822499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.822499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:29.822499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:29.822499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.822499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:29.822499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:29.822499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.822499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:29.822499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:29.822499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:29.822962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:29.823513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:29.823513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:29.823513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:34.659021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:34.659920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:34.659920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:34.661559 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:34.696918 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:34.697344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.698355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:34.698355 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.698355 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:34.698355 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.698355 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.698355 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:34.698355 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.698355 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:34.699464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.699464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:34.699464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:34.699464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:34.699464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.699464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:34.699464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:34.699464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.699464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:34.699464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:34.699464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:34.699464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.700132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:34.700132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:34.700132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:34.700132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:34.700132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:34.700132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:34.700132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:34.700132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:34.700132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.700132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:34.700132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.700132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.700132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:34.700775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.700775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:34.700775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.700775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:34.700775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:34.700775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:34.700775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:34.700775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:34.700775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.700775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:34.700775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:34.700775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.700775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:34.700775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:34.700775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:34.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.703033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:34.703033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.703033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.703033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:34.703033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.703033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:34.762922 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:34.763325 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:34.763626 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:34.764679 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:34.765067 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:34.765386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.766600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:34.766600 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.766600 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:34.766600 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.766600 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.766600 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:34.766600 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.766600 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:34.768311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.768311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:34.768311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:34.768311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:34.768311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.768311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:34.768311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:34.768311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.768311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:34.768311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:34.768311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:34.768311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.769677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:34.769677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:34.769677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:34.769677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:34.769677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:34.769677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:34.769677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:34.769677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:34.769677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.769677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:34.769677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.769677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.769677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:34.770558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.770558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:34.770558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.770558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:34.770558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:34.770558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:34.770558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:34.770558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:34.770558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.770558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:34.770558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:34.770558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.770558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:34.770558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:34.770558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:34.771160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.771920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:34.771920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.771920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.771920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:34.771920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.771920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:34.803574 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:34.804064 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:34.804211 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:34.804465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:43:34.805259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:34.805617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.806517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:34.806517 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.806517 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:34.806517 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.806517 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.806517 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:34.806517 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.806517 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:34.807825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.807825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:34.807825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:34.807825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:34.807825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.807825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:34.807825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:34.807825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:34.807825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.807825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:34.807825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:34.807825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:34.807825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:34.807825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:34.807825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:34.808907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:34.808907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:34.808907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.808907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:34.808907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.808907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.808907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:34.808907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.808907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:34.809658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.809658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:34.809658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:34.809658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:34.809658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.809658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:34.809658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:34.809658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:43:34.809658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:34.809658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:34.809658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.809658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:34.810603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:34.810603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:34.810603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.810603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:34.810603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:34.810603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:34.810603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:34.810603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:34.810603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:34.810603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:34.810603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:34.810603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.810603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:34.810603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.811424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.811424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:34.811424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.811424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:34.811424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.811424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:34.811424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:34.811424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:34.811424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:34.811424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:34.811424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.811424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:34.811424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:34.811424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:34.811837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:34.812345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:34.812345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:34.812345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:34.812345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:34.812345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:34.812345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.812345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:34.812345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.812345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.812345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:34.812345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.812345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:34.812345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:34.812345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:34.812720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:34.812720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:34.812720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:34.812720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.813272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:34.813272 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.813272 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:34.813272 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.813272 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.813272 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:34.813272 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.813272 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:34.813984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.813984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:34.813984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:34.813984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:34.813984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.813984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:34.813984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:34.813984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:34.813984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.813984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:34.813984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:34.813984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:34.813984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:34.813984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:34.813984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:34.814999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:34.814999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:34.814999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.814999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:34.814999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.814999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.814999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:34.814999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.814999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:34.814999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.814999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:34.814999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:34.814999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:34.814999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.815913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:34.815913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:34.815913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:34.815913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:34.815913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.815913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:34.815913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:34.815913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:34.815913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.815913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:34.815913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:34.815913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:34.815913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:34.816765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:34.816765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:34.816765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:34.816765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:34.816765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.816765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:34.816765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.816765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.816765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:34.816765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.816765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:34.816765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:34.817125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.817603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:34.818632 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:34.818884 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:34.819003 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:34.819156 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:34.819641 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:34.819997 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:34.820230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.821016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:34.821016 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.821016 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:34.821016 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.821016 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.821016 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:34.821016 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.821016 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:34.821843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.821843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:34.821843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:34.821843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:34.821843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.821843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:34.821843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:34.821843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.821843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:34.821843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:34.821843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:34.821843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.822097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:34.822097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:34.822097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:34.822097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:34.822097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:34.822097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:34.822097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:34.822097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:34.822097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.822097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:34.822097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.822097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.822097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:34.822330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.822330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:34.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:34.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:34.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:34.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:34.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:34.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:34.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:34.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:34.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:34.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:34.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:34.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:34.823172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:34.823547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:34.823547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:34.823547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:39.660911 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:39.661600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:39.661600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:39.662514 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:39.706011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:39.706637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.707581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:39.707581 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.707581 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:39.707581 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.707581 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.707581 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:39.707581 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.707581 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:39.708642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.046 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.708642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:39.708642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:39.708642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:39.708642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.708642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:39.708642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:39.708642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.708642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:39.708642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:39.708642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:39.708642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.709059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:39.709059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:39.709059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:39.709059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:39.709059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:39.709059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:39.709059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:39.709059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:39.709059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.709059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:39.709059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.709059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.709059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:39.709444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.709444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:39.709876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.709876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:39.709876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:39.709876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:39.709876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:39.709876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:39.709876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.709876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:39.709876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:39.709876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.709876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:39.709876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:39.709876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.709876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:39.709876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:39.709876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.711083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.712273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:39.712273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.712273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:39.764041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:39.764660 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:39.764869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:39.766096 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:39.766478 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:39.766800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.768080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:39.768080 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.768080 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:39.768080 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.768080 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.768080 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:39.768080 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.768080 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:39.769505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.769505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:39.769505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:39.769505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:39.769505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.769505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:39.769505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:39.769505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.769505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:39.769505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:39.769505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:39.769505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.770102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:39.770102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:39.770102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:39.770102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:39.770102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:39.770102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:39.770102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:39.770102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:39.770102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.770102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:39.770102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.770102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.770102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:39.770858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.770858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:39.771323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.771323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:39.771323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:39.771323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:39.771323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:39.771323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:39.771323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.771323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:39.771323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:39.771323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.771323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:39.771323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:39.771323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.771323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:39.771323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:39.771323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.771807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.772277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:39.772277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.772277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:39.804156 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:39.804601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:39.804719 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:39.804845 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:43:39.805509 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:39.805719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.806424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:39.806424 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.806424 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:39.806424 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.806424 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.806424 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:39.806424 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.806424 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:39.807301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.807301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:39.807301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:39.807301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:39.807301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.807301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:39.807301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:39.807301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:39.807301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.807301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:39.807301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:39.807301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:39.807301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:39.807301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:39.807301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:39.808078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:39.808078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:39.808078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.808078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:39.808078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.808078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.808078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:39.808078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.808078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:39.808531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.808531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:39.808531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:39.808531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:39.808531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.808531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:39.808531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:39.808531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:43:39.808531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:39.808531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:39.808531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.808531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:39.809189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:39.809189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:39.809189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.809189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:39.809189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:39.809189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:39.809189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:39.809189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:39.809189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:39.809189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:39.809189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:39.809189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.809189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:39.809189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.809884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.809884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:39.809884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.809884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:39.809884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.809884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:39.809884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:39.809884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:39.809884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:39.809884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:39.809884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.809884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:39.809884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:39.809884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:39.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:39.811321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:39.811321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:39.811321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:39.811321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:39.811321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:39.811321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.811321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:39.811321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.811321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.811321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:39.811321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.811321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:39.812008 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:39.812279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:39.812454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:39.812592 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:39.813030 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:39.813499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.814159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:39.814159 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.814159 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:39.814159 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.814159 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.814159 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:39.814159 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.814159 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:39.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:39.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:39.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:39.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:39.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:39.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:39.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:39.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:39.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:39.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:39.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:39.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:39.815471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:39.815471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:39.815471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.815471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:39.815471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.815471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.815471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:39.815471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.815471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:39.815860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.815860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:39.815860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:39.815860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:39.815860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.815860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:39.815860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:39.815860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:39.815860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:39.815860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.815860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:39.816184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:39.816184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:39.816184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.816184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:39.816184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:39.816184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:39.816184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:39.816184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:39.816184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:39.816184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:39.816184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:39.816184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.816184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:39.816184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.816574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.816574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:39.816574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.816574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.816953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:39.817427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.817939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.817939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:39.817939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.817939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:39.818965 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:39.819250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:39.819434 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:39.819643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:39.820112 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:39.820505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:39.820749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.821496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:39.821496 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.821496 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:39.821496 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.821496 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.821496 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:39.821496 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.821496 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:39.822298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.822298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:39.822298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:39.822298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:39.822298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.822298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:39.822298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:39.822298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.822298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:39.822298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:39.822298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:39.822298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.822709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:39.822709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:39.822709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:39.822709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:39.822709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:39.822709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:39.822709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:39.822709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:39.822709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.822709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:39.822709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.822709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.822709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:39.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:39.823404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.823404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:39.823404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:39.823404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:39.823404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:39.823404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:39.823404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.823404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:39.823404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:39.823404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.823404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:39.823404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:39.823404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.823404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:39.823404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:39.823404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:39.823822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:39.824446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:39.824446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:39.824446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:44.661755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:44.662862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:44.662862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:44.663812 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:44.697725 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:44.697969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.698748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:44.698748 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.698748 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:44.698748 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.698748 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.698748 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:44.698748 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.698748 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:44.699598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.699598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:44.699598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:44.699598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:44.699598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.699598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:44.699598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:44.699598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.699598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:44.699598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:44.699598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:44.699598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.700280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:44.700280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:44.700280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:44.700280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:44.700280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:44.700280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:44.700280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:44.700280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:44.700280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.700280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:44.700280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.700280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.700280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:44.701319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.701319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:44.701319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.701319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:44.701319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:44.701319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:44.701319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:44.701319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:44.701319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.701319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:44.701319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:44.701319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.701319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:44.701319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:44.701319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:44.703083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.704429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:44.704429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.704429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.704429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:44.704429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.704429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:44.765526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:44.766119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:44.766569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:44.767930 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:44.767930 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:44.767930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.768463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:44.768463 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.768463 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:44.768463 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.768463 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.768463 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:44.768463 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.768463 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:44.770098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.770098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:44.770098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:44.770098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:44.770098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.770098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:44.770098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:44.770098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.770098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:44.770098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:44.770098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:44.770098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.770519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:44.770519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:44.770519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:44.770519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:44.770519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:44.770519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:44.770519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:44.770519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:44.770519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.770519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:44.770519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.770519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.770519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:44.770843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.770843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:44.771922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.771922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:44.771922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:44.771922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:44.771922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:44.771922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:44.771922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.771922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:44.771922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:44.771922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.771922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:44.771922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:44.771922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.771922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:44.771922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:44.771922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.773364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.773881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:44.773881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.773881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:44.805635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:44.808985 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:44.808985 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:44.808985 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:43:44.808985 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:44.808985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.809449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:44.809449 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.809449 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:44.809449 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.809449 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.809449 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:44.809449 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.809449 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:44.810683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.810683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:44.810683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:44.810683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:44.810683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.810683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:44.810683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:44.810683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:44.810683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.810683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:44.810683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:44.810683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:44.810683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:44.810683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:44.810683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:44.811234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:44.811234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:44.811234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.811234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:44.811234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.811234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.811234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:44.811234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.811234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:44.812484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.812484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:44.812484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:44.812484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:44.812484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.812484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:44.812484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:44.812484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:43:44.812484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:44.812484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:44.812484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.812484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:44.813033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:44.813033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:44.813033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.813033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:44.813033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:44.813033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:44.813033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:44.813033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:44.813033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:44.813033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:44.813033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:44.813033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.813033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:44.813033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.813430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.813430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:44.813430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.813430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:44.813553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.813553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:44.813553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:44.813553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:44.813553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:44.813553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:44.813553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.813553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:44.813553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:44.813553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.813553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:44.813553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:44.813553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.813553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:44.813553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:44.813553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:44.813985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:44.814526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.814526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:44.814526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.814526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.814526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:44.814526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.814526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:44.814970 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:44.815237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:44.815330 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:44.815479 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:44.815934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:44.816168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.816713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:44.816713 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.816713 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:44.816713 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.816713 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.816713 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:44.816713 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.816713 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:44.817459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.817459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:44.817459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:44.817459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:44.817459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.817459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:44.817459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:44.817459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:44.817459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.817459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:44.817459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:44.817459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:44.817459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:44.817459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:44.817459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:44.818208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:44.818208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:44.818208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.818208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:44.818208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.818208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.818208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:44.818208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.818208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:44.818670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.818670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:44.818670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:44.818670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:44.818670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.818670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:44.818670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:44.818670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:44.818670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:44.818670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.818670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:44.819854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:44.819854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:44.819854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.819854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:44.819854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:44.819854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:44.819854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:44.819854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:44.819854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:44.819854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:44.819854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:44.819854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.819854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:44.819854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.820401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.820401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:44.820401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.820401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:44.820401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.820401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:44.820401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:44.820401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:44.820401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:44.820401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:44.820401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.820401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:44.820401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:44.820401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:44.820788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:44.821291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:44.821291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:44.821291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:44.821291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:44.821291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.821291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:44.821291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.821291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.821291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:44.821291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.821291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:44.821291 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:44.821291 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:44.821672 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:44.821672 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:44.821672 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:44.821672 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:44.821672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.821672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:44.821672 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.821672 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:44.821672 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.821928 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.821928 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:44.821928 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.821928 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:44.822415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.822415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:44.822415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:44.822415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:44.822415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.822415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:44.822415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:44.822415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.822415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:44.822415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:44.822415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:44.822415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.822780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:44.822780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:44.822780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:44.822780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:44.822780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:44.822780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:44.822780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:44.822780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:44.822780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.822780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:44.822780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.822780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.822780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:44.823107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.823107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:44.823398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.823398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:44.823398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:44.823398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:44.823398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:44.823398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:44.823398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.823398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:44.823398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:44.823398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.823398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:44.823398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:44.823398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.823398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:44.823398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:44.823398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:44.823904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:44.824410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:44.824410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:44.824410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:49.662915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:49.662915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:49.663573 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:49.663862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:49.698962 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:49.699248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.700051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:49.700051 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.700051 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:49.700051 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.700051 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.700051 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:49.700051 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.700051 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:49.701143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.701143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:49.701143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:49.701143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:49.701143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.701143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:49.701143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:49.701143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.701143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:49.701143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:49.701143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:49.701143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.701686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:49.701686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:49.701686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:49.701686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:49.701686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:49.701686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:49.701686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:49.701686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:49.701686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.701686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:49.701686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.701686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.701686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:49.702096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.702096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:49.702293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.702293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:49.702293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:49.702293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:49.702293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:49.702293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:49.702293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.702293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:49.702293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:49.702293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.702293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:49.702293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:49.702293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.702293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:49.702293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:49.702293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.702908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.703504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:49.703504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.703504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:49.767430 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:49.768166 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:49.768390 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:49.769130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:49.769389 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:49.769589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.770259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:49.770259 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.770259 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:49.770259 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.770259 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.770259 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:49.770259 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.770259 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:49.771225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.771225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:49.771225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:49.771225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:49.771225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.771225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:49.771225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:49.771225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.771225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:49.771225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:49.771225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:49.771225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.771750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:49.771750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:49.771750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:49.771750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:49.771750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:49.771750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:49.771750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:49.771750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:49.771750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.771750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:49.771750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.771750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.771750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:49.772310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.772310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:49.772575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.772575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:49.772575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:49.772575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:49.772575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:49.772575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:49.772575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.772575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:49.772575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:49.772575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.772575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:49.772575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:49.772575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.772575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:49.772575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:49.772575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.773282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.774088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:49.774088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.774088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:49.807037 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:49.807793 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:49.807910 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:49.808013 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:43:49.808583 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:49.808931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.809697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:49.809697 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.809697 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:49.809697 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.809697 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.809697 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:49.809697 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.809697 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:49.810296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.810296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:49.810296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:49.810296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:49.810296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.810296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:49.810296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:49.810296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:49.810296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.810296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:49.810296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:49.810296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:49.810296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:49.810296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:49.810296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:49.810743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:49.810743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:49.810743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.810743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:49.810743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.810743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.810743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:49.810743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.810743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:49.811001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.811001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:49.811001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:49.811001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:49.811001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.811001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:49.811001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:49.811001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:43:49.811001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:49.811001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:49.811001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.811001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:49.811334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:49.811334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:49.811334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.811334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:49.811334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:49.811334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:49.811334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:49.811334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:49.811334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:49.811334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:49.811334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:49.811334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.811334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:49.811334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.811730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.811730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:49.811730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.811730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:49.812082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.812082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:49.812082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:49.812082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:49.812082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:49.812082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:49.812082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.812082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:49.812082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:49.812082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.812082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:49.812082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:49.812082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.812082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:49.812082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:49.812082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:49.812556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:49.813043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.813043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:49.813043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.813043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.813043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:49.813043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.813043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:49.815545 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:49.815922 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:49.816044 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:49.816280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:49.816861 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:49.817539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.818226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:49.818226 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.818226 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:49.818226 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.818226 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.818226 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:49.818226 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.818226 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:49.819252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.819252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:49.819252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:49.819252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:49.819252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.819252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:49.819252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:49.819252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:49.819252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.819252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:49.819252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:49.819252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:49.819252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:49.819252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:49.819252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:49.819780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:49.819780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:49.819780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.819780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:49.819780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.819780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.819780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:49.819780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.819780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:49.820484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.820484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:49.820484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:49.820484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:49.820484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.820484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:49.820484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:49.820484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:49.820484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:49.820484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.820484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:49.820854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:49.820854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:49.820854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.820854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:49.820854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:49.820854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:49.820854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:49.820854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:49.820854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:49.820854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:49.820854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:49.820854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.820854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:49.820854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.821518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.821518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:49.821518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.821518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.822163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:49.822691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.823262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.823262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:49.823262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.823262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:49.823262 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:49.823262 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:49.823262 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:49.823262 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:49.823618 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:49.823849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:49.824004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.824531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:49.824531 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.824531 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:49.824531 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.824531 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.824531 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:49.824531 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.824531 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:49.825570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.825570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:49.825570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:49.825570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:49.825570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.825570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:49.825570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:49.825570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.825570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:49.825570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:49.825570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:49.825570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.825927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:49.825927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:49.825927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:49.825927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:49.825927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:49.825927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:49.825927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:49.825927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:49.825927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.825927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:49.825927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.825927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.825927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:49.826282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.826282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:49.826853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.826853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:49.826853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:49.826853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:49.826853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:49.826853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:49.826853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.826853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:49.826853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:49.826853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.826853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:49.826853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:49.826853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.826853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:49.826853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:49.826853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:49.827327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:49.827859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:49.827859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:49.827859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:54.663036 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:54.663981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:54.663981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:54.664171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:54.666155 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:43:54.701250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:54.701501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.702125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:54.702125 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.702125 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:54.702125 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.702125 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.702125 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:54.702125 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.702125 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:54.703099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.703099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:54.703099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:54.703099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:54.703099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.703099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:54.703099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:54.703099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.703099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:54.703099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:54.703099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:54.703099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.703595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:54.703595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:54.703595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:54.703595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:54.703595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:54.703595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:54.703595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:54.703595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:54.703595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.703595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:54.703595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.703595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.703595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:54.704022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.704022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:54.704212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.704212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:54.704212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:54.704212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:54.704212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:54.704212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:54.704212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.704212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:54.704212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:54.704212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.704212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:54.704212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:54.704212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.704212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:54.704212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:54.704212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.704906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.705682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:54.705682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.705682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:54.768150 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:54.768712 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:54.769060 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:54.770306 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:54.770646 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:54.770914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.772108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:54.772108 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.772108 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:54.772108 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.772108 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.772108 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:54.772108 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.772108 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:54.774188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.774685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:54.774685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:54.774685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:54.774685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:54.774685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:54.774685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:54.774685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:54.774685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:54.774685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.774685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:54.774685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.774685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.774685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:54.775221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.775221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:54.776395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.776395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:54.776395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:54.776395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:54.776395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:54.776395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:54.776395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.776395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:54.776395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:54.776395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.776395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:54.776395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:54.776395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.776395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:54.776395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:54.776395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.777255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.778902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:54.778902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.778902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:54.807805 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:54.808178 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:54.808502 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:54.808699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:43:54.808991 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:54.809247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.809786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:54.809786 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.809786 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:54.809786 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.809786 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.809786 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:54.809786 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.809786 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:54.810912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.810912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:54.810912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:54.810912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:54.810912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.810912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:54.810912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:54.810912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:54.810912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.810912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:54.810912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:54.810912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:54.810912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:54.810912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:54.810912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:54.811406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:54.811406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:54.811406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.811406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:54.811406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.811406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.811406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:54.811406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.811406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:54.812297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.812297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:54.812297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:54.812297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:54.812297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.812297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:54.812297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:54.812297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:43:54.812297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:54.812297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:54.812297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.812297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:54.812779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:54.812779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:54.812779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.812779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:54.812779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:54.812779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:54.812779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:54.812779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:54.812779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:54.812779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:54.812779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:54.812779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.812779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:54.812779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.813614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.813614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:54.813614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.813614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:54.814075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.814075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:54.814075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:54.814075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:54.814075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:54.814075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:54.814075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.814075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:54.814075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:54.814075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.814075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:54.814075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:54.814075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.814075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:54.814075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:54.814075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:54.814551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:54.815072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.815072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:54.815072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.815072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.815072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:54.815072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.815072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:54.816023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:54.816387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:54.816587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:54.816775 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:54.817527 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:54.817948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.818869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:54.818869 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.818869 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:54.818869 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.818869 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.818869 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:54.818869 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.818869 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:54.819665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.819665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:54.819665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:54.819665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:54.819665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.819665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:54.819665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:54.819665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:54.819665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.819665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:54.819665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:54.819665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:54.819665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:54.819665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:54.819665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:54.820121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:54.820121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:54.820121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.820121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:54.820121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.820121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.820121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:54.820121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.820121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:54.820625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.820625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:54.820625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:54.820625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:54.820625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.820625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:54.820625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:54.820625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:54.820625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:54.820625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.820625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:54.820994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:54.820994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:54.820994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.820994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:54.820994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:54.820994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:54.820994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:54.820994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:54.820994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:54.820994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:54.820994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:54.820994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.820994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:54.820994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.821495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.821495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:54.821495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.821495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.822357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:54.822866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.823387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.823387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:54.823387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.823387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:54.823387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:54.823387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:54.823387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:54.823387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:54.823746 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:54.824071 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:54.824307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.825054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:54.825054 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.825054 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:54.825054 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.825054 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.825054 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:54.825054 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.825054 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:54.825905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.825905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:54.825905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:54.825905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:54.825905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.825905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:54.825905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:54.825905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.825905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:54.825905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:54.825905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:54.825905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.826413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:54.826413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:54.826413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:54.826413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:54.826413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:54.826413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:54.826413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:54.826413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:54.826413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.826413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:54.826413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.826413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.826413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:54.826908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.826908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:54.827125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.827125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:54.827125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:54.827125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:54.827125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:54.827125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:54.827125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.827125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:54.827125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:54.827125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.827125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:54.827125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:54.827125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.827125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:54.827125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:54.827125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:54.827774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:54.828473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:54.828473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:54.828473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:59.663610 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:59.664942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:59.665167 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:59.666546 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:59.697174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:59.697487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.698117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:59.698117 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.698117 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:59.698117 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.698117 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.698117 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:59.698117 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.698117 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:59.698976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.698976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:59.698976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:59.698976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:59.698976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.698976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:59.698976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:59.698976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.698976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:59.698976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:59.698976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:59.698976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.701209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:59.701209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:59.701209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:59.701209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:59.701209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:59.701209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:59.701209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:59.701209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:59.701209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.701209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:59.701209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.701209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.701209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:59.701998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.701998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:59.701998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.701998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:59.701998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:59.701998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:59.701998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:59.701998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:59.701998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.701998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:59.701998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:59.701998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.701998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:59.701998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:59.701998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:59.702717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.703270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:59.703270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.703270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.703270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:59.703270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.703270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:59.769118 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:59.769627 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:59.769857 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:59.770933 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:59.771176 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:59.771339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.772054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:59.772054 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.772054 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:59.772054 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.772054 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.772054 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:59.772054 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.772054 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:59.773518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.773518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:59.773518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:59.773518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:59.773518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.773518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:59.773518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:59.773518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.773518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:59.773518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:59.773518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:59.773518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.774282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:59.774282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:59.774282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:59.774282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:59.774282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:59.774282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:59.774282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:59.774282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:59.774282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.774282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:59.774282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.774282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.774282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:59.775068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.775068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:59.775173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.775173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:59.775173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:59.775173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:59.775173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:59.775173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:59.775173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.775173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:59.775173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:59.775173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.775173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:59.775173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:59.775173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.775173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:59.775173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:59.775173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.775837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.777204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:59.777204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.777204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:59.808408 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:59.808781 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:59.808884 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:59.809004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:43:59.809483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:59.809787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.810507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:59.810507 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.810507 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:59.810507 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.810507 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.810507 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:59.810507 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.810507 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:59.811645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.811645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:59.811645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:59.811645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:59.811645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.811645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:59.811645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:59.811645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:59.811645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.811645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:59.811645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:59.811645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:59.811645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:59.811645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:59.811645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:59.812586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:59.812586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:59.812586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.812586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:59.812586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.812586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.812586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:59.812586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.812586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:59.813234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.813234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:59.813234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:59.813234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:59.813234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.813234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:59.813234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:59.813234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:43:59.813234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:59.813234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:59.813234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.813234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:59.813799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:59.813799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:59.813799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.813799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:59.813799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:59.813799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:59.813799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:59.813799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:59.813799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:59.813799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:59.813799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:59.813799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.813799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:59.813799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.814414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.814414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:59.814414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.814414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:59.814414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.814414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:59.814414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:59.814414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:59.814414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:59.814414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:59.814414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.814414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:59.814414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:59.814414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:59.815032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:59.815834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:59.815834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:59.815834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:59.815834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:59.815834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:59.815834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.815834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:59.815834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.815834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.815834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:59.815834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.815834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:59.816680 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:59.817089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:59.817270 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:59.817488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:59.817938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:59.818285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.819036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:59.819036 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.819036 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:59.819036 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.819036 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.819036 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:59.819036 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.819036 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:59.819810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.819810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:43:59.819810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:59.819810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:59.819810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.819810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:59.819810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:59.819810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:59.819810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.819810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:43:59.819810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:59.819810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:43:59.819810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:59.819810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:43:59.819810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:43:59.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:59.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:43:59.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:43:59.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:43:59.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:43:59.820855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.820855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:59.820855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:59.820855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:59.820855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.820855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:59.820855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:59.820855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:59.820855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:59.820855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.820855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:59.821180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:59.821180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:59.821180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.821180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:59.821180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:59.821180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:59.821180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:59.821180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:59.821180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:59.821180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:59.821180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:59.821180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.821180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:59.821180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.821643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.821643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:59.821643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.821643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:59.821643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.821643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:59.821643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:59.821643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:59.821643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:59.821643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:59.821643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.821643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:59.821643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:59.821643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:59.822036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:59.822628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:59.822628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:59.822628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:59.822628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:59.822628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.822628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:59.822628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.822628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.822628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:59.822628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.822628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:43:59.823352 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:43:59.823352 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:43:59.825011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:43:59.825011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:43:59.825011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:59.825011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:43:59.825011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.825261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:43:59.825261 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.825261 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:43:59.825261 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.825261 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.825261 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:43:59.825261 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.825261 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:43:59.826084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.826084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:43:59.826084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:59.826084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:43:59.826084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.826084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:59.826084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:59.826084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.826084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:59.826084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:59.826084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:59.826084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.826600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:43:59.826600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:59.826600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:43:59.826600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:59.826600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:43:59.826600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:43:59.826600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:59.826600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:43:59.826600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.826600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:43:59.826600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.826600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.826600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:43:59.827016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.827016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:43:59.827016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.827016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:43:59.827016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:43:59.827016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:43:59.827016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:43:59.827016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:43:59.827016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.827016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:43:59.827016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:43:59.827016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.827016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:43:59.827016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:43:59.827016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:43:59.827591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:43:59.828182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:43:59.828182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:43:59.828182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:43:59.828182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:43:59.828182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:43:59.828182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:04.665131 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:04.666224 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:04.666224 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:04.667343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:04.700805 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:04.701115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.701765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:04.701765 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.701765 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:04.701765 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.701765 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.701765 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:04.701765 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.701765 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:04.702518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.702518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:04.702518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:04.702518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:04.702518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.702518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:04.702518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:04.702518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.702518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:04.702518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:04.702518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:04.702518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.703192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:04.703192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:04.703192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:04.703192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:04.703192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:04.703192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:04.703192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:04.703192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:04.703192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.703192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:04.703192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.703192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.703192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:04.703897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.703897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:04.704229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.704229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:04.704229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:04.704229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:04.704229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:04.704229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:04.704229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.704229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:04.704229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:04.704229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.704229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:04.704229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:04.704229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.704229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:04.704229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:04.704229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.705134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.706068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:04.706068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.706068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:04.769831 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:04.770298 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:04.770579 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:04.771703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:04.772066 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:04.772312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.773279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:04.773279 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.773279 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:04.773279 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.773279 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.773279 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:04.773279 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.773279 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:04.774977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.774977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:04.774977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:04.774977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:04.774977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.774977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:04.774977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:04.774977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.774977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:04.774977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:04.774977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:04.774977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:04.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:04.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:04.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:04.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:04.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:04.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:04.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:04.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:04.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.775551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:04.776109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.776109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:04.777198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.777198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:04.777198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:04.777198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:04.777198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:04.777198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:04.777198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.777198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:04.777198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:04.777198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.777198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:04.777198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:04.777198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.777198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:04.777198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:04.777198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.777947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.778881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:04.778881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.778881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:04.809181 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:04.809670 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:04.809865 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:04.810067 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:44:04.810773 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:04.811130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.811981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:04.811981 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.811981 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:04.811981 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.811981 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.811981 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:04.811981 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.811981 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:04.813655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.813655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:04.813655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:04.813655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:04.813655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.813655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:04.813655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:04.813655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:04.813655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.813655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:04.813655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:04.813655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:04.813655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:04.813655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:04.813655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:04.814494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:04.814494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:04.814494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.814494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:04.814494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.814494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.814494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:04.814494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.814494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:04.815222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.815222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:04.815222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:04.815222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:04.815222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.815222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:04.815222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:04.815222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:44:04.815222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:04.815222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:04.815222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.815222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:04.815859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:04.815859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:04.815859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.815859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:04.815859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:04.815859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:04.815859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:04.815859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:04.815859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:04.815859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:04.815859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:04.815859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.815859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:04.815859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.816498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.816498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:04.816498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.816498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:04.817082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.817082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:04.817082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:04.817082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:04.817082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:04.817082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:04.817082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.817082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:04.817082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:04.817082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.817082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:04.817082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:04.817082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.817082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:04.817082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:04.817082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:04.817874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:04.818711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.818711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:04.818711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.818711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.818711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:04.818711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.818711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:04.818711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:04.818711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:04.818711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:04.819177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:04.819177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:04.819177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.819177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:04.819177 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.819177 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:04.819177 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.819177 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.819177 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:04.819177 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.819177 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:04.819718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.819718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:04.819718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:04.819718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:04.819718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.819718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:04.819718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:04.819718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:04.819718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.819718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:04.819718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:04.819718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:04.819718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:04.819718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:04.819718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:04.820389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:04.820389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:04.820389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.820389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:04.820389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.820389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.820389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:04.820389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.820389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:04.820389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.820389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:04.820389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:04.820389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:04.820389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.821167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:04.821167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:04.821167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:04.821167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:04.821167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.821167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:04.821167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:04.821167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:04.821167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.821167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:04.821167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:04.821167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:04.821167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:04.821531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:04.821531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:04.821531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:04.821531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:04.821531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.821531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:04.821531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.821531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.821531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:04.821531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.821531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:04.821531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:04.821945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.822464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:04.823349 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:04.823510 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:04.823582 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:04.823716 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:04.824070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:04.824286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:04.824461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.824977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:04.824977 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.824977 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:04.824977 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.824977 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.824977 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:04.824977 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.824977 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:04.825797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.825797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:04.825797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:04.825797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:04.825797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.825797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:04.825797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:04.825797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.825797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:04.825797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:04.825797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:04.825797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.826165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:04.826165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:04.826165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:04.826165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:04.826165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:04.826165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:04.826165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:04.826165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:04.826165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.826165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:04.826165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.826165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.826165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:04.826561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.826561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:04.826857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.826857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:04.826857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:04.826857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:04.826857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:04.826857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:04.826857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.826857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:04.826857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:04.826857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.826857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:04.826857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:04.826857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.826857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:04.826857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:04.826857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:04.827330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:04.827944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:04.827944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:04.827944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:09.665678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:09.666123 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:09.666123 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:09.666875 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:09.699692 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:09.700065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.700879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:09.700879 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.700879 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:09.700879 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.700879 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.700879 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:09.700879 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.700879 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:09.701678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.701678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:09.701678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:09.701678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:09.701678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.701678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:09.701678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:09.701678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.701678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:09.701678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:09.701678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:09.701678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.702093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:09.702093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:09.702093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:09.702093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:09.702093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:09.702093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:09.702093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:09.702093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:09.702093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.702093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:09.702093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.702093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.702093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:09.702539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.702539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:09.702539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.702539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:09.702539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:09.702539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:09.702539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:09.702539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:09.702539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.702539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:09.702539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:09.702539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.702539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:09.702539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:09.702539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:09.703016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.703682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:09.703682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.703682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.703682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:09.703682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.703682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:09.770506 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:09.770914 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:09.771060 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:09.772290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:09.772746 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:09.773047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.773984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:09.773984 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.773984 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:09.773984 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.773984 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.773984 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:09.773984 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.773984 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:09.775493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.775493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:09.775493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:09.775493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:09.775493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.775493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:09.775493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:09.775493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.775493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:09.775493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:09.775493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:09.775493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.776086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:09.776086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:09.776086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:09.776086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:09.776086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:09.776086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:09.776086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:09.776086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:09.776086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.776086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:09.776086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.776086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.776086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:09.776668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.776668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:09.777155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.777155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:09.777155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:09.777155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:09.777155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:09.777155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:09.777155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.777155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:09.777155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:09.777155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.777155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:09.777155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:09.777155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.777155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:09.777155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:09.777155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.777959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.778819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:09.778819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.778819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:09.809701 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:09.810102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:09.810346 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:09.810649 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:44:09.811547 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:09.811903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.812784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:09.812784 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.812784 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:09.812784 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.812784 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.812784 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:09.812784 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.812784 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:09.814219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.814219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:09.814219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:09.814219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:09.814219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.814219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:09.814219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:09.814219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:09.814219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.814219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:09.814219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:09.814219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:09.814219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:09.814219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:09.814219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:09.815695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:09.815695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:09.815695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.815695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:09.815695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.815695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.815695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:09.815695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.815695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:09.816733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.816733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:09.816733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:09.816733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:09.816733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.816733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:09.816733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:09.816733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:44:09.816733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:09.816733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:09.816733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.816733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:09.817680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:09.817680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:09.817680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.817680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:09.817680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:09.817680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:09.817680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:09.817680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:09.817680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:09.817680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:09.817680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:09.817680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.817680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:09.817680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.818499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.818499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:09.818499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.818499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:09.818499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.818499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:09.818499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:09.818499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:09.818499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:09.818499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:09.818499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.818499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:09.818499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:09.818499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:09.819174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:09.819831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:09.819831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:09.819831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:09.819831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:09.819831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:09.819831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.819831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:09.819831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.819831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.819831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:09.819831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.819831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:09.819831 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:09.819831 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:09.820237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:09.820237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:09.820237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:09.820510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.821526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:09.821526 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.821526 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:09.821526 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.821526 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.821526 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:09.821526 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.821526 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:09.822378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.822378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:09.822378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:09.822378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:09.822378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.822378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:09.822378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:09.822378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:09.822378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.822378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:09.822378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:09.822378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:09.822378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:09.822378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:09.822378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:09.822953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:09.822953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:09.822953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.822953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:09.822953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.822953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.822953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:09.822953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.822953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:09.823667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.823667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:09.823667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:09.823667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:09.823667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.823667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:09.823667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:09.823667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:09.823667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:09.823667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.823667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:09.824189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:09.824189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:09.824189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.824189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:09.824189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:09.824189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:09.824189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:09.824189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:09.824189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:09.824189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:09.824189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:09.824189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.824189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:09.824189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.824734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.824734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:09.824734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.824734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:09.824734 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.825260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:09.826155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.826685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.826685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:09.826685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.826685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:09.826685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:09.826685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:09.826685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:09.826685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:09.826923 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:09.826958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.827687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:09.827687 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.827687 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:09.827687 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.827687 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.827687 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:09.827687 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.827687 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:09.828634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.828634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:09.828634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:09.828634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:09.828634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.828634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:09.828634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:09.828634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.828634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:09.828634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:09.828634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:09.828634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.829152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:09.829152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:09.829152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:09.829152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:09.829152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:09.829152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:09.829152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:09.829152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:09.829152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.829152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:09.829152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.829152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.829152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:09.829717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.829717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:09.830013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.830013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:09.830013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:09.830013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:09.830013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:09.830013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:09.830013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.830013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:09.830013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:09.830013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.830013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:09.830013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:09.830013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.830013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:09.830013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:09.830013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:09.830550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:09.831047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:09.831047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:09.831047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:14.666303 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:14.667279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:14.667279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:14.668125 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:14.704363 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:14.704870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.705908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:14.705908 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.705908 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:14.705908 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.705908 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.705908 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:14.705908 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.705908 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:14.707078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.707078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:14.707078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:14.707078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:14.707078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.707078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:14.707078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:14.707078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.707078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:14.707078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:14.707078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:14.707078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.707741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:14.707741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:14.707741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:14.707741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:14.707741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:14.707741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:14.707741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:14.707741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:14.707741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.707741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:14.707741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.707741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.707741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:14.708399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.708399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:14.708399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.708399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:14.708399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:14.708399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:14.708399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:14.708399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:14.708399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.708399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:14.708399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:14.708399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.708399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:14.708399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:14.708399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:14.709140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.710078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:14.710078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.710078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.710078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:14.710078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.710078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:14.771310 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:14.771837 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:14.772111 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:14.773713 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:14.774154 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:14.774540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.775893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:14.775893 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.775893 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:14.775893 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.775893 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.775893 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:14.775893 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.775893 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:14.778017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.778017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:14.778017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:14.778017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:14.778017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.778017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:14.778017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:14.778017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.778017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:14.778017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:14.778017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:14.778017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.778739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:14.778739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:14.778739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:14.778739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:14.778739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:14.778739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:14.778739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:14.778739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:14.778739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.778739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:14.778739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.778739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.778739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:14.779429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.779429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:14.780454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.780454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:14.780454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:14.780454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:14.780454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:14.780454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:14.780454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.780454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:14.780454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:14.780454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.780454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:14.780454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:14.780454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.780454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:14.780454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:14.780454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.780940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.781432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:14.781432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.781432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:14.810243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:14.810656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:14.810837 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:14.811034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:44:14.811946 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:14.812381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.813388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:14.813388 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.813388 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:14.813388 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.813388 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.813388 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:14.813388 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.813388 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:14.814709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.814709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:14.814709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:14.814709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:14.814709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.814709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:14.814709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:14.814709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:14.814709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.814709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:14.814709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:14.814709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:14.814709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:14.814709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:14.814709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:14.815528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:14.815528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:14.815528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.815528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:14.815528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.815528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.815528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:14.815528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.815528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:14.816085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.816085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:14.816085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:14.816085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:14.816085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.816085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:14.816085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:14.816085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:44:14.816085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:14.816085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:14.816085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.816085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:14.816829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:14.816829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:14.816829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.816829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:14.816829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:14.816829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:14.816829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:14.816829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:14.816829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:14.816829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:14.816829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:14.816829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.816829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:14.816829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.817483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.817483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:14.817483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.817483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:14.817483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.817483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:14.817483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:14.817483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:14.817483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:14.817483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:14.817483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.817483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:14.817483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:14.817483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:14.818169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:14.819108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:14.819108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:14.819108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:14.819108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:14.819108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:14.819108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.819108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:14.819108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.819108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.819108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:14.819108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.819108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:14.819108 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:14.819108 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:14.819876 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:14.819876 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:14.819876 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:14.820326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.821098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:14.821098 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.821098 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:14.821098 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.821098 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.821098 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:14.821098 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.821098 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:14.821881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.821881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:14.821881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:14.821881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:14.821881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.821881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:14.821881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:14.821881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:14.821881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.821881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:14.821881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:14.821881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:14.821881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:14.821881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:14.821881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:14.822276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:14.822276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:14.822276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.822276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:14.822276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.822276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.822276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:14.822276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.822276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:14.822793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.822793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:14.822793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:14.822793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:14.822793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.822793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:14.822793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:14.822793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:14.822793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:14.822793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.822793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:14.823114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:14.823114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:14.823114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.823114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:14.823114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:14.823114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:14.823114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:14.823114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:14.823114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:14.823114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:14.823114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:14.823114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.823114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:14.823114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.823489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.823489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:14.823489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.823489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.823965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:14.824454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.824973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.824973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:14.824973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.824973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:14.825514 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:14.825715 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:14.825857 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:14.825984 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:14.826466 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:14.826813 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:14.827048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.827745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:14.827745 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.827745 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:14.827745 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.827745 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.827745 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:14.827745 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.827745 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:14.828678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.828678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:14.828678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:14.828678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:14.828678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.828678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:14.828678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:14.828678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.828678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:14.828678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:14.828678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:14.828678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.829170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:14.829170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:14.829170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:14.829170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:14.829170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:14.829170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:14.829170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:14.829170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:14.829170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.829170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:14.829170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.829170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.829170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:14.829695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.829695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:14.829695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.829695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:14.829695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:14.829695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:14.829695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:14.829695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:14.829695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.829695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:14.829695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:14.829695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.829695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:14.829695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:14.829695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:14.830257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:14.830987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:14.830987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:14.830987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:14.830987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:14.830987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:14.830987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:19.667120 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:19.668201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:19.668201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:19.669372 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:19.714392 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:19.714641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.715247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:19.715247 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.715247 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:19.715247 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.715247 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.715247 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:19.715247 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.715247 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:19.716052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.047 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.716052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:19.716052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:19.716052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:19.716052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.716052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:19.716052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:19.716052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.716052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:19.716052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:19.716052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:19.716052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.716467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:19.716467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:19.716467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:19.716467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:19.716467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:19.716467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:19.716467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:19.716467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:19.716467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.716467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:19.716467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.716467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.716467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:19.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:19.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:19.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:19.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:19.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:19.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:19.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:19.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:19.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:19.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:19.716890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:19.717459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.718031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:19.718031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.718031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.718031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:19.718031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.718031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:19.772040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:19.772511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:19.772720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:19.773686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:19.773956 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:19.774191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.775027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:19.775027 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.775027 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:19.775027 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.775027 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.775027 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:19.775027 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.775027 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:19.777026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.777026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:19.777026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:19.777026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:19.777026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.777026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:19.777026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:19.777026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.777026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:19.777026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:19.777026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:19.777026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.777695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:19.777695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:19.777695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:19.777695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:19.777695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:19.777695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:19.777695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:19.777695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:19.777695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.777695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:19.777695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.777695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.777695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:19.778450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.778450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:19.779543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.779543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:19.779543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:19.779543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:19.779543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:19.779543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:19.779543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.779543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:19.779543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:19.779543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.779543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:19.779543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:19.779543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.779543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:19.779543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:19.779543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.780431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.781420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:19.781420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.781420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:19.810731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:19.811172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:19.811345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:19.811592 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:44:19.812201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:19.812531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.813363 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:19.813363 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.813363 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:19.813363 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.813363 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.813363 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:19.813363 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.813363 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:19.814598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.814598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:19.814598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:19.814598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:19.814598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.814598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:19.814598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:19.814598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:19.814598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.814598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:19.814598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:19.814598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:19.814598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:19.814598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:19.814598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:19.815063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:19.815063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:19.815063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.815063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:19.815063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.815063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.815063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:19.815063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.815063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:19.815909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.815909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:19.815909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:19.815909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:19.815909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.815909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:19.815909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:19.815909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:44:19.815909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:19.815909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:19.815909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.815909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:19.816456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:19.816456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:19.816456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.816456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:19.816456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:19.816456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:19.816456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:19.816456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:19.816456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:19.816456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:19.816456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:19.816456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.816456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:19.816456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.817105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.817105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:19.817105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.817105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:19.817312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.817312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:19.817312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:19.817312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:19.817312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:19.817312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:19.817312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.817312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:19.817312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:19.817312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.817312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:19.817312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:19.817312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.817312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:19.817312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:19.817312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:19.818102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:19.818992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.818992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:19.818992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.818992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.818992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:19.818992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.818992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:19.819317 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:19.819426 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:19.819498 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:19.819600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:19.820014 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:19.820477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.821193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:19.821193 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.821193 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:19.821193 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.821193 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.821193 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:19.821193 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.821193 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:19.821897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.821897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:19.821897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:19.821897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:19.821897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.821897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:19.821897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:19.821897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:19.821897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.821897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:19.821897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:19.821897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:19.821897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:19.821897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:19.821897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:19.822344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:19.822344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:19.822344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.822344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:19.822344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.822344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.822344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:19.822344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.822344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:19.822796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.822796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:19.822796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:19.822796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:19.822796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.822796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:19.822796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:19.822796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:19.822796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:19.822796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.822796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:19.823118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:19.823118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:19.823118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.823118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:19.823118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:19.823118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:19.823118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:19.823118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:19.823118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:19.823118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:19.823118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:19.823118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.823118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:19.823118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.823513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.823513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:19.823513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.823513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.823838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:19.824351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.824830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.824830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:19.824830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.824830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:19.825779 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:19.825973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:19.826079 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:19.826226 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:19.826673 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:19.827038 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:19.827285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.828036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:19.828036 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.828036 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:19.828036 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.828036 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.828036 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:19.828036 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.828036 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:19.828868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.828868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:19.828868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:19.828868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:19.828868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.828868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:19.828868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:19.828868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.828868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:19.828868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:19.828868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:19.828868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.829218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:19.829218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:19.829218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:19.829218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:19.829218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:19.829218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:19.829218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:19.829218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:19.829218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.829218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:19.829218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.829218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.829218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:19.829610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.829610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:19.829808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.829808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:19.829808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:19.829808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:19.829808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:19.829808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:19.829808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.829808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:19.829808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:19.829808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.829808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:19.829808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:19.829808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.829808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:19.829808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:19.829808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:19.830237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:19.830748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:19.830748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:19.830748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:24.667943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:24.668542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:24.668542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:24.669736 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:24.704191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:24.704191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.704354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:24.704354 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.704354 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:24.704354 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.704354 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.704354 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:24.704354 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.704354 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:24.705113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.705113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:24.705113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:24.705113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:24.705113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.705113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:24.705113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:24.705113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.705113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:24.705113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:24.705113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:24.705113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.705501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:24.705501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:24.705501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:24.705501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:24.705501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:24.705501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:24.705501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:24.705501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:24.705501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.705501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:24.705501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.705501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.705501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:24.705832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.705832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:24.705832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.705832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:24.705832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:24.705832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:24.705832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:24.705832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:24.705832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.705832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:24.705832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:24.705832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.705832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:24.705832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:24.705832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:24.706264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.706900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:24.706900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.706900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.706900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:24.706900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.706900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:24.772828 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:24.773400 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:24.773651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:24.775583 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:24.775583 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:24.775583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.776389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:24.776389 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.776389 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:24.776389 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.776389 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.776389 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:24.776389 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.776389 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:24.777910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.777910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:24.777910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:24.777910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:24.777910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.777910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:24.777910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:24.777910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.777910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:24.777910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:24.777910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:24.777910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.778543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:24.778543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:24.778543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:24.778543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:24.778543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:24.778543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:24.778543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:24.778543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:24.778543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.778543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:24.778543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.778543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.778543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:24.779138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.779138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:24.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:24.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:24.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:24.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:24.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:24.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:24.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:24.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:24.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:24.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:24.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:24.779559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.780270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.781148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:24.781148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.781148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:24.811558 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:24.811677 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:24.811983 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:24.812521 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:44:24.812625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:24.812935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.813747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:24.813747 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.813747 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:24.813747 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.813747 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.813747 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:24.813747 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.813747 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:24.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:24.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:24.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:24.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:24.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:24.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:24.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:24.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:24.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:24.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:24.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:24.815042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:24.815716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:24.815716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:24.815716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.815716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:24.815716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.815716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.815716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:24.815716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.815716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:24.816490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.816490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:24.816490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:24.816490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:24.816490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.816490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:24.816490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:24.816490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:44:24.816490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:24.816490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:24.816490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.816490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:24.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:24.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:24.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:24.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:24.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:24.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:24.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:24.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:24.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:24.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:24.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:24.817013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.817591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.817591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:24.817591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.817591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:24.818207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.818207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:24.818207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:24.818207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:24.818207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:24.818207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:24.818207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.818207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:24.818207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:24.818207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.818207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:24.818207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:24.818207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.818207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:24.818207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:24.818207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:24.818901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:24.819411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.819411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:24.819411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.819411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.819411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:24.819411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.819411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:24.819586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:24.819822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:24.819994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:24.820192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:24.820686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:24.821077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.821859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:24.821859 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.821859 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:24.821859 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.821859 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.821859 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:24.821859 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.821859 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:24.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:24.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:24.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:24.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:24.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:24.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:24.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:24.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:24.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:24.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:24.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:24.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:24.823490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:24.823490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:24.823490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.823490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:24.823490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.823490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.823490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:24.823490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.823490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:24.824499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.824499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:24.824499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:24.824499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:24.824499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.824499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:24.824499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:24.824499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:24.824499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:24.824499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.824499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:24.824856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:24.824856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:24.824856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.824856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:24.824856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:24.824856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:24.824856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:24.824856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:24.824856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:24.824856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:24.824856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:24.824856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.824856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:24.824856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.825216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.825216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:24.825216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.825216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:24.825216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.825216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:24.825216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:24.825216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:24.825216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:24.825216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:24.825216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.825216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:24.825216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:24.825216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:24.825612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:24.826079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:24.826079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:24.826079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:24.826079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:24.826079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.826079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:24.826079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.826079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.826079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:24.826079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.826079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:24.826079 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:24.826454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:24.826454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:24.826520 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:24.826926 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:24.827257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:24.827509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.828188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:24.828188 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.828188 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:24.828188 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.828188 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.828188 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:24.828188 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.828188 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:24.829325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.829325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:24.829325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:24.829325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:24.829325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.829325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:24.829325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:24.829325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.829325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:24.829325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:24.829325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:24.829325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.829795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:24.829795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:24.829795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:24.829795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:24.829795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:24.829795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:24.829795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:24.829795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:24.829795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.829795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:24.829795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.829795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.829795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:24.830125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.830125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:24.830125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.830125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:24.830125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:24.830125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:24.830125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:24.830125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:24.830125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.830125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:24.830125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:24.830125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.830125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:24.830125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:24.830125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:24.830646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:24.831181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:24.831181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:24.831181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:24.831181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:24.831181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:24.831181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:29.668467 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:29.669343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:29.669656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:29.671266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:29.710096 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:29.710384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.711302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:29.711302 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.711302 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:29.711302 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.711302 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.711302 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:29.711302 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.711302 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:29.712641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.712641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:29.712641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:29.712641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:29.712641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.712641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:29.712641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:29.712641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.712641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:29.712641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:29.712641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:29.712641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.713305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:29.713305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:29.713305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:29.713305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:29.713305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:29.713305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:29.713305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:29.713305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:29.713305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.713305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:29.713305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.713305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.713305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:29.713996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.713996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:29.714119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.714119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:29.714119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:29.714119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:29.714119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:29.714119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:29.714119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.714119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:29.714119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:29.714119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.714119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:29.714119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:29.714119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.714119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:29.714119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:29.714119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.714997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.715980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:29.715980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.715980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:29.773699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:29.774740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:29.774982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:29.776506 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:29.776835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:29.777102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.778079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:29.778079 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.778079 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:29.778079 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.778079 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.778079 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:29.778079 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.778079 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:29.780031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.780031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:29.780031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:29.780031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:29.780031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.780031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:29.780031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:29.780031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.780031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:29.780031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:29.780031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:29.780031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:29.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:29.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:29.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:29.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:29.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:29.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:29.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:29.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:29.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.780464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:29.780807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.780807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:29.781923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.781923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:29.781923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:29.781923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:29.781923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:29.781923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:29.781923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.781923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:29.781923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:29.781923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.781923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:29.781923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:29.781923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.781923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:29.781923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:29.781923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.782410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.782930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:29.782930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.782930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:29.811915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:29.812825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:29.813078 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:29.813351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:44:29.814282 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:29.814682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.817083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:29.817083 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.817083 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:29.817083 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.817083 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.817083 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:29.817083 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.817083 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:29.817816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.817816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:29.817816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:29.817816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:29.817816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.817816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:29.817816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:29.817816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:29.817816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.817816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:29.817816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:29.817816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:29.817816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:29.817816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:29.817816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:29.818744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:29.818744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:29.818744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.818744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:29.818744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.818744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.818744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:29.818744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.818744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:29.819882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.819882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:29.819882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:29.819882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:29.819882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.819882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:29.819882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:29.819882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:44:29.819882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:29.819882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:29.819882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.819882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:29.820665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:29.820665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:29.820665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.820665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:29.820665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:29.820665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:29.820665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:29.820665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:29.820665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:29.820665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:29.820665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:29.820665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.820665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:29.820665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.821298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.821298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:29.821298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.821298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:29.821298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.821298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:29.821298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:29.821298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:29.821298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:29.821298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:29.821298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.821298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:29.821298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:29.821298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:29.821997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:29.823034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:29.823034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:29.823034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:29.823034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:29.823034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:29.823034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.823034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:29.823034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.823034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.823034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:29.823034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.823034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:29.823034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:29.823034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:29.823784 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:29.823784 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:29.823784 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:29.823784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.824786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:29.824786 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.824786 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:29.824786 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.824786 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.824786 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:29.824786 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.824786 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:29.825636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.825636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:29.825636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:29.825636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:29.825636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.825636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:29.825636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:29.825636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:29.825636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.825636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:29.825636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:29.825636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:29.825636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:29.825636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:29.825636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:29.825938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:29.825938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:29.825938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.825938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:29.825938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.825938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.825938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:29.825938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.825938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:29.826565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.826565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:29.826565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:29.826565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:29.826565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.826565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:29.826565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:29.826565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:29.826565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:29.826565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.826565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:29.826805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:29.826805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:29.826805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.826805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:29.826805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:29.826805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:29.826805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:29.826805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:29.826805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:29.826805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:29.826805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:29.826805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.826805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:29.826805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.827086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.827086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:29.827086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.827086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.827913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:29.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.828633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.828633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:29.828633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.828633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:29.828633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:29.828633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:29.828633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:29.828806 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:29.829273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:29.829850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:29.830064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.830999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:29.830999 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.830999 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:29.830999 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.830999 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.830999 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:29.830999 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.830999 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:29.831934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.831934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:29.831934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:29.831934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:29.831934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.831934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:29.831934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:29.831934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.831934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:29.831934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:29.831934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:29.831934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.832341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:29.832341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:29.832341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:29.832341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:29.832341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:29.832341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:29.832341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:29.832341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:29.832341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.832341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:29.832341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.832341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.832341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:29.832747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.832747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:29.832949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.832949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:29.832949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:29.832949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:29.832949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:29.832949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:29.832949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.832949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:29.832949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:29.832949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.832949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:29.832949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:29.832949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.832949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:29.832949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:29.832949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:29.833539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:29.834076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:29.834076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:29.834076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:34.669243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:34.670153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:34.670153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:34.671580 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:34.709887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:34.710100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.711262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:34.711262 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.711262 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:34.711262 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.711262 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.711262 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:34.711262 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.711262 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:34.712338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.712338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:34.712338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:34.712338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:34.712338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.712338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:34.712338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:34.712338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.712338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:34.712338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:34.712338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:34.712338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.713183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:34.713183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:34.713183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:34.713183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:34.713183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:34.713183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:34.713183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:34.713183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:34.713183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.713183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:34.713183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.713183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.713183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:34.713817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.713817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:34.713817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.713817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:34.713817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:34.713817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:34.713817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:34.713817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:34.713817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.713817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:34.713817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:34.713817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.713817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:34.713817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:34.713817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:34.714572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:34.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:34.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.715475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:34.774664 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:34.775137 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:34.775329 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:34.776654 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:34.777089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:34.777349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.778221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:34.778221 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.778221 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:34.778221 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.778221 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.778221 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:34.778221 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.778221 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:34.779936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.779936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:34.779936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:34.779936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:34.779936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.779936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:34.779936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:34.779936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.779936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:34.779936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:34.779936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:34.779936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.780340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:34.780340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:34.780340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:34.780340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:34.780340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:34.780340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:34.780340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:34.780340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:34.780340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.780340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:34.780340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.780340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.780340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:34.780794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.780794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:34.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:34.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:34.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:34.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:34.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:34.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:34.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:34.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:34.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:34.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:34.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:34.781917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.782562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.783190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:34.783190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.783190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:34.812623 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:34.813058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:34.813258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:34.813495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:44:34.814068 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:34.814394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.815268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:34.815268 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.815268 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:34.815268 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.815268 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.815268 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:34.815268 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.815268 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:34.816609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.816609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:34.816609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:34.816609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:34.816609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.816609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:34.816609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:34.816609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:34.816609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.816609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:34.816609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:34.816609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:34.816609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:34.816609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:34.816609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:34.817471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:34.817471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:34.817471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.817471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:34.817471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.817471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.817471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:34.817471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.817471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:34.818049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.818049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:34.818049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:34.818049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:34.818049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.818049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:34.818049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:34.818049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:44:34.818049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:34.818049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:34.818049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.818049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:34.818777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:34.818777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:34.818777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.818777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:34.818777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:34.818777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:34.818777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:34.818777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:34.818777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:34.818777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:34.818777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:34.818777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.818777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:34.818777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.819430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.819430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:34.819430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.819430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:34.819795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.819795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:34.819795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:34.819795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:34.819795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:34.819795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:34.819795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.819795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:34.819795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:34.819795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.819795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:34.819795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:34.819795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.819795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:34.819795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:34.819795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:34.820598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:34.821503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.821503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:34.821503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.821503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.821503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:34.821503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.821503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:34.822259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:34.822636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:34.822936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:34.823305 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:34.823744 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:34.824120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.824869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:34.824869 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.824869 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:34.824869 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.824869 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.824869 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:34.824869 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.824869 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:34.825610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.825610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:34.825610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:34.825610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:34.825610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.825610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:34.825610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:34.825610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:34.825610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.825610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:34.825610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:34.825610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:34.825610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:34.825610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:34.825610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:34.826024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:34.826024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:34.826024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.826024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:34.826024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.826024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.826024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:34.826024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.826024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:34.826472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.826472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:34.826472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:34.826472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:34.826472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.826472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:34.826472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:34.826472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:34.826472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:34.826472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.826472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:34.826830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:34.826830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:34.826830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.826830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:34.826830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:34.826830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:34.826830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:34.826830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:34.826830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:34.826830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:34.826830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:34.826830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.826830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:34.826830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.827217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.827217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:34.827217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.827217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.827550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:34.828044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.828601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.828601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:34.828601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.828601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:34.828601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:34.828601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:34.828795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:34.828862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:34.829303 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:34.829709 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:34.829978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.830855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:34.830855 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.830855 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:34.830855 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.830855 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.830855 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:34.830855 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.830855 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:34.831571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.831571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:34.831571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:34.831571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:34.831571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.831571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:34.831571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:34.831571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.831571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:34.831571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:34.831571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:34.831571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.831944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:34.831944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:34.831944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:34.831944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:34.831944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:34.831944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:34.831944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:34.831944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:34.831944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.831944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:34.831944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.831944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.831944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:34.832295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.832295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:34.832521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.832521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:34.832521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:34.832521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:34.832521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:34.832521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:34.832521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.832521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:34.832521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:34.832521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.832521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:34.832521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:34.832521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.832521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:34.832521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:34.832521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:34.832988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:34.833514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:34.833514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:34.833514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:39.669836 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:39.670618 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:39.670762 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:39.671617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:39.711417 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:39.711905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.713028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:39.713028 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.713028 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:39.713028 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.713028 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.713028 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:39.713028 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.713028 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:39.714015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.714015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:39.714015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:39.714015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:39.714015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.714015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:39.714015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:39.714015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.714015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:39.714015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:39.714015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:39.714015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.714613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:39.714613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:39.714613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:39.714613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:39.714613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:39.714613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:39.714613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:39.714613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:39.714613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.714613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:39.714613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.714613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.714613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:39.715094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.715094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:39.715094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.715094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:39.715094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:39.715094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:39.715094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:39.715094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:39.715094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.715094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:39.715094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:39.715094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.715094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:39.715094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:39.715094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:39.715780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.716509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:39.716509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.716509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.716509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:39.716509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.716509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:39.775268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:39.775858 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:39.776051 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:39.777381 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:39.777782 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:39.777994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.778859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:39.778859 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.778859 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:39.778859 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.778859 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.778859 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:39.778859 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.778859 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:39.779850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.779850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:39.779850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:39.779850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:39.779850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.779850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:39.779850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:39.779850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.779850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:39.779850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:39.779850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:39.779850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.780183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:39.780183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:39.780183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:39.780183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:39.780183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:39.780183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:39.780183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:39.780183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:39.780183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.780183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:39.780183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.780183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.780183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:39.780571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.780571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:39.780868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.780868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:39.780868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:39.780868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:39.780868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:39.780868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:39.780868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.780868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:39.780868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:39.780868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.780868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:39.780868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:39.780868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.780868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:39.780868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:39.780868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.781486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.782464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:39.782464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.782464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:39.813254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:39.813796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:39.813943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:39.814134 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:44:39.814955 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:39.815223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.815955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:39.815955 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.815955 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:39.815955 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.815955 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.815955 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:39.815955 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.815955 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:39.817114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.817114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:39.817114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:39.817114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:39.817114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.817114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:39.817114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:39.817114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:39.817114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.817114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:39.817114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:39.817114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:39.817114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:39.817114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:39.817114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:39.817842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:39.817842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:39.817842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.817842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:39.817842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.817842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.817842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:39.817842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.817842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:39.818282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.818282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:39.818282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:39.818282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:39.818282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.818282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:39.818282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:39.818282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:44:39.818282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:39.818282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:39.818282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.818282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:39.818949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:39.818949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:39.818949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.818949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:39.818949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:39.818949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:39.818949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:39.818949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:39.818949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:39.818949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:39.818949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:39.818949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.818949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:39.818949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.819784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.819784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:39.819784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.819784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:39.821501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.821501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:39.821501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:39.821501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:39.821501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:39.821501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:39.821501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.821501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:39.821501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:39.821501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.821501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:39.821501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:39.821501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.821501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:39.821501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:39.821501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:39.822310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:39.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:39.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:39.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:39.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:39.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:39.823186 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:39.823254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:39.823754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:39.824099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.824801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:39.824801 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.824801 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:39.824801 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.824801 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.824801 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:39.824801 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.824801 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:39.825860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.825860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:39.825860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:39.825860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:39.825860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.825860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:39.825860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:39.825860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:39.825860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.825860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:39.825860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:39.825860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:39.825860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:39.825860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:39.825860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:39.826275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:39.826275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:39.826275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.826275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:39.826275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.826275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.826275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:39.826275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.826275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:39.827061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.827061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:39.827061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:39.827061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:39.827061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.827061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:39.827061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:39.827061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:39.827061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:39.827061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.827061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:39.827388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:39.827388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:39.827388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.827388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:39.827388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:39.827388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:39.827388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:39.827388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:39.827388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:39.827388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:39.827388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:39.827388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.827388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:39.827388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.827772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.827772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:39.827772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.827772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.828539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:39.828977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.829463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.829463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:39.829463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.829463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:39.829463 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:39.829463 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:39.829463 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:39.829676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:39.829959 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:39.830186 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:39.830353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.830936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:39.830936 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.830936 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:39.830936 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.830936 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.830936 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:39.830936 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.830936 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:39.831794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.831794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:39.831794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:39.831794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:39.831794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.831794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:39.831794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:39.831794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.831794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:39.831794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:39.831794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:39.831794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.832162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:39.832162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:39.832162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:39.832162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:39.832162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:39.832162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:39.832162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:39.832162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:39.832162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.832162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:39.832162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.832162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.832162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:39.832538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.832538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:39.832778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.832778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:39.832778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:39.832778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:39.832778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:39.832778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:39.832778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.832778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:39.832778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:39.832778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.832778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:39.832778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:39.832778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.832778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:39.832778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:39.832778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:39.833290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:39.833771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:39.833771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:39.833771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:44.670806 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:44.671496 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:44.671647 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:44.672942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:44.707165 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:44.707446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.708097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:44.708097 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.708097 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:44.708097 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.708097 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.708097 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:44.708097 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.708097 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:44.708852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.708852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:44.708852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:44.708852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:44.708852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.708852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:44.708852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:44.708852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.708852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:44.708852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:44.708852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:44.708852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.709388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:44.709388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:44.709388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:44.709388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:44.709388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:44.709388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:44.709388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:44.709388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:44.709388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.709388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:44.709388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.709388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.709388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:44.709909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.709909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:44.709909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.709909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:44.709909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:44.709909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:44.709909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:44.709909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:44.709909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.709909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:44.709909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:44.709909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.709909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:44.709909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:44.709909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:44.710515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.711275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:44.711275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.711275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.711275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:44.711275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.711275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:44.775808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:44.776239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:44.776470 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:44.777484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:44.777817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:44.778056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.778908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:44.778908 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.778908 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:44.778908 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.778908 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.778908 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:44.778908 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.778908 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:44.780415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.780415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:44.780415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:44.780415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:44.780415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.780415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:44.780415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:44.780415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.780415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:44.780415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:44.780415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:44.780415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.780980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:44.780980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:44.780980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:44.780980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:44.780980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:44.780980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:44.780980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:44.780980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:44.780980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.780980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:44.780980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.780980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.780980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:44.781548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.781548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:44.782032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.782032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:44.782032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:44.782032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:44.782032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:44.782032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:44.782032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.782032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:44.782032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:44.782032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.782032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:44.782032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:44.782032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.782032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:44.782032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:44.782032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.782721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.783538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:44.783538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.783538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:44.813746 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:44.814177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:44.814356 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:44.814588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:44:44.815262 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:44.815621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.816666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:44.816666 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.816666 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:44.816666 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.816666 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.816666 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:44.816666 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.816666 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:44.818001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.818001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:44.818001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:44.818001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:44.818001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.818001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:44.818001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:44.818001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:44.818001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.818001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:44.818001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:44.818001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:44.818001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:44.818001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:44.818001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:44.818761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:44.818761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:44.818761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.818761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:44.818761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.818761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.818761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:44.818761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.818761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:44.819282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.819282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:44.819282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:44.819282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:44.819282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.819282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:44.819282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:44.819282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:44:44.819282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:44.819282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:44.819282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.819282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:44.819849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:44.819849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:44.819849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.819849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:44.819849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:44.819849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:44.819849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:44.819849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:44.819849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:44.819849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:44.819849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:44.819849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.819849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:44.819849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.820609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.820609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:44.820609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.820609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:44.820923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.820923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:44.820923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:44.820923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:44.820923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:44.820923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:44.820923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.820923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:44.820923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:44.820923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.820923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:44.820923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:44.820923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.820923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:44.820923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:44.820923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:44.821565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:44.822244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.822244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:44.822244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.822244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.822244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:44.822244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.822244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:44.822981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:44.823293 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:44.823491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:44.823680 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:44.824186 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:44.824566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.825299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:44.825299 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.825299 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:44.825299 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.825299 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.825299 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:44.825299 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.825299 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:44.826116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.826116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:44.826116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:44.826116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:44.826116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.826116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:44.826116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:44.826116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:44.826116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.826116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:44.826116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:44.826116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:44.826116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:44.826116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:44.826116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:44.826560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:44.826560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:44.826560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.826560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:44.826560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.826560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.826560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:44.826560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.826560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:44.826969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.826969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:44.826969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:44.826969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:44.826969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.826969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:44.826969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:44.826969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:44.826969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:44.826969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.826969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:44.827506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:44.827506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:44.827506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.827506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:44.827506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:44.827506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:44.827506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:44.827506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:44.827506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:44.827506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:44.827506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:44.827506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.827506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:44.827506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.827904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.827904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:44.827904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.827904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.828083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:44.828534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.829207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.829207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:44.829207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.829207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:44.829363 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:44.829621 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:44.829727 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:44.829873 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:44.830272 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:44.830637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:44.830853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.831505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:44.831505 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.831505 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:44.831505 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.831505 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.831505 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:44.831505 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.831505 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:44.832317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.832317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:44.832317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:44.832317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:44.832317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.832317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:44.832317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:44.832317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.832317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:44.832317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:44.832317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:44.832317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.832640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:44.832640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:44.832640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:44.832640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:44.832640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:44.832640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:44.832640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:44.832640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:44.832640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.832640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:44.832640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.832640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.832640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:44.832972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.832972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:44.833249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.833249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:44.833249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:44.833249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:44.833249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:44.833249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:44.833249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.833249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:44.833249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:44.833249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.833249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:44.833249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:44.833249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.833249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:44.833249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:44.833249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:44.833696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:44.834144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:44.834144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:44.834144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:49.693218 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:49.693842 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:49.694087 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:49.695458 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:49.735625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:49.735881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.736518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:49.736518 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.736518 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:49.736518 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.736518 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.736518 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:49.736518 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.736518 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:49.737555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.737555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:49.737555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:49.737555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:49.737555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.737555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:49.737555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:49.737555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.737555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:49.737555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:49.737555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:49.737555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.738220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:49.738220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:49.738220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:49.738220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:49.738220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:49.738220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:49.738220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:49.738220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:49.738220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.738220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:49.738220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.738220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.738220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:49.738932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.738932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:49.738932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.738932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:49.738932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:49.738932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:49.738932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:49.738932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:49.738932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.738932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:49.738932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:49.738932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.738932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:49.738932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:49.738932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:49.739769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.740878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:49.740878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.740878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.740878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:49.740878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.740878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:49.776407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:49.777280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:49.777530 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:49.779029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:49.779354 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:49.779627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.780574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:49.780574 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.780574 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:49.780574 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.780574 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.780574 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:49.780574 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.780574 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:49.782286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.782286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:49.782286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:49.782286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:49.782286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.782286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:49.782286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:49.782286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.782286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:49.782286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:49.782286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:49.782286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.782980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:49.782980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:49.782980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:49.782980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:49.782980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:49.782980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:49.782980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:49.782980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:49.782980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.782980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:49.782980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.782980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.782980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:49.783589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.783589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:49.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:49.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:49.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:49.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:49.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:49.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:49.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:49.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:49.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:49.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:49.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:49.784160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.785206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.786076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:49.786076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.786076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:49.814316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:49.815343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:49.815462 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:49.815613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:44:49.816516 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:49.816845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.817649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:49.817649 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.817649 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:49.817649 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.817649 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.817649 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:49.817649 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.817649 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:49.818568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.818568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:49.818568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:49.818568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:49.818568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.818568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:49.818568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:49.818568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:49.818568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.818568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:49.818568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:49.818568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:49.818568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:49.818568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:49.818568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:49.819312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:49.819312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:49.819312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.819312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:49.819312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.819312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.819312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:49.819312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.819312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:49.819805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.819805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:49.819805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:49.819805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:49.819805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.819805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:49.819805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:49.819805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:44:49.819805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:49.819805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:49.819805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.819805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:49.820345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:49.820345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:49.820345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.820345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:49.820345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:49.820345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:49.820345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:49.820345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:49.820345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:49.820345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:49.820345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:49.820345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.820345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:49.820345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.820962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.820962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:49.820962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.820962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:49.820962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.820962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:49.820962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:49.820962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:49.820962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:49.820962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:49.820962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.820962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:49.820962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:49.820962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:49.821598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:49.822509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:49.822509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:49.822509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:49.822509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:49.822509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:49.822509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.822509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:49.822509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.822509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.822509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:49.822509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.822509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:49.823516 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:49.823825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:49.823941 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:49.824069 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:49.824630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:49.825032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.825762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:49.825762 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.825762 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:49.825762 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.825762 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.825762 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:49.825762 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.825762 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:49.826539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.826539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:49.826539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:49.826539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:49.826539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.826539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:49.826539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:49.826539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:49.826539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.826539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:49.826539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:49.826539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:49.826539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:49.826539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:49.826539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:49.826952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:49.826952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:49.826952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.826952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:49.826952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.826952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.826952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:49.826952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.826952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:49.827384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.827384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:49.827384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:49.827384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:49.827384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.827384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:49.827384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:49.827384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:49.827384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:49.827384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.827384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:49.827725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:49.827725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:49.827725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.827725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:49.827725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:49.827725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:49.827725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:49.827725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:49.827725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:49.827725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:49.827725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:49.827725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.827725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:49.827725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.828116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.828116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:49.828116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.828116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.828441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:49.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.829386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.829386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:49.829386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.829386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:49.829795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:49.830075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:49.830185 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:49.830342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:49.830794 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:49.831287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:49.831585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.832317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:49.832317 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.832317 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:49.832317 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.832317 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.832317 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:49.832317 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.832317 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:49.833127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.833127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:49.833127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:49.833127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:49.833127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.833127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:49.833127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:49.833127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.833127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:49.833127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:49.833127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:49.833127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.833553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:49.833553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:49.833553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:49.833553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:49.833553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:49.833553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:49.833553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:49.833553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:49.833553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.833553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:49.833553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.833553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.833553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:49.833910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.833910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:49.834544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.834544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:49.834544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:49.834544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:49.834544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:49.834544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:49.834544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.834544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:49.834544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:49.834544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.834544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:49.834544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:49.834544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.834544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:49.834544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:49.834544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:49.835011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:49.835568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:49.835568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:49.835568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:54.694222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:54.695182 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:54.695273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:54.696652 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:54.698770 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:44:54.731327 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:54.731659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.732349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:54.732349 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.732349 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:54.732349 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.732349 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.732349 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:54.732349 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.732349 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:54.733403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.733403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:54.733403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:54.733403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:54.733403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.733403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:54.733403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:54.733403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.733403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:54.733403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:54.733403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:54.733403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.734024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:54.734024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:54.734024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:54.734024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:54.734024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:54.734024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:54.734024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:54.734024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:54.734024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.734024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:54.734024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.734024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.734024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:54.734655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.734655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:54.734655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.734655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:54.734655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:54.734655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:54.734655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:54.734655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:54.734655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.734655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:54.734655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:54.734655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.734655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:54.734655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:54.734655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:54.735328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.736150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:54.736150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.736150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.736150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:54.736150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.736150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:54.778153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:54.778575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:54.778676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:54.780093 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:54.780339 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:54.780507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.781387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:54.781387 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.781387 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:54.781387 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.781387 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.781387 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:54.781387 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.781387 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:54.783096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.783096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:54.783096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:54.783096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:54.783096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.783096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:54.783096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:54.783096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.783096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:54.783096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:54.783096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:54.783096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.783764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:54.783764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:54.783764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:54.783764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:54.783764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:54.783764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:54.783764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:54.783764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:54.783764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.783764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:54.783764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.783764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.783764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:54.784350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.784350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:54.785570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.785570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:54.785570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:54.785570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:54.785570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:54.785570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:54.785570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.785570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:54.785570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:54.785570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.785570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:54.785570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:54.785570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.785570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:54.785570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:54.785570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.786414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.787354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:54.787354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.787354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:54.815944 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:54.816429 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:54.816526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:54.816615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:44:54.817501 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:54.817807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.818645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:54.818645 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.818645 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:54.818645 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.818645 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.818645 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:54.818645 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.818645 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:54.819544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.819544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:54.819544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:54.819544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:54.819544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.819544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:54.819544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:54.819544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:54.819544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.819544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:54.819544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:54.819544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:54.819544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:54.819544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:54.819544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:54.820571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:54.820571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:54.820571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.820571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:54.820571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.820571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.820571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:54.820571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.820571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:54.820571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.820571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:54.820571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:54.820571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:54.820571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.821607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:54.821607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:54.821607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:44:54.821607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:54.821607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:54.821607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.821607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:54.821607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:54.821607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:54.821607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.821607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:54.821607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:54.821607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:54.821998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:54.821998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:54.821998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:54.821998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:54.821998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:54.821998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.821998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:54.821998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.821998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.821998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:54.821998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.821998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:54.822405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.822405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:54.822405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:54.822405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:54.822405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:54.822405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:54.822405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.822405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:54.822405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:54.822405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.822405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:54.822405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:54.822405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.822405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:54.822405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:54.822405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:54.822906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:54.823447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.823447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:54.823447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.823447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.823447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:54.823447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.823447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:54.824083 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:54.824610 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:54.824849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:54.825066 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:54.825777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:54.826147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.827005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:54.827005 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.827005 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:54.827005 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.827005 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.827005 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:54.827005 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.827005 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:54.827763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.827763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:54.827763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:54.827763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:54.827763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.827763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:54.827763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:54.827763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:54.827763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.827763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:54.827763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:54.827763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:54.827763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:54.827763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:54.827763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:54.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:54.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:54.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:54.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:54.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.828256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:54.828635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.828635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:54.828635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:54.828635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:54.828635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.828635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:54.828635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:54.828635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:54.828635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:54.828635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.828635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.829820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.829820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:54.829820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.829820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.830014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:54.830791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.831617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.831617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:54.831617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.831617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:54.831617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:54.831617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:54.831617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:54.831617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:54.832055 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:54.832055 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:54.832055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.832207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:54.832207 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.832207 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:54.832207 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.832207 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.832207 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:54.832207 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.832207 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:54.833043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.833043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:54.833043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:54.833043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:54.833043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.833043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:54.833043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:54.833043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.833043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:54.833043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:54.833043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:54.833043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.833531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:54.833531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:54.833531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:54.833531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:54.833531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:54.833531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:54.833531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:54.833531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:54.833531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.833531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:54.833531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.833531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.833531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:54.834135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.834135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:54.834135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.834135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:54.834135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:54.834135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:54.834135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:54.834135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:54.834135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.834135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:54.834135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:54.834135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.834135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:54.834135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:54.834135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:54.834731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:54.835451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:54.835451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:54.835451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:54.835451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:54.835451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:54.835451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:59.695083 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:59.695977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:59.696053 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:59.697397 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:59.729415 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:59.729856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.730958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:59.730958 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.730958 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:59.730958 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.730958 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.730958 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:59.730958 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.730958 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:59.732201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.732201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:59.732201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:59.732201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:59.732201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.732201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:59.732201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:59.732201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.732201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:59.732201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:59.732201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:59.732201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.733050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:59.733050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:59.733050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:59.733050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:59.733050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:59.733050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:59.733050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:59.733050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:59.733050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.733050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:59.733050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.733050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.733050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:59.733754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.733754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:59.733754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.733754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:59.733754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:59.733754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:59.733754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:59.733754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:59.733754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.733754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:59.733754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:59.733754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.733754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:59.733754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:59.733754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:59.734625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:59.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:59.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.736829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:59.778207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:59.779032 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:59.779202 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:59.780252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:59.780664 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:59.780911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.781772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:59.781772 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.781772 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:59.781772 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.781772 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.781772 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:59.781772 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.781772 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:59.783214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.783214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:59.783214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:59.783214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:59.783214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.783214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:59.783214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:59.783214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.783214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:59.783214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:59.783214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:59.783214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.783632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:59.783632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:59.783632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:59.783632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:59.783632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:59.783632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:59.783632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:59.783632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:59.783632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.783632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:59.783632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.783632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.783632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:59.784015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.784015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:59.784750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.784750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:59.784750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:59.784750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:59.784750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:59.784750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:59.784750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.784750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:59.784750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:59.784750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.784750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:59.784750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:59.784750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.784750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:59.784750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:59.784750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.785219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.785780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:59.785780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.785780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:59.816504 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:59.817068 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:59.817282 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:59.817516 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:44:59.818399 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:59.818580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.819541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:59.819541 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.819541 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:59.819541 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.819541 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.819541 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:59.819541 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.819541 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:59.820809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.820809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:59.820809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:59.820809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:59.820809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.820809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:59.820809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:59.820809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:59.820809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.820809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:59.820809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:59.820809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:59.820809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:59.820809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:59.820809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:59.821779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:59.821779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:59.821779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.821779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:59.821779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.821779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.821779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:59.821779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.821779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:59.822237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.822237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:59.822237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:59.822237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:59.822237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.822237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:59.822237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:59.822237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:44:59.822237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:59.822237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:59.822237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.822237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:59.822851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:59.822851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:59.822851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.822851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:59.822851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:59.822851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:59.822851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:59.822851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:59.822851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:59.822851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:59.822851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:59.822851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.822851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:59.822851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.823473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.823473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:59.823473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.823473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:59.823906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.823906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:59.823906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:59.823906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:59.823906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:59.823906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:59.823906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.823906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:59.823906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:59.823906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.823906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:59.823906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:59.823906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.823906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:59.823906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:59.823906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:59.824628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:59.825437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.825437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:59.825437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.825437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.825437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:59.825437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.825437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:59.825437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:59.825437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:59.825437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:59.825955 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:59.825955 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:59.826323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.827407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:59.827407 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.827407 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:59.827407 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.827407 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.827407 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:59.827407 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.827407 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:59.828208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.828208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:44:59.828208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:59.828208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:59.828208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.828208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:59.828208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:59.828208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:59.828208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.828208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:44:59.828208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:59.828208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:44:59.828208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:59.828208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:44:59.828208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:44:59.828673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:59.828673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:44:59.828673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.828673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:44:59.828673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.828673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.828673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:44:59.828673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.828673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:44:59.829138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.829138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:59.829138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:59.829138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:59.829138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.829138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:59.829138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:59.829138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:59.829138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:59.829138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.829138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:59.829505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:59.829505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:59.829505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.829505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:59.829505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:59.829505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:59.829505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:59.829505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:59.829505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:59.829505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:59.829505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:59.829505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.829505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:59.829505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.829906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.829906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:59.829906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.829906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.830224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:59.830718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.831220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.831220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:59.831220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.831220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:44:59.831220 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:44:59.831220 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:44:59.831220 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:44:59.831220 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:44:59.831527 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:59.831628 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:44:59.831805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.832406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:44:59.832406 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.832406 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:44:59.832406 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.832406 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.832406 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:44:59.832406 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.832406 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:44:59.833308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.833308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:44:59.833308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:59.833308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:44:59.833308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.833308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:59.833308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:59.833308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.833308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:59.833308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:59.833308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:59.833308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.833707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:44:59.833707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:59.833707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:44:59.833707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:59.833707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:44:59.833707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:44:59.833707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:59.833707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:44:59.833707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.833707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:44:59.833707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.833707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.833707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:44:59.834056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.834056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:44:59.834352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.834352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:44:59.834352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:44:59.834352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:44:59.834352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:44:59.834352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:44:59.834352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.834352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:44:59.834352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:44:59.834352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.834352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:44:59.834352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:44:59.834352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.834352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:44:59.834352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:44:59.834352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:44:59.834841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:44:59.835342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:44:59.835342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:44:59.835342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:03.774421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:03.775210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_for_inconsistencies {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:03.775282 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Checking Neutron and OVN revision consistency. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:03.784594 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:440}}
Apr 24 10:45:03.784734 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=106381) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:419}}
Apr 24 10:45:03.784835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 412fe0fb-d3c8-41ef-b742-c7e091bf5e56 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:45:03.818644 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, resource={'id': '412fe0fb-d3c8-41ef-b742-c7e091bf5e56', 'name': 'private', 'tenant_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'project_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['bedea127-581a-4245-bdcf-823b49c82996', 'd98dd98c-3740-4b7b-9054-95b7f384275a'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:19:49Z', 'updated_at': '2026-04-24T10:19:53Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 21598}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:03.818972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:03.819571 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-d9e6c44e-2c1f-4e1c-97fa-3abe15d536c8, external_ids_update=None, columns={'tag': 21598}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:03.819760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.820661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:03.820661 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:03.820661 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:03.820661 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:03.820661 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:03.820661 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:03.820661 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.820661 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:03.821687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 412fe0fb-d3c8-41ef-b742-c7e091bf5e56 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.821687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:03.821687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:45:03.821687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:45:03.821687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:45:03.821687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:45:03.821687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:45:03.821687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:03.821687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:03.821687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:03.821687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:03.822263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:03.822263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:03.822263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:03.822263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:03.822263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:03.822263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:03.822263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:03.822263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:03.822263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:03.822263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:03.822263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:03.822263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:03.822263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:03.822263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:03.822927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:03.822927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.822927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:03.822927 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 86c46bc9-7739-46e7-9c49-62d2723e0d83 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:45:03.851086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, resource={'id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'name': 'public', 'tenant_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'project_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['4daf396b-50dc-4100-9154-fd24fc0e5f1d', '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-24T10:19:55Z', 'updated_at': '2026-04-24T10:20:05Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:03.851498 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:03.852164 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-b792be55-4fbf-4e4f-a9dc-10cee932ceea, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:03.852559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:03.853340 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:03.853340 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:03.853340 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:03.853340 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:03.853340 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:03.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:03.854529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 86c46bc9-7739-46e7-9c49-62d2723e0d83 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.854529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:03.854529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:45:03.854529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:45:03.854529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:45:03.854529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:45:03.854529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:45:03.854529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:03.854529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:03.854529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:03.854529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:03.855098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:03.855098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:03.855098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:03.855098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:03.855098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:03.855098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:03.855098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:03.855098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:03.855098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:03.855098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:03.855098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:03.855098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:03.855098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:03.855098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:03.856392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:03.856392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.856392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:03.856392 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 64c3f969-5120-406a-afc1-20f8f45b7533 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:45:03.883515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-64c3f969-5120-406a-afc1-20f8f45b7533, resource={'id': '64c3f969-5120-406a-afc1-20f8f45b7533', 'name': 'admin_net', 'tenant_id': '91bc93878b40449c8fd1c9924d8a3e8b', 'project_id': '91bc93878b40449c8fd1c9924d8a3e8b', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['18db2f65-6ba9-4ddd-8ab7-55370a16debc'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:23:22Z', 'updated_at': '2026-04-24T10:23:23Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 10837}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:03.883943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-64c3f969-5120-406a-afc1-20f8f45b7533, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:03.884487 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-a26d15c8-ce05-4e3e-84bc-9aa33edf96fe, external_ids_update=None, columns={'tag': 10837}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:03.884677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.885573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:03.885573 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:03.885573 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:03.885573 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:03.885573 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:03.885573 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:03.885573 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.885573 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:03.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 64c3f969-5120-406a-afc1-20f8f45b7533 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:03.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:45:03.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:45:03.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:45:03.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:45:03.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:45:03.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:03.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:03.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:03.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:03.887306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:03.887306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:03.887306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:03.887306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:03.887306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:03.887306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:03.887306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:03.887306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:03.887306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:03.887306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:03.887306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:03.887306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:03.887306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:03.887306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:03.888106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:03.888106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.888106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:03.888106 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource b30b34a1-477c-4ef7-aea4-d9540988f10a (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:45:03.917254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a, resource={'id': 'b30b34a1-477c-4ef7-aea4-d9540988f10a', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'tenant_id': '277dd31c279b430f90665727a827242c', 'project_id': '277dd31c279b430f90665727a827242c', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['a3090689-5a84-48d5-9685-f418bb1fd559'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:24:04Z', 'updated_at': '2026-04-24T10:24:05Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 23713}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:03.917738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:03.918321 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-6d5b7906-0378-49b8-88fc-e9fa642055e4, external_ids_update=None, columns={'tag': 23713}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:03.918562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.919432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:03.919432 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:03.919432 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:03.919432 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:03.919432 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:03.919432 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:03.919432 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.919432 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:03.920631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource b30b34a1-477c-4ef7-aea4-d9540988f10a (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.920631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:03.920631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:45:03.920631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:45:03.920631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:45:03.920631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:45:03.920631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:45:03.920631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:03.920631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:03.920631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:03.920631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:03.921126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:03.921126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:03.921126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:03.921126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:03.921126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:03.921126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:03.921126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:03.921126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:03.921126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:03.921126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:03.921126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:03.921126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:03.921126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:03.921126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:03.921764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:03.921764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.921764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:03.921764 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 931f18d3-b7f8-4874-928b-3c06d4d5d355 (type: routers) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:45:03.992015 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, resource={'id': '931f18d3-b7f8-4874-928b-3c06d4d5d355', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'project_id': '277dd31c279b430f90665727a827242c', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'external_fixed_ips': [{'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7', 'ip_address': '172.24.5.167'}, {'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'ip_address': '2001:db8::1b3'}], 'enable_snat': True}, 'gw_port_id': '77659748-a2b4-448f-aa2d-e166be8f2be9', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-7ytfi', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'external_fixed_ips': [{'ip_address': '172.24.5.167', 'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7'}, {'ip_address': '2001:db8::1b3', 'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-24T10:24:05Z', 'updated_at': '2026-04-24T10:24:08Z', 'revision_number': 3, 'tenant_id': '277dd31c279b430f90665727a827242c'}, resource_type=routers, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:03.992531 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:03.993022 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "77659748-a2b4-448f-aa2d-e166be8f2be9"')], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:03.993394 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "77659748-a2b4-448f-aa2d-e166be8f2be9"')], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:03.993600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.994592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:03.994592 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:03.994592 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:03.994592 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:03.994592 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:03.994592 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:03.994592 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.994592 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:03.994964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Unable to update router 931f18d3-b7f8-4874-928b-3c06d4d5d355. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.996589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 931f18d3-b7f8-4874-928b-3c06d4d5d355 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.996589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:03.996589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:45:03.996589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:45:03.996589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:45:03.996589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:45:03.996589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1634, in update_router
Apr 24 10:45:03.996589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 24 10:45:03.996589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
Apr 24 10:45:03.996589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 24 10:45:03.996589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 24 10:45:03.997134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 24 10:45:03.997134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1568, in update_router
Apr 24 10:45:03.997134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:03.997134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:03.997134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:03.997134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:03.997134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:03.997134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:03.997134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:03.997134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:03.997134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:03.997134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:03.997134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:03.997134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:03.997927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:03.997927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:03.997927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:03.997927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:03.997927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:03.997927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:03.997927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:03.997927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:03.997927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:03.997927 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 77659748-a2b4-448f-aa2d-e166be8f2be9 (type: router_ports) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:45:04.105302 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, resource={'id': '77659748-a2b4-448f-aa2d-e166be8f2be9', 'name': '', 'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'project_id': '', 'mac_address': 'fa:16:3e:fa:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '931f18d3-b7f8-4874-928b-3c06d4d5d355', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7', 'ip_address': '172.24.5.167'}, {'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'ip_address': '2001:db8::1b3'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000170011', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-24T10:24:06Z', 'updated_at': '2026-04-24T10:24:07Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:04.105578 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7 4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'neutron:network_name': 'neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.167/24', '2001:db8::1b3/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:04.106166 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=77659748-a2b4-448f-aa2d-e166be8f2be9, lrouter_port=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:04.106616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.107763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:04.107763 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.107763 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:04.107763 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.107763 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.107763 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:04.107763 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.107763 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:04.108666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 77659748-a2b4-448f-aa2d-e166be8f2be9 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.108666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:04.108666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:45:04.108666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:45:04.108666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:45:04.108666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:45:04.108666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1971, in update_router_port
Apr 24 10:45:04.108666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:04.108666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.108666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:04.108666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:04.109209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:04.109209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.109209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:04.109209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:04.109209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:04.109209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:04.109209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:04.109209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:04.109209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:04.109209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:04.109209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.109209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:04.109209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.109209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.109655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:04.109655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.109655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:04.109655 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_for_inconsistencies finished in 0.333 seconds
Apr 24 10:45:04.695910 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:04.696407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:04.696614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:04.698026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:04.733979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:04.734587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.735483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:04.735483 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.735483 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:04.735483 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.735483 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.735483 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:04.735483 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.735483 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:04.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:04.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:04.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:04.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:04.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:04.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:04.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:04.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:04.736210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.737420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:04.737420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:04.737420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:04.737420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:04.737420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:04.737420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:04.737420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:04.737420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:04.737420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.737420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:04.737420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.737420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.737420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:04.738892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.738892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:04.738892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.738892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:04.738892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:04.738892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:04.738892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:04.738892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:04.738892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.738892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:04.738892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:04.738892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.738892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:04.738892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:04.738892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:04.739465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.739949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:04.739949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.739949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.739949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:04.739949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.739949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:04.778961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:04.779507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:04.779700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:04.780751 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:04.781057 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:04.781277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.782968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:04.782968 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.782968 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:04.782968 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.782968 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.782968 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:04.782968 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.782968 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:04.784600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.784600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:04.784600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:04.784600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:04.784600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.784600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:04.784600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:04.784600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.784600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:04.784600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:04.784600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:04.784600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.785221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:04.785221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:04.785221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:04.785221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:04.785221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:04.785221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:04.785221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:04.785221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:04.785221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.785221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:04.785221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.785221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.785221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:04.785857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.785857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:04.785965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.785965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:04.785965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:04.785965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:04.785965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:04.785965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:04.785965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.785965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:04.785965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:04.785965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.785965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:04.785965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:04.785965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.785965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:04.785965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:04.785965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.786852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.787797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:04.787797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.787797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:04.816980 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:04.817315 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:04.817542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:04.817726 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:45:04.818253 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:04.818587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.819335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:04.819335 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.819335 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:04.819335 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.819335 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.819335 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:04.819335 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.819335 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:04.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:04.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:04.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:04.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:04.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:04.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:04.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:04.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:04.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:04.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:04.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:04.820523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:04.821568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:04.821568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:04.821568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.821568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:04.821568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.821568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.821568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:04.821568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.821568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:04.822160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.822160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:04.822160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:04.822160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:04.822160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.822160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:04.822160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:04.822160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:45:04.822160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:04.822160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:04.822160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.822160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:04.822870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:04.822870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:04.822870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.822870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:04.822870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:04.822870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:04.822870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:04.822870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:04.822870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:04.822870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:04.822870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:04.822870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.822870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:04.822870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.823640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.823640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:04.823640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.823640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:04.823929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.823929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:04.823929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:04.823929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:04.823929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:04.823929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:04.823929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.823929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:04.823929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:04.823929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.823929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:04.823929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:04.823929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.823929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:04.823929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:04.823929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:04.824596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:04.825114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.825114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:04.825114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.825114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.825114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:04.825114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.825114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:04.825114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:04.825362 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:04.825582 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:04.825769 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:04.826322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:04.826855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.827814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:04.827814 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.827814 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:04.827814 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.827814 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.827814 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:04.827814 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.827814 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:04.831012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.831012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:04.831012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:04.831012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:04.831012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.831012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:04.831012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:04.831012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:04.831012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.831012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:04.831012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:04.831012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:04.831012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:04.831012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:04.831012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:04.831570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:04.831570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:04.831570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.831570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:04.831570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.831570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.831570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:04.831570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.831570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:04.831570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.831570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:04.831570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:04.831570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:04.831570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.831997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:04.831997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:04.831997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:04.831997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:04.831997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.831997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:04.831997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:04.831997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:04.831997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.831997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:04.831997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:04.831997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:04.831997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:04.832384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:04.832384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:04.832384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:04.832384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:04.832384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.832384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:04.832384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.832384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.832384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:04.832384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.832384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:04.832384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:04.832790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.833354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:04.834022 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:04.834219 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:04.834300 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:04.834633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:04.835563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:04.835563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:04.835563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.835563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:04.835563 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.835563 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:04.835563 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.835563 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.835563 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:04.835563 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.835563 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:04.836010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.836010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:04.836010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:04.836010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:04.836010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.836010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:04.836010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:04.836010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.836010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:04.836010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:04.836010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:04.836010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.836276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:04.836276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:04.836276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:04.836276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:04.836276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:04.836276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:04.836276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:04.836276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:04.836276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.836276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:04.836276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.836276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.836276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:04.836557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.836557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:04.836706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.836706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:04.836706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:04.836706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:04.836706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:04.836706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:04.836706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.836706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:04.836706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:04.836706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.836706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:04.836706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:04.836706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.836706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:04.836706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:04.836706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:04.837036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:04.837449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:04.837449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:04.837449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:09.696774 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:09.697935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:09.697935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:09.699328 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:09.739523 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:09.739847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.741453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:09.741453 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.741453 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:09.741453 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.741453 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.741453 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:09.741453 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.741453 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:09.741964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.741964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:09.741964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:09.741964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:09.741964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.741964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:09.741964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:09.741964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.741964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:09.741964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:09.741964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:09.741964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.742606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:09.742606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:09.742606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:09.742606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:09.742606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:09.742606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:09.742606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:09.742606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:09.742606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.742606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:09.742606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.742606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.742606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:09.743207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.743207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:09.743207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.743207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:09.743207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:09.743207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:09.743207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:09.743207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:09.743207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.743207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:09.743207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:09.743207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.743207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:09.743207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:09.743207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:09.743954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.745143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:09.745143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.745143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.745143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:09.745143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.745143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:09.779764 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:09.780597 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:09.780803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:09.782064 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:09.782393 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:09.782776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.783719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:09.783719 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.783719 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:09.783719 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.783719 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.783719 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:09.783719 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.783719 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:09.784814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.784814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:09.784814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:09.784814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:09.784814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.784814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:09.784814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:09.784814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.784814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:09.784814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:09.784814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:09.784814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.786510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:09.786510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:09.786510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:09.786510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:09.786510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:09.786510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:09.786510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:09.786510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:09.786510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.786510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:09.786510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.786510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.786510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:09.787927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.787927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:09.787927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.787927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:09.787927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:09.787927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:09.787927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:09.787927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:09.787927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.787927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:09.787927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:09.787927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.787927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:09.787927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:09.787927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:09.789605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.790547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:09.790547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.790547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.790547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:09.790547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.790547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:09.817989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:09.818628 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:09.818745 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:09.818871 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:45:09.819543 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:09.819930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.820818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:09.820818 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.820818 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:09.820818 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.820818 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.820818 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:09.820818 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.820818 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:09.822218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.822218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:09.822218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:09.822218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:09.822218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.822218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:09.822218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:09.822218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:09.822218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.822218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:09.822218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:09.822218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:09.822218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:09.822218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:09.822218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:09.823000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:09.823000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:09.823000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.823000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:09.823000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.823000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.823000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:09.823000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.823000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:09.823674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.823674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:09.823674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:09.823674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:09.823674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.823674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:09.823674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:09.823674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:45:09.823674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:09.823674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:09.823674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.823674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:09.825189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:09.825189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:09.825189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.825189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:09.825189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:09.825189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:09.825189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:09.825189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:09.825189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:09.825189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:09.825189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:09.825189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.825189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:09.825189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.826492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.826492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:09.826492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.826492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:09.826492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.826492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:09.826492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:09.826492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:09.826492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:09.826492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:09.826492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.826492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:09.826492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:09.826492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:09.827057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:09.827786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:09.827786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:09.827786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:09.827786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:09.827786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:09.827786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.827786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:09.827786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.827786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.827786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:09.827786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.827786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:09.827786 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:09.827786 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:09.828175 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:09.828175 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:09.828175 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:09.828175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.828175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:09.828175 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.828175 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:09.828175 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.828175 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.828175 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:09.828175 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.828175 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:09.829915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.829915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:09.829915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:09.829915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:09.829915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.829915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:09.829915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:09.829915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:09.829915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.829915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:09.829915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:09.829915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:09.829915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:09.829915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:09.829915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:09.830489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:09.830489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:09.830489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.830489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:09.830489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.830489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.830489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:09.830489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.830489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:09.892455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.892455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:09.892455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:09.892455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:09.892455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.892455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:09.892455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:09.892455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:09.892455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:09.892455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.892455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:09.892747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:09.892747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:09.892747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.892747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:09.892747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:09.892747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:09.892747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:09.892747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:09.892747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:09.892747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:09.892747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:09.892747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.892747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:09.892747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.892998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.892998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:09.892998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.892998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:09.892998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.894906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:09.895284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.895637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.895637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:09.895637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.895637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:09.895637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:09.895637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:09.895766 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:09.896162 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:09.896406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:09.896540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.897039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:09.897039 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.897039 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:09.897039 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.897039 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.897039 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:09.897039 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.897039 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:09.897961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.897961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:09.897961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:09.897961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:09.897961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.897961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:09.897961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:09.897961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.897961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:09.897961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:09.897961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:09.897961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:09.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:09.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:09.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:09.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:09.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:09.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:09.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:09.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:09.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:09.898478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.898478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:09.899057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.899057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:09.899057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:09.899057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:09.899057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:09.899057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:09.899057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.899057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:09.899057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:09.899057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.899057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:09.899057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:09.899057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.899057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:09.899057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:09.899057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:09.899387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:09.899778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:09.899778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:09.899778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:14.697868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:14.699185 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:14.699185 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:14.699633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:14.737829 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:14.738307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.739242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:14.739242 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.739242 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:14.739242 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.739242 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.739242 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:14.739242 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.739242 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:14.740007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.740007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:14.740007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:14.740007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:14.740007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.740007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:14.740007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:14.740007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.740007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:14.740007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:14.740007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:14.740007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.740595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:14.740595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:14.740595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:14.740595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:14.740595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:14.740595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:14.740595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:14.740595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:14.740595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.740595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:14.740595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.740595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.740595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:14.741007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.741007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:14.741007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.741007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:14.741007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:14.741007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:14.741007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:14.741007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:14.741007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.741007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:14.741007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:14.741007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.741007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:14.741007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:14.741007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:14.741503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.742035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:14.742035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.742035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.742035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:14.742035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.742035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:14.780607 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:14.781065 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:14.781323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:14.782388 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:14.782770 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:14.783031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.783909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:14.783909 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.783909 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:14.783909 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.783909 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.783909 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:14.783909 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.783909 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:14.785569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.785569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:14.785569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:14.785569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:14.785569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.785569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:14.785569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:14.785569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.785569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:14.785569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:14.785569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:14.785569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.786062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:14.786062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:14.786062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:14.786062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:14.786062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:14.786062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:14.786062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:14.786062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:14.786062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.786062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:14.786062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.786062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.786062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:14.786564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.786564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:14.787321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.787321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:14.787321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:14.787321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:14.787321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:14.787321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:14.787321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.787321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:14.787321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:14.787321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.787321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:14.787321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:14.787321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.787321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:14.787321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:14.787321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.788061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.788850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:14.788850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.788850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:14.818673 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:14.818985 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:14.819157 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:14.819433 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:45:14.819998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:14.820303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.821181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:14.821181 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.821181 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:14.821181 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.821181 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.821181 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:14.821181 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.821181 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:14.822933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.822933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:14.822933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:14.822933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:14.822933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.822933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:14.822933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:14.822933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:14.822933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.822933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:14.822933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:14.822933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:14.822933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:14.822933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:14.822933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:14.823745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:14.823745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:14.823745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.823745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:14.823745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.823745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.823745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:14.823745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.823745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:14.824540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.824540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:14.824540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:14.824540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:14.824540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.824540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:14.824540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:14.824540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:45:14.824540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:14.824540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:14.824540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.824540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:14.825190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:14.825190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:14.825190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.825190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:14.825190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:14.825190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:14.825190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:14.825190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:14.825190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:14.825190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:14.825190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:14.825190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.825190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:14.825190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.825943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.825943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:14.825943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.825943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:14.826570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.826570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:14.826570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:14.826570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:14.826570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:14.826570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:14.826570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.826570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:14.826570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:14.826570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.826570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:14.826570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:14.826570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.826570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:14.826570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:14.826570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:14.827246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:14.827728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.827728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:14.827728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.827728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.827728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:14.827728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.827728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:14.827728 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:14.827728 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:14.827728 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:14.828000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:14.828000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:14.828432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.829025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:14.829025 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.829025 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:14.829025 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.829025 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.829025 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:14.829025 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.829025 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:14.829825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.829825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:14.829825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:14.829825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:14.829825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.829825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:14.829825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:14.829825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:14.829825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.829825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:14.829825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:14.829825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:14.829825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:14.829825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:14.829825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:14.830199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:14.830199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:14.830199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.830199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:14.830199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.830199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.830199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:14.830199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.830199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:14.830692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.830692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:14.830692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:14.830692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:14.830692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.830692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:14.830692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:14.830692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:14.830692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:14.830692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.830692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:14.831009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:14.831009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:14.831009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.831009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:14.831009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:14.831009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:14.831009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:14.831009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:14.831009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:14.831009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:14.831009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:14.831009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.831009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:14.831009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.831381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.831381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:14.831381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.831381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.831758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:14.832290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.832818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.832818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:14.832818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.832818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:14.895301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:14.895640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:14.895810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:14.896047 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:14.896534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:14.896786 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:14.896936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.897617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:14.897617 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.897617 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:14.897617 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.897617 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.897617 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:14.897617 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.897617 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:14.898905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.898905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:14.898905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:14.898905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:14.898905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.898905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:14.898905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:14.898905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.898905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:14.898905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:14.898905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:14.898905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.899487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:14.899487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:14.899487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:14.899487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:14.899487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:14.899487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:14.899487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:14.899487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:14.899487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.899487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:14.899487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.899487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.899487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:14.900033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.900033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:14.900518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.900518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:14.900518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:14.900518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:14.900518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:14.900518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:14.900518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.900518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:14.900518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:14.900518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.900518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:14.900518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:14.900518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.900518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:14.900518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:14.900518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:14.901239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:14.902147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:14.902147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:14.902147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:19.698434 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:19.699065 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:19.699065 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:19.699635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:19.738311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:19.738695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.739615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:19.739615 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.739615 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:19.739615 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.739615 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.739615 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:19.739615 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.739615 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:19.740811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.740811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:19.740811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:19.740811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:19.740811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.740811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:19.740811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:19.740811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.740811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:19.740811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:19.740811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:19.740811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.741301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:19.741301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:19.741301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:19.741301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:19.741301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:19.741301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:19.741301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:19.741301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:19.741301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.741301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:19.741301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.741301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.741301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:19.741745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.741745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:19.742019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.742019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:19.742019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:19.742019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:19.742019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:19.742019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:19.742019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.742019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:19.742019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:19.742019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.742019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:19.742019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:19.742019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.742019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:19.742019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:19.742019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.742602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.743264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:19.743264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.743264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:19.823515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:19.823515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:19.823515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:19.823515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:19.823515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:19.823515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.823830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:19.823830 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.823830 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:19.823830 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.823830 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.823830 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:19.823830 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.823830 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:19.823830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.008 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.823830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:19.823830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:19.823830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:19.823830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.823830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:19.823830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:19.824510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.824510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:19.824510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:19.824510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:19.824510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.824510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:19.824510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:19.824510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:19.824510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:19.824510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:19.824510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:19.824510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:19.824510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:19.824510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.824984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:19.824984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.824984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.824984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:19.824984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.824984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:19.824984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.824984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:19.824984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:19.824984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:19.824984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:19.824984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:19.824984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.824984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:19.825273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:19.825707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:19.825707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:19.825707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:19.825707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.825707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:19.825707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.825707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.825707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:19.825707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.825707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:19.825707 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:19.825707 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:19.825978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:19.825978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:45:19.825978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:19.825978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.825978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:19.825978 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.825978 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:19.825978 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.825978 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.825978 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:19.825978 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.825978 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:19.826673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.826673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:19.826673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:19.826673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:19.826673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.826673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:19.826673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:19.826673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:19.826673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.826673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:19.826673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:19.826673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:19.826673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:19.826673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:19.826673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:19.827089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:19.827089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:19.827089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.827089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:19.827089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.827089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.827089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:19.827089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.827089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:19.827089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.827089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:19.827089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:19.827089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:19.827089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.827533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:19.827533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:19.827533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:45:19.827533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:19.827533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:19.827533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.827533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:19.827533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:19.827533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:19.827533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.827533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:19.827533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:19.827533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:19.828819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:19.828819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:19.828819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:19.828819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:19.828819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:19.828819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.828819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:19.828819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.828819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.828819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:19.828819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.828819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:19.829094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.829094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:19.829094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:19.829094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:19.829094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:19.829094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:19.829094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.829094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:19.829094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:19.829094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.829094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:19.829094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:19.829094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.829094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:19.829094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:19.829094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:19.829484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:19.829897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.829897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:19.829897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.829897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.829897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:19.829897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.829897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:19.829897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:19.829897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:19.829897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:19.830249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:19.830249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:19.830249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.830249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:19.830249 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.830249 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:19.830249 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.830249 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.830249 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:19.830249 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.830249 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:19.830875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.830875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:19.830875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:19.830875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:19.830875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.830875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:19.830875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:19.830875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:19.830875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.830875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:19.830875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:19.830875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:19.830875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:19.830875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:19.830875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:19.831167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:19.831167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:19.831167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.831167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:19.831167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.831167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.831167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:19.831167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.831167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:19.831482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.831482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:19.831482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:19.831482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:19.831482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.831482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:19.831482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:19.831482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:19.831482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:19.831482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.831482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:19.831735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:19.831735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:19.831735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.831735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:19.831735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:19.831735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:19.831735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:19.831735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:19.831735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:19.831735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:19.831735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:19.831735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.831735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:19.831735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.832042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.832042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:19.832042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.832042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.832242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:19.832721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.833214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.833214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:19.833214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.833214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:19.895845 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:19.896268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:19.896565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:19.897524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:19.897524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:19.897791 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:19.897996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.898716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:19.898716 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.898716 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:19.898716 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.898716 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.898716 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:19.898716 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.898716 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:19.900338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.900338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:19.900338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:19.900338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:19.900338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.900338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:19.900338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:19.900338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.900338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:19.900338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:19.900338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:19.900338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.900725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:19.900725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:19.900725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:19.900725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:19.900725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:19.900725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:19.900725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:19.900725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:19.900725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.900725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:19.900725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.900725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.900725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:19.901086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.901086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:19.901952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.901952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:19.901952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:19.901952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:19.901952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:19.901952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:19.901952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.901952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:19.901952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:19.901952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.901952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:19.901952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:19.901952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.901952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:19.901952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:19.901952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:19.902453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:19.902982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:19.902982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:19.902982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:24.698866 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:24.700687 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:24.700858 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:24.702296 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:24.737729 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:24.738115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.738983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:24.738983 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.738983 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:24.738983 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.738983 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.738983 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:24.738983 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.738983 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:24.739782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.739782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:24.739782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:24.739782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:24.739782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.739782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:24.739782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:24.739782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.739782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:24.739782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:24.739782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:24.739782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.740238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:24.740238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:24.740238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:24.740238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:24.740238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:24.740238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:24.740238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:24.740238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:24.740238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.740238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:24.740238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.740238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.740238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:24.740669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.740669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:24.740669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.740669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:24.740669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:24.740669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:24.740669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:24.740669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:24.740669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.740669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:24.740669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:24.740669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.740669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:24.740669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:24.740669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:24.741155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.741763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:24.741763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.741763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.741763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:24.741763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.741763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:24.782163 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:24.782630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:24.782835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:24.783860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:24.784246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:24.784527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.785739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:24.785739 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.785739 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:24.785739 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.785739 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.785739 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:24.785739 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.785739 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:24.787133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.787133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:24.787133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:24.787133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:24.787133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.787133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:24.787133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:24.787133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.787133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:24.787133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:24.787133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:24.787133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.787765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:24.787765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:24.787765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:24.787765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:24.787765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:24.787765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:24.787765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:24.787765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:24.787765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.787765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:24.787765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.787765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.787765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:24.788317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.788317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:24.788837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.788837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:24.788837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:24.788837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:24.788837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:24.788837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:24.788837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.788837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:24.788837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:24.788837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.788837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:24.788837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:24.788837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.788837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:24.788837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:24.788837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.789541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.790338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:24.790338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.790338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:24.819883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:24.820340 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:24.820558 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:24.820741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:45:24.821456 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:24.821803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.822756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:24.822756 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.822756 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:24.822756 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.822756 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.822756 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:24.822756 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.822756 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:24.823959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.823959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:24.823959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:24.823959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:24.823959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.823959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:24.823959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:24.823959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:24.823959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.823959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:24.823959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:24.823959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:24.823959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:24.823959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:24.823959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:24.824783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:24.824783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:24.824783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.824783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:24.824783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.824783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.824783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:24.824783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.824783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:24.825228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.825228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:24.825228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:24.825228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:24.825228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.825228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:24.825228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:24.825228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:45:24.825228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:24.825228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:24.825228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.825228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:24.825814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:24.825814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:24.825814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.825814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:24.825814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:24.825814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:24.825814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:24.825814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:24.825814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:24.825814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:24.825814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:24.825814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.825814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:24.825814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.826424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.826424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:24.826424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.826424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:24.826980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.826980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:24.826980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:24.826980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:24.826980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:24.826980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:24.826980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.826980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:24.826980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:24.826980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.826980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:24.826980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:24.826980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.826980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:24.826980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:24.826980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:24.827721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:24.828607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.828607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:24.828607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.828607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.828607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:24.828607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.828607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:24.829095 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:24.829459 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:24.829638 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:24.829830 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:24.832214 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:24.832467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.832959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:24.832959 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.832959 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:24.832959 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.832959 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.832959 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:24.832959 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.832959 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:24.833671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.833671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:24.833671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:24.833671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:24.833671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.833671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:24.833671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:24.833671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:24.833671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.833671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:24.833671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:24.833671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:24.833671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:24.833671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:24.833671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:24.834092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:24.834092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:24.834092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.834092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:24.834092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.834092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.834092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:24.834092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.834092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:24.834622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.834622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:24.834622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:24.834622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:24.834622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.834622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:24.834622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:24.834622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:24.834622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:24.834622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.834622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:24.834962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:24.834962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:24.834962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.834962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:24.834962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:24.834962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:24.834962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:24.834962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:24.834962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:24.834962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:24.834962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:24.834962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.834962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:24.834962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.835348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.835348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:24.835348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.835348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.835757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:24.836234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.836761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.836761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:24.836761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.836761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:24.896428 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:24.896916 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:24.897102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:24.897338 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:24.898323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:24.898864 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:24.899123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.900133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:24.900133 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.900133 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:24.900133 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.900133 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.900133 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:24.900133 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.900133 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:24.901464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.901464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:24.901464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:24.901464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:24.901464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.901464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:24.901464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:24.901464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.901464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:24.901464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:24.901464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:24.901464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.902047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:24.902047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:24.902047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:24.902047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:24.902047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:24.902047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:24.902047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:24.902047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:24.902047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.902047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:24.902047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.902047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.902047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:24.902622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.902622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:24.903040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.903040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:24.903040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:24.903040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:24.903040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:24.903040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:24.903040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.903040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:24.903040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:24.903040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.903040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:24.903040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:24.903040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.903040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:24.903040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:24.903040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:24.903783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:24.904608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:24.904608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:24.904608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:29.699303 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:29.699796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:29.699898 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:29.700812 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:29.732765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:29.733130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.734033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:29.734033 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.734033 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:29.734033 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.734033 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.734033 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:29.734033 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.734033 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:29.734789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.734789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:29.734789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:29.734789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:29.734789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.734789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:29.734789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:29.734789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.734789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:29.734789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:29.734789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:29.734789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.735170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:29.735170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:29.735170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:29.735170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:29.735170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:29.735170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:29.735170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:29.735170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:29.735170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.735170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:29.735170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.735170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.735170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:29.735524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.735524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:29.735524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.735524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:29.735524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:29.735524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:29.735524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:29.735524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:29.735524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.735524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:29.735524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:29.735524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.735524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:29.735524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:29.735524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:29.736004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.736475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:29.736475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.736475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.736475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:29.736475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.736475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:29.782979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:29.783613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:29.783800 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:29.784913 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:29.785476 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:29.785590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.786359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:29.786359 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.786359 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:29.786359 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.786359 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.786359 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:29.786359 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.786359 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:29.787914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.787914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:29.787914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:29.787914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:29.787914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.787914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:29.787914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:29.787914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.787914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:29.787914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:29.787914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:29.787914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.788326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:29.788326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:29.788326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:29.788326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:29.788326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:29.788326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:29.788326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:29.788326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:29.788326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.788326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:29.788326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.788326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.788326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:29.788798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.788798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:29.789736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.789736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:29.789736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:29.789736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:29.789736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:29.789736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:29.789736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.789736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:29.789736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:29.789736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.789736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:29.789736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:29.789736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.789736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:29.789736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:29.789736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.790218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.790759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:29.820549 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:29.821237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:29.821762 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:29.821813 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:45:29.822388 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:29.822679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.823751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:29.823751 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.823751 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:29.823751 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.823751 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.823751 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:29.823751 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.823751 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:29.824947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.824947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:29.824947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:29.824947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:29.824947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.824947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:29.824947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:29.824947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:29.824947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.824947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:29.824947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:29.824947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:29.824947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:29.824947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:29.824947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:29.825441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:29.825441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:29.825441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.825441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:29.825441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.825441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.825441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:29.825441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.825441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:29.826389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.826389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:29.826389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:29.826389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:29.826389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.826389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:29.826389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:29.826389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:45:29.826389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:29.826389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:29.826389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.826389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:29.826756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:29.826756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:29.826756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.826756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:29.826756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:29.826756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:29.826756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:29.826756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:29.826756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:29.826756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:29.826756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:29.826756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.826756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:29.826756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.827172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.827172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:29.827172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.827172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:29.830407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.830407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:29.830407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:29.830407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:29.830407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:29.830407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:29.830407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.830407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:29.830407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:29.830407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.830407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:29.830407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:29.830407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.830407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:29.830407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:29.830407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:29.830881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:29.831327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.831327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:29.831327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.831327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.831327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:29.831327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.831327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:29.831327 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:29.831327 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:29.831327 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:29.831650 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:29.831650 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:29.831650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.831650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:29.831650 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.831650 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:29.831650 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.831650 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.831650 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:29.831650 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.831650 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:29.832026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.832026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:29.832026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:29.832026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:29.832026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.832026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:29.832026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:29.832026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:29.832026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.832026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:29.832026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:29.832026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:29.832026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:29.832026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:29.832026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:29.832480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:29.832480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:29.832480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.832480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:29.832480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.832480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.832480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:29.832480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.832480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:29.832871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.832871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:29.832871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:29.832871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:29.832871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.832871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:29.832871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:29.832871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:29.832871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:29.832871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.832871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:29.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:29.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:29.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:29.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:29.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:29.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:29.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:29.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:29.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:29.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:29.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:29.833197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.833672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.833672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:29.833672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.833672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.833957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:29.834509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.834997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.834997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:29.834997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.834997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:29.897280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:29.898153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:29.898153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:29.898545 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:29.899082 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:29.899342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:29.899506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.900293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:29.900293 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.900293 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:29.900293 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.900293 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.900293 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:29.900293 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.900293 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:29.901932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.901932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:29.901932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:29.901932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:29.901932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.901932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:29.901932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:29.901932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.901932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:29.901932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:29.901932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:29.901932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.902645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:29.902645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:29.902645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:29.902645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:29.902645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:29.902645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:29.902645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:29.902645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:29.902645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.902645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:29.902645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.902645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.902645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:29.903152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.903152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:29.905604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.905604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:29.905604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:29.905604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:29.905604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:29.905604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:29.905604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.905604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:29.905604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:29.905604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.905604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:29.905604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:29.905604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.905604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:29.905604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:29.905604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:29.906214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:29.906700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:29.906700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:29.906700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:34.700016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:34.701033 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:34.701033 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:34.701332 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:34.733945 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:34.734213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.734877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:34.734877 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.734877 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:34.734877 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.734877 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.734877 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:34.734877 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.734877 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:34.735651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.735651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:34.735651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:34.735651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:34.735651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.735651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:34.735651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:34.735651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.735651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:34.735651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:34.735651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:34.735651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.736289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:34.736289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:34.736289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:34.736289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:34.736289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:34.736289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:34.736289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:34.736289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:34.736289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.736289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:34.736289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.736289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.736289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:34.736977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.736977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:34.736977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.736977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:34.736977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:34.736977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:34.736977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:34.736977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:34.736977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.736977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:34.736977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:34.736977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.736977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:34.736977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:34.736977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:34.737757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.738690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:34.738690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.738690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.738690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:34.738690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.738690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:34.783508 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:34.783664 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:34.783726 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:34.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:34.785196 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:34.785719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.786465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:34.786465 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.786465 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:34.786465 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.786465 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.786465 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:34.786465 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.786465 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:34.787364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.787364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:34.787364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:34.787364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:34.787364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.787364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:34.787364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:34.787364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.787364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:34.787364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:34.787364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:34.787364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.787987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:34.787987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:34.787987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:34.787987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:34.787987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:34.787987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:34.787987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:34.787987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:34.787987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.787987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:34.787987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.787987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.787987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:34.788576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.788576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:34.788576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.788576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:34.788576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:34.788576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:34.788576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:34.788576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:34.788576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.788576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:34.788576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:34.788576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.788576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:34.788576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:34.788576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:34.789222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.790064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:34.790064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.790064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.790064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:34.790064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.790064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:34.822481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:34.822481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:34.822481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:34.822481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:45:34.824965 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:34.824965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.824965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:34.824965 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.824965 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:34.824965 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.824965 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.824965 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:34.824965 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.824965 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:34.827079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.827079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:34.827079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:34.827079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:34.827079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.827079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:34.827079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:34.827079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:34.827079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.827079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:34.827079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:34.827079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:34.827079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:34.827079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:34.827079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:34.828002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:34.828002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:34.828002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.828002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:34.828002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.828002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.828002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:34.828002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.828002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:34.828002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.828002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:34.828002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:34.828002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:34.828002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.829132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:34.829132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:34.829132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:45:34.829132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:34.829132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:34.829132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.829132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:34.829132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:34.829132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:34.829132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.829132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:34.829132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:34.829132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:34.831797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:34.831797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:34.831797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:34.831797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:34.831797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:34.831797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.831797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:34.831797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.831797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.831797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:34.831797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.831797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:34.832891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.832891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:34.832891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:34.832891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:34.832891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:34.832891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:34.832891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.832891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:34.832891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:34.832891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.832891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:34.832891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:34.832891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.832891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:34.832891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:34.832891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:34.834344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:34.836342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.836342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:34.836342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.836342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.836342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:34.836342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.836342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:34.836342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:34.836342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:34.836342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:34.836945 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:34.836945 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:34.836945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.836945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:34.836945 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.836945 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:34.836945 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.836945 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.836945 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:34.836945 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.836945 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:34.836945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:34.837311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.839227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:34.839227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.839227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.839227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:34.839227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.839227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:34.839227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.839227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:34.839227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:34.839227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:34.839227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.839227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:34.839227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:34.839988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:34.839988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:34.839988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.839988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:34.839988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:34.839988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:34.839988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.839988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:34.839988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:34.839988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:34.839988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:34.839988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:34.839988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:34.840625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:34.840625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:34.840625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.840625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:34.840625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.840625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.840625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:34.840625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.840625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:34.840625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.840625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:34.840625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.841224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.842066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:34.897869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:34.898171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:34.898393 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:34.898720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:34.899334 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:34.899771 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:34.899973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.900954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:34.900954 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.900954 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:34.900954 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.900954 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.900954 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:34.900954 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.900954 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:34.902435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.902435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:34.902435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:34.902435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:34.902435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.902435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:34.902435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:34.902435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.902435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:34.902435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:34.902435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:34.902435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.903075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:34.903075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:34.903075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:34.903075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:34.903075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:34.903075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:34.903075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:34.903075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:34.903075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.903075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:34.903075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.903075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.903075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:34.903871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.903871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:34.904476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.904476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:34.904476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:34.904476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:34.904476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:34.904476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:34.904476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.904476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:34.904476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:34.904476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.904476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:34.904476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:34.904476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.904476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:34.904476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:34.904476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:34.905214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:34.906047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:34.906047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:34.906047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:39.700537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:39.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:39.701548 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:39.701821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:39.738382 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:39.738801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.739812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:39.739812 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.739812 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:39.739812 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.739812 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.739812 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:39.739812 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.739812 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:39.740827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.740827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:39.740827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:39.740827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:39.740827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.740827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:39.740827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:39.740827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.740827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:39.740827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:39.740827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:39.740827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.741177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:39.741177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:39.741177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:39.741177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:39.741177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:39.741177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:39.741177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:39.741177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:39.741177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.741177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:39.741177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.741177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.741177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:39.741507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.741507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:39.741698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.741698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:39.741698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:39.741698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:39.741698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:39.741698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:39.741698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.741698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:39.741698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:39.741698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.741698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:39.741698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:39.741698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.741698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:39.741698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:39.741698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.742809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.744093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:39.744093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.744093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:39.784295 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:39.785305 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:39.785495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:39.786457 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:39.786793 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:39.787022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.787843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:39.787843 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.787843 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:39.787843 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.787843 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.787843 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:39.787843 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.787843 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:39.789004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.789004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:39.789004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:39.789004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:39.789004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.789004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:39.789004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:39.789004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.789004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:39.789004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:39.789004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:39.789004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.789652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:39.789652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:39.789652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:39.789652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:39.789652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:39.789652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:39.789652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:39.789652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:39.789652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.789652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:39.789652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.789652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.789652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:39.790244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.790244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:39.790244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.790244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:39.790244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:39.790244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:39.790244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:39.790244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:39.790244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.790244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:39.790244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:39.790244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.790244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:39.790244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:39.790244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:39.790981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.791877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:39.791877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.791877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.791877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:39.791877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.791877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:39.822007 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:39.822869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:39.823065 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:39.823388 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:45:39.824240 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:39.824511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.825306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:39.825306 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.825306 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:39.825306 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.825306 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.825306 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:39.825306 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.825306 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:39.826913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.826913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:39.826913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:39.826913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:39.826913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.826913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:39.826913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:39.826913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:39.826913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.826913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:39.826913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:39.826913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:39.826913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:39.826913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:39.826913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:39.827868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:39.827868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:39.827868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.827868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:39.827868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.827868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.827868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:39.827868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.827868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:39.828558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.828558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:39.828558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:39.828558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:39.828558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.828558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:39.828558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:39.828558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:45:39.828558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:39.828558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:39.828558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.828558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:39.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:39.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:39.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:39.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:39.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:39.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:39.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:39.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:39.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:39.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:39.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:39.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.830482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.830482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:39.830482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.830482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:39.830482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.830482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:39.830482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:39.830482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:39.830482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:39.830482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:39.830482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.830482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:39.830482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:39.830482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:39.831163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:39.832161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:39.832161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:39.832161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:39.832161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:39.832161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:39.832161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.832161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:39.832161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.832161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.832161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:39.832161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.832161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:39.832161 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:39.832161 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:39.832924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:39.832924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:39.832924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:39.832924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.832924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:39.832924 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.832924 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:39.832924 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.832924 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.832924 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:39.832924 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.832924 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:39.833547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.833547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:39.833547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:39.833547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:39.833547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.833547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:39.833547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:39.833547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:39.833547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.833547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:39.833547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:39.833547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:39.833547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:39.833547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:39.833547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:39.833939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:39.833939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:39.833939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.833939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:39.833939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.833939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.833939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:39.833939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.833939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:39.833939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.833939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:39.833939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:39.833939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:39.833939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.834326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:39.834326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:39.834326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:39.834326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:39.834326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.834326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:39.834326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:39.834326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:39.834326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.834326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:39.834326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:39.834326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:39.834326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:39.834700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:39.834700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:39.834700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:39.834700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:39.834700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.834700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:39.834700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.834700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.834700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:39.834700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.834700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.834998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:39.835452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.835940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.835940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:39.835940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.835940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:39.898694 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:39.899403 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:39.899622 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:39.899956 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:39.901067 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:39.901886 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:39.902206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.904641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:39.904641 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.904641 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:39.904641 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.904641 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.904641 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:39.904641 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.904641 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:39.906247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.906247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:39.906247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:39.906247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:39.906247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.906247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:39.906247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:39.906247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.906247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:39.906247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:39.906247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:39.906247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.907060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:39.907060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:39.907060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:39.907060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:39.907060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:39.907060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:39.907060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:39.907060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:39.907060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.907060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:39.907060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.907060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.907060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:39.907815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.907815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:39.907947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.907947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:39.907947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:39.907947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:39.907947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:39.907947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:39.907947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.907947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:39.907947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:39.907947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.907947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:39.907947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:39.907947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.907947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:39.907947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:39.907947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:39.908842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:39.909704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:39.909704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:39.909704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:44.701132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:44.702207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:44.702207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:44.703212 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:44.736057 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:44.736531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.737481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:44.737481 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.737481 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:44.737481 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.737481 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.737481 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:44.737481 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.737481 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:44.738511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.738511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:44.738511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:44.738511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:44.738511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.738511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:44.738511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:44.738511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.738511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:44.738511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:44.738511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:44.738511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.739211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:44.739211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:44.739211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:44.739211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:44.739211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:44.739211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:44.739211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:44.739211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:44.739211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.739211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:44.739211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.739211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.739211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:44.739926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.739926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:44.739926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.739926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:44.739926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:44.739926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:44.739926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:44.739926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:44.739926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.739926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:44.739926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:44.739926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.739926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:44.739926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:44.739926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:44.740783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.741781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:44.741781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.741781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.741781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:44.741781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.741781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:44.785540 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:44.785920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:44.786510 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:44.787239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:44.787592 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:44.787761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.788615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:44.788615 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.788615 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:44.788615 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.788615 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.788615 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:44.788615 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.788615 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:44.790066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.790066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:44.790066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:44.790066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:44.790066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.790066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:44.790066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:44.790066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.790066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:44.790066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:44.790066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:44.790066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.790979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:44.790979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:44.790979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:44.790979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:44.790979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:44.790979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:44.790979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:44.790979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:44.790979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.790979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:44.790979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.790979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.790979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:44.791742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.791742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:44.791856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.791856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:44.791856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:44.791856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:44.791856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:44.791856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:44.791856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.791856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:44.791856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:44.791856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.791856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:44.791856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:44.791856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.791856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:44.791856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:44.791856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.792716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.794338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:44.794338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.794338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:44.822935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:44.823363 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:44.823688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:44.823964 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:45:44.824743 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:44.824997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.825778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:44.825778 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.825778 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:44.825778 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.825778 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.825778 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:44.825778 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.825778 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:44.827409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.827409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:44.827409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:44.827409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:44.827409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.827409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:44.827409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:44.827409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:44.827409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.827409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:44.827409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:44.827409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:44.827409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:44.827409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:44.827409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:44.828171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:44.828171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:44.828171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.828171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:44.828171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.828171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.828171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:44.828171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.828171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:44.828955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.828955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:44.828955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:44.828955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:44.828955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.828955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:44.828955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:44.828955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:45:44.828955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:44.828955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:44.828955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.828955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:44.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:44.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:44.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:44.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:44.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:44.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:44.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:44.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:44.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:44.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:44.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:44.829499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.829879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.829879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:44.829879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.829879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:44.830671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.830671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:44.830671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:44.830671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:44.830671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:44.830671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:44.830671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.830671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:44.830671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:44.830671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.830671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:44.830671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:44.830671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.830671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:44.830671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:44.830671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:44.831134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:44.831668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.831668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:44.831668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.831668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.831668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:44.831668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.831668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:44.831668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:44.831668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:44.831668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:44.831983 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:44.831983 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:44.832177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.832835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:44.832835 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.832835 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:44.832835 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.832835 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.832835 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:44.832835 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.832835 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:44.834028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.834028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:44.834028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:44.834028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:44.834028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.834028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:44.834028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:44.834028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:44.834028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.834028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:44.834028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:44.834028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:44.834028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:44.834028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:44.834028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:44.834641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:44.834641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:44.834641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.834641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:44.834641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.834641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.834641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:44.834641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.834641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:44.835215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.835215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:44.835215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:44.835215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:44.835215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.835215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:44.835215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:44.835215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:44.835215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:44.835215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.835215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:44.835626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:44.835626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:44.835626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.835626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:44.835626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:44.835626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:44.835626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:44.835626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:44.835626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:44.835626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:44.835626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:44.835626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.835626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:44.835626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.836019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.836019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:44.836019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.836019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:44.836019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.836019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:44.836019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:44.836019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:44.836019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:44.836019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:44.836019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.836019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:44.836019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:44.836019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:44.836469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:44.837004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:44.837004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:44.837004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:44.837004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:44.837004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.837004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:44.837004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.837004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.837004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:44.837004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.837004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:44.899628 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:44.899907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:44.900126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:44.900424 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:44.901208 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:44.901500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:44.901660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.902387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:44.902387 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.902387 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:44.902387 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.902387 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.902387 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:44.902387 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.902387 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:44.903830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.903830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:44.903830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:44.903830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:44.903830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.903830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:44.903830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:44.903830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.903830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:44.903830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:44.903830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:44.903830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.904464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:44.904464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:44.904464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:44.904464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:44.904464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:44.904464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:44.904464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:44.904464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:44.904464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.904464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:44.904464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.904464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.904464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:44.904996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.904996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:44.905496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.905496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:44.905496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:44.905496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:44.905496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:44.905496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:44.905496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.905496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:44.905496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:44.905496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.905496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:44.905496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:44.905496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.905496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:44.905496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:44.905496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:44.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:44.907330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:44.907330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:44.907330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:49.701787 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:49.702605 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:49.702605 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:49.703604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:49.742715 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:49.743027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.743751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:49.743751 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.743751 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:49.743751 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.743751 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.743751 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:49.743751 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.743751 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:49.744470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.744470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:49.744470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:49.744470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:49.744470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.744470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:49.744470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:49.744470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.744470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:49.744470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:49.744470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:49.744470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.744897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:49.744897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:49.744897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:49.744897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:49.744897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:49.744897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:49.744897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:49.744897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:49.744897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.744897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:49.744897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.744897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.744897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:49.745297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.745297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:49.745297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.745297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:49.745297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:49.745297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:49.745297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:49.745297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:49.745297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.745297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:49.745297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:49.745297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.745297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:49.745297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:49.745297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:49.745796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.746334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:49.746334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.746334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.746334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:49.746334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.746334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:49.786119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:49.786565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:49.786755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:49.788256 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:49.788660 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:49.788900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.789888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:49.789888 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.789888 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:49.789888 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.789888 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.789888 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:49.789888 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.789888 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:49.791531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.791531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:49.791531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:49.791531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:49.791531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.791531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:49.791531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:49.791531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.791531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:49.791531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:49.791531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:49.791531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.791911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:49.791911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:49.791911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:49.791911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:49.791911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:49.791911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:49.791911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:49.791911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:49.791911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.791911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:49.791911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.791911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.791911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:49.792250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.792250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:49.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:49.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:49.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:49.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:49.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:49.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:49.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:49.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:49.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:49.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:49.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:49.793606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.794048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.794605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:49.794605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.794605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:49.823565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:49.824808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:49.824808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:49.824974 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:45:49.825586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:49.825816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.826472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:49.826472 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.826472 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:49.826472 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.826472 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.826472 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:49.826472 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.826472 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:49.827712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.827712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:49.827712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:49.827712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:49.827712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.827712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:49.827712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:49.827712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:49.827712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.827712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:49.827712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:49.827712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:49.827712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:49.827712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:49.827712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:49.828057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:49.828057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:49.828057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.828057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:49.828057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.828057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.828057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:49.828057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.828057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:49.829063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.829063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:49.829063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:49.829063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:49.829063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.829063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:49.829063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:49.829063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:45:49.829063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:49.829063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:49.829063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.829063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:49.829441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:49.829441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:49.829441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.829441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:49.829441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:49.829441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:49.829441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:49.829441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:49.829441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:49.829441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:49.829441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:49.829441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.829441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:49.829441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.829821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.829821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:49.829821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.829821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:49.830190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.830190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:49.830190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:49.830190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:49.830190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:49.830190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:49.830190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.830190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:49.830190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:49.830190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.830190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:49.830190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:49.830190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.830190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:49.830190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:49.830190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:49.830642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:49.831148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.831148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:49.831148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.831148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.831148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:49.831148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.831148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:49.831148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:49.831419 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:49.831459 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:49.831602 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:49.832028 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:49.832269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.832759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:49.832759 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.832759 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:49.832759 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.832759 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.832759 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:49.832759 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.832759 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:49.833518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.833518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:49.833518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:49.833518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:49.833518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.833518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:49.833518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:49.833518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:49.833518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.833518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:49.833518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:49.833518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:49.833518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:49.833518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:49.833518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:49.833903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:49.833903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:49.833903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.833903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:49.833903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.833903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.833903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:49.833903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.833903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:49.834355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.834355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:49.834355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:49.834355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:49.834355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.834355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:49.834355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:49.834355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:49.834355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:49.834355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.834355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:49.834697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:49.834697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:49.834697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.834697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:49.834697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:49.834697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:49.834697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:49.834697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:49.834697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:49.834697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:49.834697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:49.834697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.834697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:49.834697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.835065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.835065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:49.835065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.835065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.835379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:49.835848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.836562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.836562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:49.836562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.836562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:49.900125 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:49.900538 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:49.900711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:49.900968 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:49.901634 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:49.901909 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:49.902044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.902741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:49.902741 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.902741 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:49.902741 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.902741 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.902741 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:49.902741 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.902741 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:49.904191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.904191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:49.904191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:49.904191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:49.904191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.904191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:49.904191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:49.904191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.904191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:49.904191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:49.904191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:49.904191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.904716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:49.904716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:49.904716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:49.904716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:49.904716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:49.904716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:49.904716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:49.904716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:49.904716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.904716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:49.904716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.904716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.904716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:49.905289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.905289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:49.905906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.905906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:49.905906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:49.905906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:49.905906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:49.905906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:49.905906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.905906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:49.905906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:49.905906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.905906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:49.905906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:49.905906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.905906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:49.905906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:49.905906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:49.906706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:49.907519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:49.907519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:49.907519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:54.702573 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:54.703508 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:54.703508 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:54.704469 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:54.706730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=434 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:45:54.744066 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:54.744498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.745537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:54.745537 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.745537 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:54.745537 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.745537 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.745537 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:54.745537 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.745537 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:54.747203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.747203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:54.747203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:54.747203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:54.747203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.747203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:54.747203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:54.747203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.747203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:54.747203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:54.747203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:54.747203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.749336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:54.749336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:54.749336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:54.749336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:54.749336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:54.749336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:54.749336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:54.749336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:54.749336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.749336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:54.749336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.749336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.749336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:54.750333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.750333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:54.750333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.750333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:54.750333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:54.750333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:54.750333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:54.750333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:54.750333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.750333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:54.750333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:54.750333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.750333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:54.750333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:54.750333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:54.752128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.754163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:54.754163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.754163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.754163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:54.754163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.754163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:54.786891 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:54.787567 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:54.787755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:54.789017 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:54.789396 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:54.789750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.790632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:54.790632 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.790632 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:54.790632 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.790632 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.790632 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:54.790632 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.790632 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:54.792121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.792121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:54.792121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:54.792121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:54.792121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.792121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:54.792121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:54.792121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.792121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:54.792121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:54.792121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:54.792121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.792701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:54.792701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:54.792701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:54.792701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:54.792701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:54.792701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:54.792701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:54.792701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:54.792701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.792701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:54.792701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.792701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.792701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:54.793120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.793120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:54.793765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.793765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:54.793765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:54.793765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:54.793765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:54.793765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:54.793765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.793765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:54.793765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:54.793765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.793765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:54.793765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:54.793765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.793765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:54.793765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:54.793765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.794221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.794769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:54.794769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.794769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:54.824847 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:54.825311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:54.825539 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:54.825739 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:45:54.826385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:54.826794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.827782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:54.827782 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.827782 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:54.827782 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.827782 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.827782 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:54.827782 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.827782 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:54.829155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:54.830068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:54.830068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:54.830068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.830068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:54.830068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.830068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.830068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:54.830068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.830068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:54.830568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.830568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:54.830568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:54.830568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:54.830568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.830568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:54.830568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:54.830568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:45:54.830568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:54.830568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:54.830568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.830568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:54.831133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:54.831133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:54.831133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.831133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:54.831133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:54.831133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:54.831133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:54.831133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:54.831133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:54.831133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:54.831133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:54.831133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.831133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:54.831133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.831744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.831744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:54.831744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.831744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:54.832210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.832210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:54.832210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:54.832210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:54.832210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:54.832210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:54.832210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.832210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:54.832210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:54.832210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.832210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:54.832210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:54.832210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.832210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:54.832210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:54.832210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:54.832797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:54.833561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.833561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:54.833561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.833561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.833561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:54.833561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.833561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:54.833561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:54.833561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:54.833561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:54.834021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:54.834021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:54.834021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.834126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:54.834126 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.834126 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:54.834126 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.834126 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.834126 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:54.834126 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.834126 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:54.834909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.834909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:54.834909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:54.834909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:54.834909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.834909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:54.834909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:54.834909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:54.834909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.834909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:54.834909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:54.834909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:54.834909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:54.834909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:54.834909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:54.835309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:54.835309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:54.835309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.835309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:54.835309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.835309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.835309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:54.835309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.835309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:54.835814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.835814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:54.835814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:54.835814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:54.835814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.835814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:54.835814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:54.835814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:54.835814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:54.835814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.835814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:54.836187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:54.836187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:54.836187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.836187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:54.836187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:54.836187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:54.836187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:54.836187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:54.836187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:54.836187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:54.836187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:54.836187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.836187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:54.836187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.836566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.836566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:54.836566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.836566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.836893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:54.837369 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.837883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.837883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:54.837883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.837883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:54.900796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:54.901161 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:54.901344 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:54.901635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:54.902428 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:54.902906 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:54.903138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.904334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:54.904334 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.904334 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:54.904334 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.904334 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.904334 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:54.904334 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.904334 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:54.905550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.905550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:54.905550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:54.905550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:54.905550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.905550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:54.905550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:54.905550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.905550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:54.905550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:54.905550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:54.905550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.906401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:54.906401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:54.906401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:54.906401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:54.906401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:54.906401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:54.906401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:54.906401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:54.906401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.906401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:54.906401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.906401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.906401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:54.907070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.907070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:54.907070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.907070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:54.907070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:54.907070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:54.907070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:54.907070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:54.907070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.907070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:54.907070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:54.907070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.907070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:54.907070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:54.907070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:54.908019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:54.909086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:54.909086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:54.909086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:54.909086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:54.909086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:54.909086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:59.703046 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:59.705541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:59.705541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:59.707754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:59.743435 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:59.743744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.744605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:59.744605 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.744605 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:59.744605 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.744605 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.744605 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:59.744605 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.744605 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:59.745443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.745443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:59.745443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:59.745443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:59.745443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.745443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:59.745443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:59.745443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.745443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:59.745443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:59.745443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:59.745443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.746139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:59.746139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:59.746139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:59.746139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:59.746139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:59.746139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:59.746139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:59.746139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:59.746139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.746139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:59.746139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.746139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.746139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:59.746938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.746938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:59.746938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.746938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:59.746938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:59.746938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:59.746938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:59.746938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:59.746938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.746938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:59.746938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:59.746938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.746938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:59.746938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:59.746938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:59.747839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.750173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:59.750173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.750173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.750173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:59.750173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.750173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:59.787755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:59.788196 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:59.788379 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:59.789734 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:59.790133 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:59.790460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.791536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:59.791536 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.791536 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:59.791536 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.791536 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.791536 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:59.791536 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.791536 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:59.793001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.793001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:59.793001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:59.793001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:59.793001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.793001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:59.793001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:59.793001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.793001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:59.793001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:59.793001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:59.793001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.793319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:59.793319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:59.793319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:59.793319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:59.793319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:59.793319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:59.793319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:59.793319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:59.793319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.793319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:59.793319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.793319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.793319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:59.793613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.793613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:59.794796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.794796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:59.794796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:59.794796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:59.794796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:59.794796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:59.794796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.794796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:59.794796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:59.794796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.794796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:59.794796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:59.794796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.794796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:59.794796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:59.794796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.795144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.795587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:59.795587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.795587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:59.825544 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:59.825909 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:59.826042 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:59.826152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:45:59.826992 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:59.827281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.828096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:59.828096 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.828096 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:59.828096 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.828096 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.828096 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:59.828096 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.828096 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:59.829420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.829420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:59.829420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:59.829420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:59.829420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.829420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:59.829420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:59.829420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:59.829420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.829420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:59.829420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:59.829420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:59.829420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:59.829420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:59.829420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:59.829932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:59.829932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:59.829932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.829932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:59.829932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.829932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.829932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:59.829932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.829932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:59.830443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.830443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:59.830443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:59.830443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:59.830443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.830443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:59.830443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:59.830443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:45:59.830443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:59.830443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:59.830443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.830443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:59.830779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:59.830779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:59.830779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.830779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:59.830779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:59.830779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:59.830779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:59.830779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:59.830779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:59.830779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:59.830779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:59.830779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.830779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:59.830779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.831174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.831174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:59.831174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.831174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:59.832299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.832299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:59.832299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:59.832299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:59.832299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:59.832299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:59.832299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.832299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:59.832299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:59.832299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.832299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:59.832299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:59.832299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.832299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:59.832299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:59.832299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:59.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:59.833575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.833575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:59.833575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.833575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.833575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:59.833575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.833575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:59.833575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:59.833575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:59.833575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:59.833874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:59.833874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:59.834022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.834599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:59.834599 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.834599 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:59.834599 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.834599 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.834599 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:59.834599 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.834599 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:59.836638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.836638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:45:59.836638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:59.836638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:59.836638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.836638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:59.836638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:59.836638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:59.836638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.836638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:45:59.836638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:59.836638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:45:59.836638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:59.836638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:45:59.836638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:45:59.837077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:59.837077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:45:59.837077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.837077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:45:59.837077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.837077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.837077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:45:59.837077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.837077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:45:59.838254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.838254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:59.838254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:59.838254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:59.838254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.838254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:59.838254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:59.838254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:59.838254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:59.838254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.838254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:59.838644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:59.838644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:59.838644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.838644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:59.838644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:59.838644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:59.838644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:59.838644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:59.838644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:59.838644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:59.838644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:59.838644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.838644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:59.838644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.839067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.839067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:59.839067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.839067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.840213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:59.840765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.841244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.841244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:59.841244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.841244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:45:59.901270 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:45:59.901643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:45:59.901802 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:45:59.902045 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:45:59.902800 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:59.903145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:45:59.903340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.904119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:45:59.904119 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.904119 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:45:59.904119 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.904119 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.904119 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:45:59.904119 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.904119 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:45:59.905398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.905398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:45:59.905398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:59.905398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:45:59.905398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.905398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:59.905398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:59.905398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.905398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:59.905398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:59.905398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:59.905398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.905868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:45:59.905868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:59.905868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:45:59.905868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:59.905868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:45:59.905868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:45:59.905868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:59.905868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:45:59.905868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.905868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:45:59.905868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.905868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.905868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:45:59.906194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.906194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:45:59.906677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.906677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:45:59.906677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:45:59.906677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:45:59.906677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:45:59.906677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:45:59.906677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.906677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:45:59.906677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:45:59.906677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.906677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:45:59.906677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:45:59.906677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.906677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:45:59.906677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:45:59.906677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:45:59.907112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:45:59.907665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:45:59.907665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:45:59.907665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:04.704775 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:04.705814 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:04.705814 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:04.706430 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:04.740793 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:04.741237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.742184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:04.742184 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.742184 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:04.742184 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.742184 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.742184 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:04.742184 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.742184 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:04.743308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.743308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:04.743308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:04.743308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:04.743308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.743308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:04.743308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:04.743308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.743308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:04.743308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:04.743308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:04.743308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.743710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:04.743710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:04.743710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:04.743710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:04.743710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:04.743710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:04.743710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:04.743710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:04.743710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.743710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:04.743710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.743710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.743710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:04.744157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.744157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:04.744555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.744555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:04.744555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:04.744555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:04.744555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:04.744555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:04.744555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.744555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:04.744555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:04.744555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.744555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:04.744555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:04.744555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.744555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:04.744555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:04.744555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.745037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.745660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:04.745660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.745660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:04.788328 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:04.788896 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:04.789077 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:04.790089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:04.790472 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:04.790726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.791670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:04.791670 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.791670 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:04.791670 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.791670 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.791670 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:04.791670 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.791670 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:04.793281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.793281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:04.793281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:04.793281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:04.793281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.793281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:04.793281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:04.793281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.793281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:04.793281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:04.793281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:04.793281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.793876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:04.793876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:04.793876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:04.793876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:04.793876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:04.793876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:04.793876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:04.793876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:04.793876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.793876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:04.793876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.793876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.793876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:04.794563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.794563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:04.795164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.795164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:04.795164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:04.795164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:04.795164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:04.795164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:04.795164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.795164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:04.795164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:04.795164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.795164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:04.795164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:04.795164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.795164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:04.795164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:04.795164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.797170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:04.797170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.797170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:04.826133 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:04.826706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:04.826882 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:04.827065 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:46:04.827778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:04.828200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.829078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:04.829078 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.829078 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:04.829078 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.829078 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.829078 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:04.829078 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.829078 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:04.830338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.830338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:04.830338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:04.830338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:04.830338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.830338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:04.830338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:04.830338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:04.830338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.830338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:04.830338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:04.830338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:04.830338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:04.830338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:04.830338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:04.830976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:04.830976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:04.830976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.830976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:04.830976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.830976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.830976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:04.830976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.830976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:04.831666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.831666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:04.831666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:04.831666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:04.831666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.831666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:04.831666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:04.831666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:46:04.831666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:04.831666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:04.831666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.831666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:04.832187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:04.832187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:04.832187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.832187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:04.832187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:04.832187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:04.832187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:04.832187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:04.832187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:04.832187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:04.832187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:04.832187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.832187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:04.832187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.832791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.832791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:04.832791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.832791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:04.833117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.833117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:04.833117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:04.833117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:04.833117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:04.833117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:04.833117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.833117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:04.833117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:04.833117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.833117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:04.833117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:04.833117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.833117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:04.833117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:04.833117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:04.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:04.834437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.834437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:04.834437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.834437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.834437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:04.834437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.834437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:04.834437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:04.834437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:04.834437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:04.834823 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:04.834823 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:04.834823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.835082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:04.835082 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.835082 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:04.835082 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.835082 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.835082 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:04.835082 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.835082 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:04.835768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.835768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:04.835768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:04.835768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:04.835768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.835768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:04.835768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:04.835768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:04.835768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.835768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:04.835768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:04.835768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:04.835768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:04.835768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:04.835768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:04.836328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:04.836328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:04.836328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.836328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:04.836328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.836328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.836328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:04.836328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.836328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:04.836689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.836689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:04.836689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:04.836689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:04.836689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.836689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:04.836689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:04.836689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:04.836689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:04.836689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.836689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:04.837110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:04.837110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:04.837110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.837110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:04.837110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:04.837110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:04.837110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:04.837110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:04.837110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:04.837110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:04.837110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:04.837110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.837110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:04.837110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:04.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.837793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:04.838468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.839129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.839129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:04.839129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.839129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:04.902007 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:04.902723 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:04.902878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:04.903144 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:04.903993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:04.904561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:04.904713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.905458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:04.905458 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.905458 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:04.905458 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.905458 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.905458 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:04.905458 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.905458 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:04.906876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.906876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:04.906876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:04.906876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:04.906876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.906876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:04.906876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:04.906876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.906876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:04.906876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:04.906876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:04.906876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.907667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:04.907667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:04.907667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:04.907667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:04.907667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:04.907667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:04.907667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:04.907667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:04.907667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.907667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:04.907667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.907667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.907667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:04.908518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.908518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:04.908676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.908676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:04.908676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:04.908676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:04.908676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:04.908676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:04.908676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.908676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:04.908676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:04.908676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.908676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:04.908676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:04.908676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.908676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:04.908676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:04.908676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:04.909723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:04.910977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:04.910977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:04.910977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:09.705534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:09.706455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:09.706455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:09.707638 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:09.739603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:09.739796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.740581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:09.740581 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.740581 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:09.740581 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.740581 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.740581 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:09.740581 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.740581 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:09.742082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.742082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:09.742082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:09.742082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:09.742082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.742082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:09.742082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:09.742082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.742082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:09.742082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:09.742082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:09.742082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.742857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:09.742857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:09.742857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:09.742857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:09.742857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:09.742857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:09.742857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:09.742857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:09.742857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.742857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:09.742857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.742857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.742857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:09.743565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.743565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:09.743714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.743714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:09.743714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:09.743714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:09.743714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:09.743714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:09.743714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.743714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:09.743714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:09.743714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.743714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:09.743714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:09.743714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.743714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:09.743714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:09.743714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.744592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.745625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:09.745625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.745625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:09.788946 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:09.789411 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:09.789550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:09.790597 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:09.790874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:09.791040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.791654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:09.791654 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.791654 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:09.791654 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.791654 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.791654 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:09.791654 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.791654 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:09.793270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.793270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:09.793270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:09.793270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:09.793270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.793270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:09.793270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:09.793270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.793270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:09.793270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:09.793270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:09.793270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.793981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:09.793981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:09.793981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:09.793981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:09.793981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:09.793981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:09.793981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:09.793981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:09.793981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.793981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:09.793981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.793981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.793981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:09.794586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.794586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:09.794959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.794959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:09.794959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:09.794959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:09.794959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:09.794959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:09.794959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.794959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:09.794959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:09.794959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.794959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:09.794959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:09.794959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.794959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:09.794959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:09.794959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.795706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.796215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:09.796215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.796215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:09.827091 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:09.827558 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:09.827739 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:09.827919 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:46:09.828386 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:09.828604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.829345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:09.829345 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.829345 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:09.829345 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.829345 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.829345 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:09.829345 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.829345 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:09.830564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.830564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:09.830564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:09.830564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:09.830564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.830564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:09.830564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:09.830564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:09.830564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.830564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:09.830564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:09.830564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:09.830564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:09.830564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:09.830564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:09.831361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:09.831361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:09.831361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.831361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:09.831361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.831361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.831361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:09.831361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.831361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:09.831923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.831923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:09.831923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:09.831923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:09.831923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.831923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:09.831923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:09.831923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:46:09.831923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:09.831923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:09.831923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.831923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:09.832761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:09.832761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:09.832761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.832761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:09.832761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:09.832761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:09.832761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:09.832761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:09.832761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:09.832761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:09.832761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:09.832761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.832761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:09.832761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.833714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.833714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:09.833714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.833714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:09.833714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.833714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:09.833714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:09.833714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:09.833714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:09.833714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:09.833714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.833714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:09.833714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:09.833714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:09.834547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:09.835524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:09.835524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:09.835524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:09.835524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:09.835524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:09.835524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.835524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:09.835524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.835524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.835524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:09.835524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.835524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:09.835524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:09.835524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:09.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:09.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:09.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:09.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.836561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:09.836561 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.836561 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:09.836561 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.836561 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.836561 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:09.836561 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.836561 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:09.837316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.837316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:09.837316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:09.837316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:09.837316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.837316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:09.837316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:09.837316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:09.837316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.837316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:09.837316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:09.837316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:09.837316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:09.837316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:09.837316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:09.838253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:09.838253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:09.838253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.838253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:09.838253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.838253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.838253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:09.838253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.838253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:09.838253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.838253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:09.838253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:09.838253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:09.838253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.839101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:09.839101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:09.839101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:09.839101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:09.839101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.839101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:09.839101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:09.839101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:09.839101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.839101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:09.839101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:09.839101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:09.839101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:09.839429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:09.839429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:09.839429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:09.839429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:09.839429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.839429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:09.839429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.839429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.839429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:09.839429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.839429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:09.839429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:09.839692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.840085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:09.902835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:09.903483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:09.903656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:09.903967 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:09.904806 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:09.905242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:09.905542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.906342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:09.906342 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.906342 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:09.906342 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.906342 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.906342 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:09.906342 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.906342 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:09.907800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.907800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:09.907800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:09.907800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:09.907800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.907800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:09.907800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:09.907800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.907800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:09.907800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:09.907800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:09.907800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.908415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:09.908415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:09.908415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:09.908415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:09.908415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:09.908415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:09.908415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:09.908415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:09.908415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.908415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:09.908415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.908415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.908415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:09.908890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.908890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:09.909340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.909340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:09.909340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:09.909340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:09.909340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:09.909340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:09.909340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.909340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:09.909340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:09.909340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.909340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:09.909340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:09.909340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.909340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:09.909340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:09.909340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:09.910004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:09.910545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:09.910545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:09.910545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:14.706255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:14.707322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:14.707322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:14.708434 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:14.745695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:14.746194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.747068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:14.747068 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.747068 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:14.747068 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.747068 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.747068 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:14.747068 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.747068 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:14.748163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.748163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:14.748163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:14.748163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:14.748163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.748163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:14.748163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:14.748163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.748163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:14.748163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:14.748163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:14.748163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.748619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:14.748619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:14.748619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:14.748619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:14.748619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:14.748619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:14.748619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:14.748619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:14.748619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.748619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:14.748619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.748619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.748619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:14.749032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.749032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:14.749249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.749249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:14.749249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:14.749249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:14.749249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:14.749249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:14.749249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.749249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:14.749249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:14.749249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.749249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:14.749249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:14.749249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.749249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:14.749249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:14.749249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.750170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.750746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:14.750746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.750746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:14.789729 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:14.790157 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:14.790336 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:14.791452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:14.791802 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:14.792058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.792932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:14.792932 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.792932 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:14.792932 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.792932 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.792932 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:14.792932 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.792932 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:14.794399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.794399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:14.794399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:14.794399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:14.794399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.794399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:14.794399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:14.794399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.794399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:14.794399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:14.794399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:14.794399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.794979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:14.794979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:14.794979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:14.794979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:14.794979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:14.794979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:14.794979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:14.794979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:14.794979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.794979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:14.794979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.794979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.794979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:14.795588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.795588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:14.795961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.795961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:14.795961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:14.795961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:14.795961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:14.795961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:14.795961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.795961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:14.795961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:14.795961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.795961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:14.795961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:14.795961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.795961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:14.795961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:14.795961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.796930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.798003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:14.798003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.798003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:14.827749 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:14.828215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:14.828428 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:14.828617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:46:14.829321 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:14.829725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.830626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:14.830626 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.830626 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:14.830626 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.830626 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.830626 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:14.830626 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.830626 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:14.831931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.831931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:14.831931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:14.831931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:14.831931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.831931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:14.831931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:14.831931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:14.831931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.831931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:14.831931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:14.831931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:14.831931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:14.831931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:14.831931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:14.832928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:14.832928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:14.832928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.832928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:14.832928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.832928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.832928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:14.832928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.832928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:14.833596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.833596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:14.833596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:14.833596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:14.833596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.833596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:14.833596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:14.833596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:46:14.833596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:14.833596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:14.833596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.833596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:14.834432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:14.834432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:14.834432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.834432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:14.834432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:14.834432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:14.834432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:14.834432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:14.834432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:14.834432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:14.834432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:14.834432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.834432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:14.834432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.835335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.835335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:14.835335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.835335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:14.835335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.835335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:14.835335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:14.835335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:14.835335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:14.835335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:14.835335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.835335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:14.835335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:14.835335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:14.836179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:14.837228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:14.837228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:14.837228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:14.837228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:14.837228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:14.837228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.837228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:14.837228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.837228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.837228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:14.837228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.837228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:14.837228 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:14.837228 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:14.838108 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:14.838108 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:14.838108 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:14.838108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.838108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:14.838108 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.838108 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:14.838108 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.838108 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.838108 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:14.838108 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.838108 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:14.838655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.838655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:14.838655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:14.838655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:14.838655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.838655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:14.838655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:14.838655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:14.838655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.838655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:14.838655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:14.838655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:14.838655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:14.838655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:14.838655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:14.839196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:14.839196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:14.839196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.839196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:14.839196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.839196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.839196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:14.839196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.839196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:14.839550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.839550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:14.839550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:14.839550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:14.839550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.839550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:14.839550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:14.839550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:14.839550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:14.839550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.839550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:14.839999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:14.839999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:14.839999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.839999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:14.839999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:14.839999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:14.839999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:14.839999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:14.839999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:14.839999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:14.839999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:14.839999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.839999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:14.839999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.840528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.840528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:14.840528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.840528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:14.840528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.840528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:14.840528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:14.840528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:14.840528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:14.840528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:14.840528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.840528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:14.840528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:14.840528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:14.841083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:14.841879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:14.841879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:14.841879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:14.841879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:14.841879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.841879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:14.841879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.841879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.841879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:14.841879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.841879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:14.903602 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:14.904198 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:14.904391 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:14.904668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:14.905411 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:14.906018 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:14.906242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.907158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:14.907158 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.907158 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:14.907158 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.907158 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.907158 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:14.907158 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.907158 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:14.908683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.908683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:14.908683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:14.908683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:14.908683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.908683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:14.908683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:14.908683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.908683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:14.908683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:14.908683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:14.908683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.909309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:14.909309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:14.909309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:14.909309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:14.909309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:14.909309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:14.909309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:14.909309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:14.909309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.909309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:14.909309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.909309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.909309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:14.910197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.910197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:14.910197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.910197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:14.910197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:14.910197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:14.910197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:14.910197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:14.910197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.910197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:14.910197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:14.910197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.910197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:14.910197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:14.910197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:14.910840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:14.911357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:14.911357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:14.911357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:14.911357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:14.911357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:14.911357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:19.706886 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:19.707908 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:19.707908 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:19.708984 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:19.744412 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:19.744579 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.745320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:19.745320 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.745320 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:19.745320 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.745320 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.745320 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:19.745320 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.745320 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:19.746400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.746400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:19.746400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:19.746400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:19.746400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.746400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:19.746400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:19.746400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.746400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:19.746400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:19.746400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:19.746400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.746937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:19.746937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:19.746937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:19.746937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:19.746937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:19.746937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:19.746937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:19.746937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:19.746937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.746937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:19.746937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.746937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.746937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:19.749029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.749029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:19.749029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.749029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:19.749029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:19.749029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:19.749029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:19.749029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:19.749029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.749029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:19.749029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:19.749029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.749029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:19.749029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:19.749029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:19.750924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.751665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:19.751665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.751665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.751665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:19.751665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.751665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:19.790400 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:19.790920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:19.791040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:19.792194 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:19.792747 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:19.792747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.793422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:19.793422 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.793422 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:19.793422 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.793422 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.793422 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:19.793422 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.793422 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:19.794485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.794485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:19.794485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:19.794485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:19.794485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.794485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:19.794485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:19.794485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.794485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:19.794485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:19.794485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:19.794485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.795097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:19.795097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:19.795097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:19.795097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:19.795097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:19.795097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:19.795097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:19.795097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:19.795097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.795097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:19.795097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.795097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.795097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:19.795688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.795688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:19.795688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.795688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:19.795688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:19.795688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:19.795688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:19.795688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:19.795688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.795688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:19.795688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:19.795688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.795688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:19.795688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:19.795688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:19.796517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.797715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:19.797715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.797715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.797715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:19.797715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.797715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:19.828393 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:19.829095 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:19.829161 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:19.829356 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:46:19.830104 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:19.830577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.831655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:19.831655 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.831655 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:19.831655 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.831655 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.831655 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:19.831655 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.831655 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:19.832880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.832880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:19.832880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:19.832880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:19.832880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.832880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:19.832880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:19.832880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:19.832880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.832880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:19.832880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:19.832880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:19.832880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:19.832880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:19.832880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:19.834073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:19.834073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:19.834073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.834073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:19.834073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.834073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.834073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:19.834073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.834073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:19.834416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.834416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:19.834416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:19.834416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:19.834416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.834416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:19.834416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:19.834416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:46:19.834416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:19.834416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:19.834416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.834416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:19.834772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:19.834772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:19.834772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.834772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:19.834772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:19.834772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:19.834772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:19.834772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:19.834772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:19.834772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:19.834772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:19.834772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.834772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:19.834772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.835163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.835163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:19.835163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.835163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:19.835781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.835781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:19.835781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:19.835781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:19.835781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:19.835781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:19.835781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.835781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:19.835781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:19.835781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.835781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:19.835781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:19.835781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.835781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:19.835781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:19.835781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:19.836359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:19.836957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.836957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:19.836957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.836957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.836957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:19.836957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.836957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:19.836957 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:19.836957 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:19.836957 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:19.837562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:19.837562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:19.837562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.837766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:19.837766 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.837766 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:19.837766 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.837766 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.837766 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:19.837766 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.837766 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:19.838629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.838629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:19.838629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:19.838629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:19.838629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.838629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:19.838629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:19.838629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:19.838629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.838629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:19.838629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:19.838629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:19.838629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:19.838629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:19.838629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:19.839225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:19.839225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:19.839225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.839225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:19.839225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.839225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.839225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:19.839225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.839225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:19.839594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.839594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:19.839594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:19.839594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:19.839594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.839594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:19.839594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:19.839594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:19.839594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:19.839594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.839594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:19.839932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:19.839932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:19.839932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.839932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:19.839932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:19.839932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:19.839932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:19.839932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:19.839932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:19.839932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:19.839932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:19.839932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.839932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:19.839932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.840335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.840335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:19.840335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.840335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.840686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:19.841318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.841835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.841835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:19.841835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.841835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:19.904215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:19.904803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:19.904992 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:19.905330 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:19.905943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:19.906384 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:19.906618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.907529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:19.907529 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.907529 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:19.907529 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.907529 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.907529 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:19.907529 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.907529 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:19.908942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.908942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:19.908942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:19.908942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:19.908942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.908942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:19.908942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:19.908942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.908942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:19.908942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:19.908942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:19.908942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.909444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:19.909444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:19.909444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:19.909444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:19.909444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:19.909444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:19.909444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:19.909444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:19.909444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.909444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:19.909444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.909444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.909444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:19.909891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.909891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:19.910796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.910796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:19.910796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:19.910796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:19.910796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:19.910796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:19.910796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.910796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:19.910796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:19.910796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.910796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:19.910796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:19.910796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.910796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:19.910796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:19.910796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:19.911493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:19.912089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:19.912089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:19.912089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:24.707514 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:24.708547 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:24.708547 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:24.709713 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:24.741458 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:24.741682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.742317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:24.742317 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.742317 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:24.742317 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.742317 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.742317 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:24.742317 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.742317 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:24.743498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.743498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:24.743498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:24.743498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:24.743498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.743498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:24.743498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:24.743498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.743498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:24.743498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:24.743498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:24.743498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.744050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:24.744050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:24.744050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:24.744050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:24.744050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:24.744050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:24.744050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:24.744050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:24.744050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.744050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:24.744050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.744050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.744050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:24.744638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.744638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:24.744956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.744956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:24.744956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:24.744956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:24.744956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:24.744956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:24.744956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.744956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:24.744956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:24.744956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.744956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:24.744956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:24.744956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.744956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:24.744956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:24.744956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.745500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.746003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:24.746003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.746003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:24.791162 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:24.791721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:24.791980 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:24.793356 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:24.793768 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:24.794024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.795029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:24.795029 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.795029 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:24.795029 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.795029 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.795029 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:24.795029 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.795029 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:24.796677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.796677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:24.796677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:24.796677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:24.796677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.796677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:24.796677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:24.796677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.796677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:24.796677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:24.796677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:24.796677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.797639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:24.797639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:24.797639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:24.797639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:24.797639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:24.797639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:24.797639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:24.797639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:24.797639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.797639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:24.797639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.797639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.797639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:24.798538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.798538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:24.799025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.799025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:24.799025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:24.799025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:24.799025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:24.799025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:24.799025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.799025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:24.799025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:24.799025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.799025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:24.799025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:24.799025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.799025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:24.799025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:24.799025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.800626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:24.800626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.800626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:24.829172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:24.829693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:24.829937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:24.830198 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:46:24.830941 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:24.831250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.832138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:24.832138 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.832138 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:24.832138 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.832138 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.832138 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:24.832138 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.832138 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:24.833642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.833642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:24.833642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:24.833642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:24.833642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.833642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:24.833642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:24.833642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:24.833642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.833642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:24.833642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:24.833642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:24.833642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:24.833642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:24.833642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:24.834686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:24.834686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:24.834686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.834686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:24.834686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.834686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.834686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:24.834686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.834686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:24.835525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.835525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:24.835525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:24.835525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:24.835525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.835525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:24.835525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:24.835525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:46:24.835525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:24.835525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:24.835525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.835525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:24.836546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:24.836546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:24.836546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.836546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:24.836546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:24.836546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:24.836546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:24.836546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:24.836546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:24.836546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:24.836546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:24.836546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.836546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:24.836546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.837538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.837538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:24.837538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.837538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:24.838110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.838110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:24.838110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:24.838110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:24.838110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:24.838110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:24.838110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.838110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:24.838110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:24.838110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.838110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:24.838110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:24.838110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.838110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:24.838110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:24.838110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:24.838916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:24.839497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.839497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:24.839497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.839497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.839497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:24.839497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.839497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:24.839497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:24.839497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:24.839497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:24.839784 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:24.839784 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:24.839784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.840271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:24.840271 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.840271 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:24.840271 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.840271 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.840271 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:24.840271 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.840271 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:24.841175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.841175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:24.841175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:24.841175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:24.841175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.841175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:24.841175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:24.841175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:24.841175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.841175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:24.841175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:24.841175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:24.841175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:24.841175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:24.841175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:24.841850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:24.841850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:24.841850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.841850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:24.841850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.841850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.841850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:24.841850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.841850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:24.842424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.842424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:24.842424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:24.842424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:24.842424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.842424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:24.842424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:24.842424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:24.842424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:24.842424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.842424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:24.842983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:24.842983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:24.842983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.842983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:24.842983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:24.842983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:24.842983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:24.842983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:24.842983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:24.842983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:24.842983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:24.842983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.842983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:24.842983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.843577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.843577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:24.843577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.843577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.843971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:24.844621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.845168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.845168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:24.845168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.845168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:24.904850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:24.905534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:24.905773 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:24.906264 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:24.906997 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:24.907513 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:24.907741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.908666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:24.908666 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.908666 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:24.908666 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.908666 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.908666 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:24.908666 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.908666 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:24.910701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.910701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:24.910701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:24.910701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:24.910701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.910701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:24.910701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:24.910701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.910701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:24.910701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:24.910701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:24.910701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.911292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:24.911292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:24.911292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:24.911292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:24.911292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:24.911292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:24.911292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:24.911292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:24.911292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.911292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:24.911292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.911292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.911292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:24.911985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.911985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:24.912397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.912397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:24.912397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:24.912397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:24.912397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:24.912397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:24.912397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.912397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:24.912397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:24.912397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.912397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:24.912397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:24.912397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.912397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:24.912397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:24.912397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:24.913251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:24.914205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:24.914205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:24.914205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:29.708083 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:29.709014 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:29.709014 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:29.710089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:29.742405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:29.742711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.743312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:29.743312 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.743312 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:29.743312 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.743312 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.743312 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:29.743312 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.743312 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:29.744009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.744009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:29.744009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:29.744009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:29.744009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.744009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:29.744009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:29.744009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.744009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:29.744009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:29.744009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:29.744009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.744904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:29.744904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:29.744904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:29.744904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:29.744904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:29.744904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:29.744904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:29.744904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:29.744904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.744904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:29.744904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.744904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.744904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:29.745462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.745462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:29.745462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.745462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:29.745462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:29.745462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:29.745462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:29.745462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:29.745462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.745462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:29.745462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:29.745462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.745462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:29.745462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:29.745462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:29.746147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.747005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:29.747005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.747005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.747005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:29.747005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.747005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:29.791735 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:29.792217 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:29.792434 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:29.794528 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:29.794528 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:29.794528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.795293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:29.795293 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.795293 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:29.795293 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.795293 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.795293 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:29.795293 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.795293 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:29.796863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.796863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:29.796863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:29.796863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:29.796863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.796863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:29.796863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:29.796863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.796863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:29.796863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:29.796863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:29.796863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.797517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:29.797517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:29.797517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:29.797517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:29.797517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:29.797517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:29.797517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:29.797517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:29.797517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.797517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:29.797517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.797517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.797517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:29.798024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.798024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:29.798995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.798995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:29.798995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:29.798995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:29.798995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:29.798995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:29.798995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.798995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:29.798995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:29.798995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.798995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:29.798995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:29.798995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.798995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:29.798995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:29.798995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.799772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.800519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:29.800519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.800519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:29.829860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:29.830329 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:29.830614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:29.830853 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:46:29.831600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:29.831931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.832820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:29.832820 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.832820 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:29.832820 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.832820 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.832820 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:29.832820 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.832820 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:29.834060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.834060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:29.834060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:29.834060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:29.834060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.834060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:29.834060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:29.834060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:29.834060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.834060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:29.834060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:29.834060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:29.834060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:29.834060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:29.834060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:29.834891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:29.834891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:29.834891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.834891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:29.834891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.834891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.834891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:29.834891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.834891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:29.835748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.835748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:29.835748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:29.835748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:29.835748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.835748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:29.835748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:29.835748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:46:29.835748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:29.835748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:29.835748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.835748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:29.836341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:29.836341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:29.836341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.836341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:29.836341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:29.836341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:29.836341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:29.836341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:29.836341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:29.836341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:29.836341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:29.836341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.836341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:29.836341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.837012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.837012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:29.837012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.837012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:29.837834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.837834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:29.837834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:29.837834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:29.837834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:29.837834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:29.837834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.837834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:29.837834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:29.837834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.837834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:29.837834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:29.837834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.837834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:29.837834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:29.837834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:29.838715 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:29.839595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.839595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:29.839595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.839595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.839595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:29.839595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.839595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:29.839595 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:29.839595 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:29.839595 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:29.839912 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:29.839912 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:29.840456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.841191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:29.841191 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.841191 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:29.841191 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.841191 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.841191 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:29.841191 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.841191 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:29.841985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.841985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:29.841985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:29.841985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:29.841985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.841985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:29.841985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:29.841985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:29.841985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.841985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:29.841985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:29.841985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:29.841985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:29.841985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:29.841985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:29.842501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:29.842501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:29.842501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.842501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:29.842501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.842501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.842501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:29.842501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.842501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:29.843129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.843129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:29.843129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:29.843129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:29.843129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.843129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:29.843129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:29.843129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:29.843129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:29.843129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.843129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:29.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:29.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:29.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:29.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:29.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:29.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:29.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:29.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:29.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:29.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:29.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:29.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.843933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.843933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:29.843933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.843933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.844518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:29.845002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.845521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.845521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:29.845521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.845521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:29.905659 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:29.906164 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:29.906422 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:29.906764 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:29.907473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:29.907841 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:29.908068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.908920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:29.908920 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.908920 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:29.908920 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.908920 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.908920 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:29.908920 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.908920 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:29.910313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.910313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:29.910313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:29.910313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:29.910313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.910313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:29.910313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:29.910313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.910313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:29.910313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:29.910313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:29.910313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.910717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:29.910717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:29.910717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:29.910717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:29.910717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:29.910717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:29.910717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:29.910717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:29.910717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.910717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:29.910717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.910717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.910717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:29.911041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.911041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:29.911932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.911932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:29.911932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:29.911932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:29.911932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:29.911932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:29.911932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.911932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:29.911932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:29.911932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.911932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:29.911932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:29.911932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.911932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:29.911932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:29.911932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:29.912620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:29.913345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:29.913345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:29.913345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:34.708751 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:34.709301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:34.709301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:34.709639 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:34.737037 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:34.737333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.737999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:34.737999 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.737999 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:34.737999 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.737999 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.737999 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:34.737999 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.737999 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:34.738781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.029 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.738781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:34.738781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:34.738781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:34.738781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.738781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:34.738781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:34.738781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.738781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:34.738781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:34.738781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:34.738781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.739085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:34.739085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:34.739085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:34.739085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:34.739085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:34.739085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:34.739085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:34.739085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:34.739085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.739085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:34.739085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.739085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.739085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:34.739414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.739414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:34.739546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.739546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:34.739546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:34.739546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:34.739546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:34.739546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:34.739546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.739546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:34.739546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:34.739546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.739546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:34.739546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:34.739546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.739546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:34.739546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:34.739546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.739912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.740404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:34.740404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.740404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:34.792277 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:34.792486 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:34.792587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:34.793497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:34.793830 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:34.794065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.794869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:34.794869 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.794869 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:34.794869 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.794869 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.794869 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:34.794869 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.794869 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:34.795632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.795632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:34.795632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:34.795632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:34.795632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.795632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:34.795632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:34.795632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.795632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:34.795632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:34.795632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:34.795632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:34.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:34.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:34.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:34.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:34.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:34.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:34.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:34.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:34.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.795902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:34.796148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.796148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:34.796402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.796402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:34.796402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:34.796402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:34.796402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:34.796402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:34.796402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.796402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:34.796402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:34.796402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.796402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:34.796402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:34.796402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.796402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:34.796402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:34.796402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.796724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.797077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:34.797077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.797077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:34.830341 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:34.830579 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:34.830668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:34.830763 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:46:34.831517 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:34.831823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.832626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:34.832626 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.832626 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:34.832626 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.832626 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.832626 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:34.832626 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.832626 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:34.833252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.833252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:34.833252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:34.833252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:34.833252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.833252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:34.833252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:34.833252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:34.833252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.833252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:34.833252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:34.833252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:34.833252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:34.833252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:34.833252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:34.833683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:34.833683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:34.833683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.833683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:34.833683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.833683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.833683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:34.833683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.833683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:34.833900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.833900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:34.833900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:34.833900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:34.833900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.833900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:34.833900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:34.833900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:46:34.833900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:34.833900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:34.833900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.833900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:34.834160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:34.834160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:34.834160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.834160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:34.834160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:34.834160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:34.834160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:34.834160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:34.834160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:34.834160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:34.834160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:34.834160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.834160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:34.834160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.834462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.834462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:34.834462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.834462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:34.834605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.834605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:34.834605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:34.834605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:34.834605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:34.834605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:34.834605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.834605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:34.834605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:34.834605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.834605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:34.834605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:34.834605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.834605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:34.834605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:34.834605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:34.834924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:34.835295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.835295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:34.835295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.835295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.835295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:34.835295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.835295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:34.839107 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:34.839297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:34.839356 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:34.839489 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:34.839932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:34.840301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.841002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:34.841002 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.841002 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:34.841002 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.841002 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.841002 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:34.841002 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.841002 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:34.841828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.841828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:34.841828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:34.841828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:34.841828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.841828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:34.841828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:34.841828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:34.841828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.841828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:34.841828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:34.841828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:34.841828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:34.841828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:34.841828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:34.842137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:34.842137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:34.842137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.842137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:34.842137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.842137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.842137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:34.842137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.842137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:34.842781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.842781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:34.842781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:34.842781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:34.842781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.842781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:34.842781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:34.842781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:34.842781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:34.842781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.842781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:34.843081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:34.843081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:34.843081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.843081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:34.843081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:34.843081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:34.843081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:34.843081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:34.843081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:34.843081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:34.843081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:34.843081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.843081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:34.843081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.843355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.843355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:34.843355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.843355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.844017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:34.844417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.844751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.844751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:34.844751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.844751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:34.906213 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:34.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:34.906565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:34.906721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:34.907405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:34.907830 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:34.908051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.912636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:34.912636 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.912636 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:34.912636 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.912636 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.912636 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:34.912636 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.912636 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:34.913389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.006 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.913389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:34.913389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:34.913389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:34.913389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.913389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:34.913389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:34.913389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.913389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:34.913389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:34.913389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:34.913389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.913679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:34.913679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:34.913679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:34.913679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:34.913679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:34.913679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:34.913679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:34.913679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:34.913679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.913679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:34.913679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.913679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.913679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:34.913938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.913938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:34.915398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.915398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:34.915398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:34.915398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:34.915398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:34.915398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:34.915398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.915398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:34.915398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:34.915398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.915398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:34.915398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:34.915398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.915398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:34.915398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:34.915398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:34.915754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:34.916114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:34.916114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:34.916114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:39.709511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:39.710179 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:39.710398 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:39.711737 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:39.751648 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:39.753483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.753483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:39.753483 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.753483 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:39.753483 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.753483 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.753483 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:39.753483 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.753483 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:39.753899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.753899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:39.753899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:39.753899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:39.753899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.753899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:39.753899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:39.753899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.753899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:39.753899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:39.753899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:39.753899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.754194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:39.754194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:39.754194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:39.754194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:39.754194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:39.754194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:39.754194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:39.754194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:39.754194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.754194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:39.754194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.754194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.754194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:39.754550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.754550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:39.754680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.754680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:39.754680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:39.754680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:39.754680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:39.754680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:39.754680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.754680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:39.754680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:39.754680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.754680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:39.754680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:39.754680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.754680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:39.754680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:39.754680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.755044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.755450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:39.755450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.755450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:39.792986 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:39.793736 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:39.793736 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:39.794804 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:39.795063 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:39.795211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.795877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:39.795877 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.795877 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:39.795877 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.795877 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.795877 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:39.795877 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.795877 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:39.797507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.797507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:39.797507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:39.797507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:39.797507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.797507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:39.797507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:39.797507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.797507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:39.797507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:39.797507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:39.797507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.797952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:39.797952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:39.797952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:39.797952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:39.797952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:39.797952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:39.797952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:39.797952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:39.797952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.797952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:39.797952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.797952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.797952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:39.798335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.798335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:39.799319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.799319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:39.799319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:39.799319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:39.799319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:39.799319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:39.799319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.799319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:39.799319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:39.799319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.799319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:39.799319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:39.799319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.799319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:39.799319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:39.799319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.799971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.800543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:39.800543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.800543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:39.830817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:39.831555 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:39.831857 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:39.832161 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:46:39.832815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:39.833053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.833703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:39.833703 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.833703 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:39.833703 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.833703 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.833703 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:39.833703 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.833703 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:39.834747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.834747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:39.834747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:39.834747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:39.834747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.834747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:39.834747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:39.834747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:39.834747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.834747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:39.834747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:39.834747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:39.834747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:39.834747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:39.834747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:39.835268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:39.835268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:39.835268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.835268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:39.835268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.835268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.835268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:39.835268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.835268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:39.836323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.836323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:39.836323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:39.836323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:39.836323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.836323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:39.836323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:39.836323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:46:39.836323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:39.836323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:39.836323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.836323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:39.836766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:39.836766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:39.836766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.836766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:39.836766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:39.836766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:39.836766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:39.836766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:39.836766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:39.836766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:39.836766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:39.836766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.836766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:39.836766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.837143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.837143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:39.837143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.837143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:39.837553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.837553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:39.837553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:39.837553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:39.837553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:39.837553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:39.837553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.837553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:39.837553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:39.837553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.837553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:39.837553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:39.837553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.837553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:39.837553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:39.837553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:39.838081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:39.838768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.838768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:39.838768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.838768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.838768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:39.838768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.838768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:39.839532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:39.839854 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:39.840017 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:39.840208 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:39.843386 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:39.843386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.843386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:39.843386 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.843386 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:39.843386 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.843386 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.843386 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:39.843386 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.843386 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:39.843386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.843386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:39.843386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:39.843386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.843703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:39.844027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.844027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:39.844027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.844027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:39.844027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:39.844027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:39.844027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.844027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:39.844027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:39.844027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:39.844027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:39.844027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.844259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:39.844259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:39.844259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:39.844259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.844259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:39.844259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:39.844259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:39.844259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:39.844259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:39.844259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:39.844259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:39.844259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:39.844259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.844259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:39.844533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.844533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.844533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:39.844533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.844533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.845480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:39.845863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.846194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.846194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:39.846194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.846194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:39.906708 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:39.907299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:39.907562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:39.907854 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:39.908606 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:39.909020 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:39.909170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.911810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:39.911810 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.911810 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:39.911810 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.911810 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.911810 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:39.911810 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.911810 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:39.913256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.913256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:39.913256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:39.913256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:39.913256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.913256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:39.913256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:39.913256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.913256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:39.913256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:39.913256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:39.913256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.913546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:39.913546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:39.913546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:39.913546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:39.913546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:39.913546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:39.913546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:39.913546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:39.913546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.913546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:39.913546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.913546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.913546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:39.913822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.913822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:39.916085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.916085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:39.916085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:39.916085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:39.916085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:39.916085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:39.916085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.916085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:39.916085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:39.916085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.916085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:39.916085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:39.916085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.916085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:39.916085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:39.916085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:39.916623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:39.917171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:39.917171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:39.917171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:44.710825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:44.711411 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:44.711411 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:44.711999 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:44.750115 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:44.750354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.750902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:44.750902 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.750902 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:44.750902 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.750902 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.750902 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:44.750902 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.750902 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:44.752150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.752150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:44.752150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:44.752150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:44.752150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.752150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:44.752150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:44.752150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.752150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:44.752150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:44.752150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:44.752150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.752621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:44.752621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:44.752621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:44.752621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:44.752621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:44.752621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:44.752621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:44.752621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:44.752621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.752621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:44.752621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.752621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.752621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:44.753037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.753037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:44.753289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.753289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:44.753289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:44.753289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:44.753289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:44.753289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:44.753289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.753289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:44.753289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:44.753289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.753289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:44.753289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:44.753289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.753289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:44.753289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:44.753289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.754094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.754706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:44.754706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.754706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:44.793619 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:44.794015 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:44.794136 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:44.795011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:44.795257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:44.795492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:44.796155 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.796155 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:44.796155 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.796155 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.796155 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:44.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.796155 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:44.797207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.797207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:44.797207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:44.797207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:44.797207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.797207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:44.797207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:44.797207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.797207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:44.797207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:44.797207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:44.797207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.797654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:44.797654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:44.797654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:44.797654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:44.797654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:44.797654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:44.797654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:44.797654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:44.797654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.797654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:44.797654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.797654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.797654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:44.797969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.797969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:44.798523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.798523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:44.798523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:44.798523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:44.798523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:44.798523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:44.798523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.798523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:44.798523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:44.798523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.798523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:44.798523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:44.798523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.798523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:44.798523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:44.798523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.798970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.799422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:44.799422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.799422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:44.831694 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:44.832064 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:44.832269 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:44.832495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:46:44.833101 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:44.833380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.834052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:44.834052 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.834052 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:44.834052 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.834052 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.834052 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:44.834052 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.834052 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:44.835378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.835378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:44.835378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:44.835378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:44.835378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.835378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:44.835378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:44.835378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:44.835378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.835378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:44.835378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:44.835378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:44.835378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:44.835378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:44.835378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:44.835910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:44.835910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:44.835910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.835910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:44.835910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.835910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.835910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:44.835910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.835910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:44.836859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.836859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:44.836859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:44.836859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:44.836859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.836859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:44.836859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:44.836859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:46:44.836859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:44.836859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:44.836859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.836859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:44.837444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:44.837444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:44.837444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.837444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:44.837444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:44.837444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:44.837444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:44.837444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:44.837444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:44.837444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:44.837444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:44.837444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.837444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:44.837444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.838019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.838019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:44.838019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.838019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:44.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:44.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:44.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:44.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:44.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:44.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:44.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:44.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:44.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:44.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:44.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:44.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:44.839512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:44.840398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.840398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:44.840398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.840398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.840398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:44.840398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.840398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:44.841228 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:44.841536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:44.841707 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:44.841938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:44.842453 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:44.842847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.844118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:44.844118 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.844118 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:44.844118 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.844118 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.844118 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:44.844118 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.844118 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:44.845053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.845053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:44.845053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:44.845053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:44.845053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.845053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:44.845053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:44.845053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:44.845053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.845053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:44.845053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:44.845053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:44.845053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:44.845053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:44.845053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:44.846472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:44.846472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:44.846472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.846472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:44.846472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.846472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.846472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:44.846472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.846472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:44.846472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.846472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:44.846472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:44.846472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:44.846472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.847870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:44.847870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:44.847870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:44.847870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:44.847870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.847870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:44.847870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:44.847870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:44.847870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.847870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:44.847870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:44.847870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:44.847870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:44.848254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:44.848254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:44.848254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:44.848254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:44.848254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.848254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:44.848254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.848254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.848254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:44.848254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.848254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:44.848254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:44.848615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.849089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:44.907305 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:44.907842 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:44.908021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:44.908316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:44.908914 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:44.909159 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:44.909312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.910155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:44.910155 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.910155 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:44.910155 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.910155 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.910155 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:44.910155 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.910155 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:44.911668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.911668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:44.911668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:44.911668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:44.911668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.911668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:44.911668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:44.911668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.911668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:44.911668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:44.911668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:44.911668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.912096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:44.912096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:44.912096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:44.912096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:44.912096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:44.912096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:44.912096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:44.912096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:44.912096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.912096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:44.912096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.912096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.912096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:44.912531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.912531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:44.913329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.913329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:44.913329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:44.913329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:44.913329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:44.913329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:44.913329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.913329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:44.913329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:44.913329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.913329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:44.913329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:44.913329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.913329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:44.913329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:44.913329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:44.914234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:44.915043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:44.915043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:44.915043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:49.711392 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:49.712320 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:49.712320 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:49.713510 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:49.747286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:49.747584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.748140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:49.748140 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.748140 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:49.748140 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.748140 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.748140 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:49.748140 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.748140 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:49.749159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.749159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:49.749159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:49.749159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:49.749159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.749159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:49.749159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:49.749159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.749159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:49.749159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:49.749159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:49.749159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.749669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:49.749669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:49.749669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:49.749669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:49.749669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:49.749669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:49.749669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:49.749669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:49.749669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.749669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:49.749669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.749669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.749669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:49.750448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.750448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:49.750448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.750448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:49.750448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:49.750448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:49.750448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:49.750448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:49.750448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.750448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:49.750448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:49.750448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.750448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:49.750448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:49.750448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:49.751761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.752630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:49.752630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.752630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.752630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:49.752630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.752630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:49.794203 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:49.794715 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:49.794915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:49.795743 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:49.795989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:49.796235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.797034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:49.797034 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.797034 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:49.797034 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.797034 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.797034 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:49.797034 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.797034 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:49.798498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.798498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:49.798498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:49.798498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:49.798498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.798498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:49.798498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:49.798498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.798498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:49.798498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:49.798498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:49.798498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.799143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:49.799143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:49.799143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:49.799143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:49.799143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:49.799143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:49.799143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:49.799143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:49.799143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.799143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:49.799143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.799143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.799143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:49.799769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.799769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:49.800116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.800116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:49.800116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:49.800116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:49.800116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:49.800116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:49.800116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.800116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:49.800116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:49.800116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.800116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:49.800116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:49.800116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.800116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:49.800116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:49.800116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.800923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.801967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:49.801967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.801967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:49.832197 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:49.832759 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:49.832942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:49.833157 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:46:49.833854 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:49.834145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.835000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:49.835000 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.835000 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:49.835000 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.835000 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.835000 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:49.835000 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.835000 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:49.836285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.836285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:49.836285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:49.836285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:49.836285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.836285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:49.836285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:49.836285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:49.836285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.836285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:49.836285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:49.836285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:49.836285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:49.836285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:49.836285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:49.837157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:49.837157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:49.837157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.837157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:49.837157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.837157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.837157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:49.837157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.837157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:49.837766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.837766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:49.837766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:49.837766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:49.837766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.837766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:49.837766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:49.837766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:46:49.837766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:49.837766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:49.837766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.837766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:49.838263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:49.838263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:49.838263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.838263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:49.838263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:49.838263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:49.838263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:49.838263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:49.838263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:49.838263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:49.838263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:49.838263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.838263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:49.838263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.838652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.838652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:49.838652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.838652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:49.839500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.839500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:49.839500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:49.839500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:49.839500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:49.839500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:49.839500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.839500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:49.839500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:49.839500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.839500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:49.839500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:49.839500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.839500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:49.839500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:49.839500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:49.839953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:49.840448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.840448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:49.840448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.840448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.840448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:49.840448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.840448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:49.841534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:49.842072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:49.842275 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:49.842521 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:49.843030 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:49.843461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.844251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:49.844251 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.844251 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:49.844251 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.844251 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.844251 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:49.844251 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.844251 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:49.845789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.845789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:49.845789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:49.845789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:49.845789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.845789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:49.845789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:49.845789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:49.845789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.845789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:49.845789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:49.845789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:49.845789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:49.845789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:49.845789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:49.846185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:49.846185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:49.846185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.846185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:49.846185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.846185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.846185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:49.846185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.846185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:49.846895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.846895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:49.846895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:49.846895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:49.846895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.846895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:49.846895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:49.846895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:49.846895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:49.846895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.846895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:49.847219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:49.847219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:49.847219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.847219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:49.847219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:49.847219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:49.847219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:49.847219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:49.847219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:49.847219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:49.847219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:49.847219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.847219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:49.847219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.847607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.847607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:49.847607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.847607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.848195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:49.848754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.849253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.849253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:49.849253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.849253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:49.909304 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:49.910105 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:49.910645 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:49.910645 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:49.911093 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:49.911642 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:49.911747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.912980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:49.912980 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.912980 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:49.912980 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.912980 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.912980 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:49.912980 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.912980 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:49.914345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.914345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:49.914345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:49.914345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:49.914345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.914345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:49.914345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:49.914345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.914345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:49.914345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:49.914345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:49.914345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.915215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:49.915215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:49.915215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:49.915215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:49.915215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:49.915215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:49.915215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:49.915215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:49.915215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.915215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:49.915215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.915215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.915215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:49.915961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.915961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:49.915961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.915961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:49.915961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:49.915961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:49.915961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:49.915961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:49.915961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.915961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:49.915961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:49.915961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.915961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:49.915961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:49.915961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:49.916710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:49.917653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:49.917653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:49.917653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:49.917653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:49.917653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:49.917653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:54.712539 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:54.713075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:54.713075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:54.714244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:54.717815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:46:54.759148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:54.759342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.760049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:54.760049 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.760049 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:54.760049 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.760049 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.760049 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:54.760049 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.760049 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:54.760891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.047 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.760891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:54.760891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:54.760891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:54.760891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.760891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:54.760891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:54.760891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.760891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:54.760891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:54.760891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:54.760891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.761484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:54.761484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:54.761484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:54.761484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:54.761484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:54.761484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:54.761484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:54.761484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:54.761484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.761484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:54.761484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.761484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.761484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:54.762042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.762042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:54.762042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.762042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:54.762042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:54.762042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:54.762042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:54.762042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:54.762042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.762042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:54.762042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:54.762042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.762042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:54.762042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:54.762042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:54.762785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.763522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:54.763522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.763522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.763522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:54.763522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.763522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:54.794807 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:54.795397 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:54.795667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:54.796638 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:54.796912 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:54.797139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.797961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:54.797961 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.797961 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:54.797961 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.797961 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.797961 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:54.797961 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.797961 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:54.799525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.799525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:54.799525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:54.799525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:54.799525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.799525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:54.799525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:54.799525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.799525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:54.799525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:54.799525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:54.799525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.800089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:54.800089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:54.800089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:54.800089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:54.800089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:54.800089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:54.800089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:54.800089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:54.800089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.800089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:54.800089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.800089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.800089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:54.800753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.800753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:54.800753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.800753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:54.800753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:54.800753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:54.800753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:54.800753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:54.800753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.800753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:54.800753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:54.800753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.800753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:54.800753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:54.800753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:54.801447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.802237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:54.802237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.802237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.802237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:54.802237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.802237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:54.832752 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:54.833399 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:54.833615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:54.833819 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:46:54.834562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:54.834946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.835931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:54.835931 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.835931 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:54.835931 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.835931 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.835931 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:54.835931 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.835931 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:54.837358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.837358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:54.837358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:54.837358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:54.837358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.837358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:54.837358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:54.837358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:54.837358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.837358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:54.837358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:54.837358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:54.837358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:54.837358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:54.837358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:54.837778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:54.837778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:54.837778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.837778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:54.837778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.837778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.837778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:54.837778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.837778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:54.838945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.838945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:54.838945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:54.838945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:54.838945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.838945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:54.838945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:54.838945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:46:54.838945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:54.838945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:54.838945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.838945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:54.839293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:54.839293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:54.839293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.839293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:54.839293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:54.839293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:54.839293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:54.839293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:54.839293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:54.839293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:54.839293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:54.839293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.839293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:54.839293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.839697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.839697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:54.839697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.839697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:54.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:54.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:54.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:54.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:54.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:54.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:54.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:54.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:54.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:54.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:54.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:54.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:54.841566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:54.842197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.842197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:54.842197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.842197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.842197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:54.842197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.842197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:54.842197 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:54.842197 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:54.842537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:54.842537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:54.842880 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:54.843119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.843600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:54.843600 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.843600 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:54.843600 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.843600 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.843600 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:54.843600 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.843600 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:54.844292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.844292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:54.844292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:54.844292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:54.844292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.844292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:54.844292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:54.844292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:54.844292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.844292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:54.844292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:54.844292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:54.844292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:54.844292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:54.844292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:54.844813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:54.844813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:54.844813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.844813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:54.844813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.844813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.844813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:54.844813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.844813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:54.845164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.845164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:54.845164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:54.845164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:54.845164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.845164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:54.845164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:54.845164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:54.845164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:54.845164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.845164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:54.845534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:54.845534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:54.845534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.845534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:54.845534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:54.845534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:54.845534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:54.845534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:54.845534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:54.845534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:54.845534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:54.845534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.845534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:54.845534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.845896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.845896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:54.845896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.845896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.846219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:54.846670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.847184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.847184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:54.847184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.847184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:54.910207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:54.911083 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:54.911229 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:54.911536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:54.912185 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:54.912712 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:54.913035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.913824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:54.913824 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.913824 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:54.913824 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.913824 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.913824 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:54.913824 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.913824 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:54.915163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.915163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:54.915163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:54.915163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:54.915163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.915163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:54.915163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:54.915163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.915163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:54.915163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:54.915163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:54.915163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.915764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:54.915764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:54.915764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:54.915764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:54.915764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:54.915764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:54.915764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:54.915764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:54.915764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.915764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:54.915764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.915764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.915764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:54.916319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.916319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:54.917160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.917160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:54.917160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:54.917160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:54.917160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:54.917160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:54.917160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.917160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:54.917160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:54.917160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.917160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:54.917160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:54.917160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.917160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:54.917160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:54.917160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:54.917846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:54.920812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:54.920812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:54.920812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:59.714788 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:59.715546 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:59.715546 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:59.716730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:59.760447 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:59.760655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.761067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:59.761067 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.761067 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:59.761067 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.761067 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.761067 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:59.761067 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.761067 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:59.761907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.045 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.761907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:59.761907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:59.761907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:59.761907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.761907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:59.761907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:59.761907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.761907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:59.761907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:59.761907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:59.761907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.762707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:59.762707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:59.762707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:59.762707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:59.762707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:59.762707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:59.762707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:59.762707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:59.762707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.762707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:59.762707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.762707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.762707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:59.763413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.763413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:59.763413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.763413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:59.763413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:59.763413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:59.763413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:59.763413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:59.763413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.763413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:59.763413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:59.763413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.763413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:59.763413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:59.763413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:59.764171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.765169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:59.765169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.765169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.765169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:59.765169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.765169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:59.795358 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:59.795721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:59.795905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:59.796825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:59.797129 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:59.797477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.798234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:59.798234 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.798234 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:59.798234 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.798234 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.798234 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:59.798234 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.798234 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:59.799396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.799396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:59.799396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:59.799396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:59.799396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.799396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:59.799396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:59.799396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.799396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:59.799396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:59.799396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:59.799396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.799967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:59.799967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:59.799967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:59.799967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:59.799967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:59.799967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:59.799967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:59.799967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:59.799967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.799967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:59.799967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.799967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.799967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:59.800545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.800545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:59.801861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.801861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:59.801861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:59.801861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:59.801861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:59.801861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:59.801861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.801861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:59.801861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:59.801861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.801861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:59.801861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:59.801861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.801861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:59.801861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:59.801861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.802551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.803702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:59.803702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.803702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:59.833226 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:59.833540 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:59.833676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:59.833812 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:46:59.834456 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:59.834755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.835430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:59.835430 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.835430 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:59.835430 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.835430 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.835430 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:59.835430 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.835430 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:59.836384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.836384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:59.836384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:59.836384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:59.836384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.836384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:59.836384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:59.836384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:59.836384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.836384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:59.836384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:59.836384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:59.836384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:59.836384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:59.836384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:59.836849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:59.836849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:59.836849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.836849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:59.836849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.836849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.836849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:59.836849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.836849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:59.837641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.837641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:59.837641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:59.837641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:59.837641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.837641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:59.837641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:59.837641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:46:59.837641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:59.837641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:59.837641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.837641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:59.838444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:59.838444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:59.838444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.838444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:59.838444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:59.838444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:59.838444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:59.838444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:59.838444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:59.838444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:59.838444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:59.838444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.838444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:59.838444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.839146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.839146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:59.839146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.839146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:59.839146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.839146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:59.839146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:59.839146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:59.839146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:59.839146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:59.839146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.839146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:59.839146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:59.839146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:59.839976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:59.841097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:59.841097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:59.841097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:59.841097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:59.841097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:59.841097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.841097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:59.841097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.841097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.841097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:59.841097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.841097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:59.842244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:59.842511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:59.842603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:59.842772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:59.843625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:59.843964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.844717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:59.844717 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.844717 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:59.844717 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.844717 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.844717 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:59.844717 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.844717 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:59.845395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.845395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:46:59.845395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:59.845395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:59.845395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.845395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:59.845395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:59.845395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:59.845395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.845395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:46:59.845395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:59.845395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:46:59.845395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:59.845395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:46:59.845395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:46:59.845889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:59.845889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:46:59.845889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.845889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:46:59.845889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.845889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.845889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:46:59.845889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.845889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:46:59.846542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.846542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:59.846542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:59.846542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:59.846542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.846542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:59.846542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:59.846542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:59.846542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:59.846542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.846542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:59.846912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:59.846912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:59.846912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.846912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:59.846912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:59.846912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:59.846912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:59.846912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:59.846912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:59.846912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:59.846912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:59.846912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.846912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:59.846912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.847309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.847309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:59.847309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.847309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.847678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:59.848158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.848695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.848695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:59.848695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.848695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:46:59.910960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:46:59.911284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:46:59.911430 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:46:59.911628 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:46:59.912281 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:59.912768 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:46:59.913049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.913931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:46:59.913931 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.913931 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:46:59.913931 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.913931 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.913931 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:46:59.913931 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.913931 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:46:59.914967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.914967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:46:59.914967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:59.914967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:46:59.914967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.914967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:59.914967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:59.914967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.914967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:59.914967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:59.914967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:59.914967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.915611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:46:59.915611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:59.915611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:46:59.915611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:59.915611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:46:59.915611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:46:59.915611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:59.915611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:46:59.915611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.915611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:46:59.915611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.915611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.915611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:46:59.916424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.916424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:46:59.916424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.916424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:46:59.916424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:46:59.916424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:46:59.916424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:46:59.916424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:46:59.916424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.916424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:46:59.916424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:46:59.916424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.916424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:46:59.916424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:46:59.916424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:46:59.917133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:46:59.918195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:46:59.918195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:46:59.918195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:46:59.918195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:46:59.918195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:46:59.918195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:04.715452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:04.747684 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:04.747684 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:04.749744 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:04.783058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:04.783315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.784319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:04.784319 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.784319 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:04.784319 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.784319 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.784319 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:04.784319 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.784319 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:04.785941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.785941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:04.785941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:04.785941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:04.785941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.785941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:04.785941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:04.785941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.785941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:04.785941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:04.785941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:04.785941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.786991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:04.786991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:04.786991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:04.786991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:04.786991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:04.786991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:04.786991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:04.786991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:04.786991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.786991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:04.786991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.786991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.786991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:04.787597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.787597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:04.787597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.787597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:04.787597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:04.787597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:04.787597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:04.787597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:04.787597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.787597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:04.787597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:04.787597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.787597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:04.787597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:04.787597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:04.788015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.788516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:04.788516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.788516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.788516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:04.788516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.788516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:04.796042 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:04.796519 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:04.796664 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:04.797530 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:04.797886 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:04.798237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.799048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:04.799048 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.799048 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:04.799048 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.799048 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.799048 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:04.799048 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.799048 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:04.800159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.800159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:04.800159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:04.800159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:04.800159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.800159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:04.800159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:04.800159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.800159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:04.800159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:04.800159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:04.800159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.800684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:04.800684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:04.800684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:04.800684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:04.800684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:04.800684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:04.800684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:04.800684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:04.800684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.800684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:04.800684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.800684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.800684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:04.801764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.801764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:04.801764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.801764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:04.801764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:04.801764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:04.801764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:04.801764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:04.801764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.801764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:04.801764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:04.801764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.801764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:04.801764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:04.801764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:04.802215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.802698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:04.802698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.802698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.802698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:04.802698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.802698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:04.833809 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:04.834274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:04.834554 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:04.834809 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:47:04.835352 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:04.835694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.836524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:04.836524 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.836524 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:04.836524 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.836524 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.836524 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:04.836524 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.836524 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:04.837802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.837802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:04.837802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:04.837802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:04.837802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.837802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:04.837802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:04.837802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:04.837802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.837802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:04.837802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:04.837802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:04.837802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:04.837802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:04.837802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:04.838192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:04.838192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:04.838192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.838192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:04.838192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.838192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.838192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:04.838192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.838192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:04.839137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.839137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:04.839137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:04.839137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:04.839137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.839137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:04.839137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:04.839137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:47:04.839137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:04.839137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:04.839137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.839137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:04.839467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:04.839467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:04.839467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.839467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:04.839467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:04.839467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:04.839467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:04.839467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:04.839467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:04.839467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:04.839467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:04.839467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.839467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:04.839467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.839833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.839833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:04.839833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.839833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:04.840896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.840896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:04.840896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:04.840896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:04.840896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:04.840896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:04.840896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.840896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:04.840896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:04.840896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.840896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:04.840896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:04.840896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.840896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:04.840896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:04.840896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:04.841341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:04.841807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.841807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:04.841807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.841807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.841807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:04.841807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.841807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:04.842714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:04.843033 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:04.843148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:04.843263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:04.843748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:04.844115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.844844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:04.844844 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.844844 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:04.844844 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.844844 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.844844 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:04.844844 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.844844 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:04.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:04.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:04.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:04.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:04.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:04.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:04.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:04.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:04.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:04.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:04.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:04.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:04.846032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:04.846032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:04.846032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.846032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:04.846032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.846032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.846032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:04.846032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.846032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:04.846745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.846745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:04.846745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:04.846745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:04.846745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.846745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:04.846745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:04.846745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:04.846745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:04.846745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.846745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:04.847091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:04.847091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:04.847091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.847091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:04.847091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:04.847091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:04.847091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:04.847091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:04.847091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:04.847091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:04.847091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:04.847091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.847091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:04.847091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.847496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.847496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:04.847496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.847496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.847794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:04.848228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.848742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.848742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:04.848742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.848742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:04.911462 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:04.912029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:04.912268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:04.912610 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:04.913483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:04.913997 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:04.914288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.915259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:04.915259 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.915259 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:04.915259 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.915259 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.915259 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:04.915259 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.915259 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:04.916298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.916298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:04.916298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:04.916298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:04.916298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.916298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:04.916298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:04.916298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.916298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:04.916298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:04.916298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:04.916298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.917074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:04.917074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:04.917074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:04.917074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:04.917074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:04.917074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:04.917074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:04.917074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:04.917074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.917074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:04.917074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.917074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.917074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:04.917656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.917656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:04.917656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.917656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:04.917656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:04.917656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:04.917656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:04.917656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:04.917656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.917656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:04.917656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:04.917656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.917656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:04.917656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:04.917656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:04.918258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:04.919102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:04.919102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:04.919102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:04.919102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:04.919102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:04.919102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:09.747348 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:09.749741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:09.749741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:09.752182 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:09.807480 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:09.828962 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:09.829230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.831880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:09.831880 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.831880 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:09.831880 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.831880 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.831880 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:09.831880 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.831880 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:09.831880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.081 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.831880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:09.831880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:09.831880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:09.831880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.831880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:09.831880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:09.832272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.832272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:09.832272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:09.832272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:09.832272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.832272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:09.832272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:09.832272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:09.832272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:09.832272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:09.832272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:09.832272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:09.832272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:09.832272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.832597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:09.832597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.832597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.832597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:09.832597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.832597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:09.832597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.832597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:09.832597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:09.832597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:09.832597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:09.832597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:09.832597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.832597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:09.832941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:09.833413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:09.833413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:09.833413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.833413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:09.833413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.833413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.833413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:09.833413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.833413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:09.833413 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:09.833413 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:09.833413 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:09.834092 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:09.834092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.834573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:09.834573 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.834573 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:09.834573 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.834573 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.834573 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:09.834573 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.834573 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:09.837008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.837008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:09.837008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:09.837008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:09.837008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.837008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:09.837008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:09.837008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.837008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:09.837008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:09.837008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:09.837008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.837292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:09.837292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:09.837292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:09.837292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:09.837292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:09.837292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:09.837292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:09.837292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:09.837292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.837292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:09.837292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.837292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.837292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:09.837574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.837574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:09.837940 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:09.839140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.839140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:09.839140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:09.839140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:09.839140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:09.839140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:09.839140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.839140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:09.839140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:09.839140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.839140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:09.839140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:09.839140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.839140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:09.839140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:09.839140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.839493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.839935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:09.839935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.839935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:09.839935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:09.839935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:09.839935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:47:09.839935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:09.840089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.842563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:09.842974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:09.842974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:09.842974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:09.842974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:09.842974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:09.842974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:09.842974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:09.842974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.842974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:09.842974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.842974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.842974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:09.842974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.842974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:09.842974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.843307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:09.843307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:09.843307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:09.843307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.843307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:09.843307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:09.843307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:47:09.843307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:09.843307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:09.843307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.843307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:09.843307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:09.843307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:09.843584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.843584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:09.843584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:09.843584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:09.843584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:09.843584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:09.843584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:09.843584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:09.843584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:09.843584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.843584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:09.843584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.843584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.843584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:09.843838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.843838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:09.843838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.843838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:09.843838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:09.843838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:09.843838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:09.843838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:09.843838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.843838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:09.843838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:09.843838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.843838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:09.843838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:09.843838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:09.844134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:09.844526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:09.844526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:09.844526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.844526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:09.844526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.844526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.844526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:09.844526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.844526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:09.844526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:09.844903 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:09.845049 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:09.845197 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:09.845732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:09.846720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.848175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:09.848175 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.848175 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:09.848175 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.848175 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.848175 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:09.848175 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.848175 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:09.849324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.849324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:09.849324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:09.849324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:09.849324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.849324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:09.849324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:09.849324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:09.849324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.849324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:09.849324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:09.849324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:09.849324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:09.849324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:09.849324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:09.849812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:09.849812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:09.849812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.849812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:09.849812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.849812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.849812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:09.849812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.849812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:09.854571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.854571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:09.854571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:09.854571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:09.854571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.854571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:09.854571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:09.854571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:09.854571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:09.854571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.854571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:09.855242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:09.855242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:09.855242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.855242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:09.855242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:09.855242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:09.855242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:09.855242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:09.855242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:09.855242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:09.855242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:09.855242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.855242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:09.855242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.855843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.855843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:09.855843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.855843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:09.855843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.855843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:09.855843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:09.855843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:09.855843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:09.855843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:09.855843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.855843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:09.855843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:09.855843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:09.856462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:09.857164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:09.857164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:09.857164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:09.857164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:09.857164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.857164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:09.857164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.857164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.857164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:09.857164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.857164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:09.912195 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:09.913282 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:09.913486 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:09.913727 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:09.914350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:09.914758 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:09.915011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.916310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:09.916310 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.916310 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:09.916310 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.916310 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.916310 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:09.916310 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.916310 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:09.917247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.917247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:09.917247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:09.917247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:09.917247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.917247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:09.917247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:09.917247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.917247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:09.917247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:09.917247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:09.917247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.917801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:09.917801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:09.917801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:09.917801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:09.917801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:09.917801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:09.917801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:09.917801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:09.917801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.917801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:09.917801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.917801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.917801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:09.918307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.918307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:09.918307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.918307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:09.918307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:09.918307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:09.918307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:09.918307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:09.918307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.918307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:09.918307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:09.918307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.918307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:09.918307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:09.918307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:09.918898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:09.919606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:09.919606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:09.919606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:09.919606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:09.919606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:09.919606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:14.748907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:14.749769 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:14.749769 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:14.750934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:14.788247 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:14.788801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.789844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:14.789844 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.789844 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:14.789844 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.789844 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.789844 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:14.789844 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.789844 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:14.790973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.790973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:14.790973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:14.790973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:14.790973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.790973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:14.790973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:14.790973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.790973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:14.790973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:14.790973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:14.790973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.791703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:14.791703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:14.791703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:14.791703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:14.791703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:14.791703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:14.791703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:14.791703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:14.791703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.791703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:14.791703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.791703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.791703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:14.792301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.792301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:14.792301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.792301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:14.792301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:14.792301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:14.792301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:14.792301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:14.792301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.792301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:14.792301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:14.792301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.792301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:14.792301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:14.792301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:14.793229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.794257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:14.794257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.794257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.794257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:14.794257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.794257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:14.831932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:14.832208 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:14.832298 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:14.833172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:14.833634 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:14.833938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.834872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:14.834872 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.834872 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:14.834872 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.834872 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.834872 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:14.834872 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.834872 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:14.835611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.835611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:14.835611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:14.835611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:14.835611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.835611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:14.835611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:14.835611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.835611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:14.835611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:14.835611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:14.835611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.836249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:14.836249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:14.836249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:14.836249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:14.836249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:14.836249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:14.836249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:14.836249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:14.836249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.836249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:14.836249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.836249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.836249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:14.836865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.836865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:14.836865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.836865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:14.836865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:14.836865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:14.836865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:14.836865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:14.836865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.836865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:14.836865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:14.836865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.836865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:14.836865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:14.836865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:14.837623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.838711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:14.838711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.838711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.838711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:14.838711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.838711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:14.839132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:14.839326 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:14.839439 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:14.839529 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:47:14.840037 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:14.840390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:14.841144 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.841144 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:14.841144 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.841144 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.841144 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:14.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.841144 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:14.841681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.841681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:14.841681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:14.841681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:14.841681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.841681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:14.841681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:14.841681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:14.841681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.841681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:14.841681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:14.841681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:14.841681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:14.841681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:14.841681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:14.842124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:14.842124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:14.842124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.842124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:14.842124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.842124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.842124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:14.842124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.842124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:14.842388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.842388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:14.842388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:14.842388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:14.842388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.842388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:14.842388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:14.842388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:47:14.842388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:14.842388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:14.842388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.842388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:14.842716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:14.842716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:14.842716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.842716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:14.842716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:14.842716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:14.842716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:14.842716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:14.842716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:14.842716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:14.842716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:14.842716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.842716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:14.842716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.843110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.843110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:14.843110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.843110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:14.843110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.843110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:14.843110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:14.843110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:14.843110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:14.843110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:14.843110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.843110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:14.843110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:14.843110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:14.843492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:14.843974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:14.843974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:14.843974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:14.843974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:14.843974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:14.843974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.843974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:14.843974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.843974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.843974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:14.843974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.843974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:14.845114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:14.845526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:14.845715 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:14.845917 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:14.846806 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:14.846806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.847310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:14.847310 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.847310 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:14.847310 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.847310 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.847310 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:14.847310 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.847310 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:14.848496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.848496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:14.848496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:14.848496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:14.848496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.848496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:14.848496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:14.848496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:14.848496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.848496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:14.848496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:14.848496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:14.848496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:14.848496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:14.848496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:14.848926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:14.848926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:14.848926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.848926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:14.848926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.848926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.848926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:14.848926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.848926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:14.849962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.849962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:14.849962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:14.849962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:14.849962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.849962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:14.849962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:14.849962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:14.849962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:14.849962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.849962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:14.850318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:14.850318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:14.850318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.850318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:14.850318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:14.850318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:14.850318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:14.850318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:14.850318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:14.850318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:14.850318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:14.850318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.850318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:14.850318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.850756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.850756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:14.850756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.850756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.851759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:14.852238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.852784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.852784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:14.852784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.852784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:14.913406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:14.913877 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:14.914058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:14.914312 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:14.914911 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:14.915387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:14.915734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.916609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:14.916609 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.916609 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:14.916609 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.916609 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.916609 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:14.916609 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.916609 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:14.918144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.918144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:14.918144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:14.918144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:14.918144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.918144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:14.918144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:14.918144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.918144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:14.918144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:14.918144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:14.918144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.918834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:14.918834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:14.918834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:14.918834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:14.918834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:14.918834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:14.918834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:14.918834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:14.918834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.918834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:14.918834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.918834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.918834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:14.919532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.919532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:14.920276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.920276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:14.920276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:14.920276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:14.920276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:14.920276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:14.920276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.920276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:14.920276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:14.920276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.920276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:14.920276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:14.920276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.920276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:14.920276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:14.920276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:14.920869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:14.921417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:14.921417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:14.921417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:19.749455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:19.750080 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:19.750080 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:19.750895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:19.795051 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:19.795216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.795700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:19.795700 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.795700 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:19.795700 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.795700 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.795700 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:19.795700 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.795700 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:19.796381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.046 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.796381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:19.796381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:19.796381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:19.796381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.796381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:19.796381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:19.796381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.796381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:19.796381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:19.796381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:19.796381 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.796783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:19.796783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:19.796783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:19.796783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:19.796783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:19.796783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:19.796783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:19.796783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:19.796783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.796783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:19.796783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.796783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.796783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:19.797212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.797212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:19.797212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.797212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:19.797212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:19.797212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:19.797212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:19.797212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:19.797212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.797212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:19.797212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:19.797212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.797212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:19.797212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:19.797212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:19.797719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.798295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:19.798295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.798295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.798295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:19.798295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.798295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:19.832440 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:19.833031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:19.833285 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:19.834301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:19.834668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:19.834906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.835890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:19.835890 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.835890 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:19.835890 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.835890 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.835890 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:19.835890 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.835890 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:19.837624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.837624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:19.837624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:19.837624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:19.837624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.837624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:19.837624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:19.837624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.837624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:19.837624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:19.837624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:19.837624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.838189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:19.838189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:19.838189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:19.838189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:19.838189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:19.838189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:19.838189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:19.838189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:19.838189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.838189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:19.838189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.838189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.838189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:19.838761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.838761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:19.839484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.839484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:19.839484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:19.839484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:19.839484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:19.839484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:19.839484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.839484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:19.839484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:19.839484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.839484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:19.839484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:19.839484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.839484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:19.839484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:19.839484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.840168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.841064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:19.841064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.841064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:19.841064 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:19.841064 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:19.841064 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:19.841064 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:47:19.841064 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:19.841391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.842043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:19.842043 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.842043 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:19.842043 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.842043 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.842043 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:19.842043 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.842043 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:19.842775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.842775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:19.842775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:19.842775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:19.842775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.842775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:19.842775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:19.842775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:19.842775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.842775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:19.842775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:19.842775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:19.842775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:19.842775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:19.842775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:19.843230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:19.843230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:19.843230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.843230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:19.843230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.843230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.843230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:19.843230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.843230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:19.843588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.843588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:19.843588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:19.843588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:19.843588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.843588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:19.843588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:19.843588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:47:19.843588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:19.843588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:19.843588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.843588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:19.843922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:19.843922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:19.843922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.843922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:19.843922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:19.843922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:19.843922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:19.843922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:19.843922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:19.843922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:19.843922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:19.843922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.843922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:19.843922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.844290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.844290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:19.844290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.844290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:19.844652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.844652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:19.844652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:19.844652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:19.844652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:19.844652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:19.844652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.844652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:19.844652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:19.844652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.844652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:19.844652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:19.844652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.844652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:19.844652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:19.844652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:19.845095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:19.845610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.845610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:19.845610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.845610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.845610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:19.845610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.845610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:19.845610 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:19.845862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:19.845984 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:19.846108 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:19.846518 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:19.846894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.847563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:19.847563 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.847563 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:19.847563 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.847563 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.847563 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:19.847563 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.847563 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:19.848283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.848283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:19.848283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:19.848283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:19.848283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.848283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:19.848283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:19.848283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:19.848283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.848283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:19.848283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:19.848283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:19.848283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:19.848283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:19.848283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:19.848731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:19.848731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:19.848731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.848731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:19.848731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.848731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.848731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:19.848731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.848731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:19.849223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.849223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:19.849223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:19.849223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:19.849223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.849223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:19.849223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:19.849223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:19.849223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:19.849223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.849223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:19.849580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:19.849580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:19.849580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.849580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:19.849580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:19.849580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:19.849580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:19.849580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:19.849580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:19.849580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:19.849580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:19.849580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.849580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:19.849580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.850057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.850057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:19.850057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.850057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.850298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:19.850806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.851317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.851317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:19.851317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.851317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:19.914150 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:19.914613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:19.914738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:19.914893 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:19.915421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:19.915546 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:19.915688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.916317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:19.916317 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.916317 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:19.916317 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.916317 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.916317 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:19.916317 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.916317 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:19.917915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.917915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:19.917915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:19.917915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:19.917915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.917915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:19.917915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:19.917915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.917915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:19.917915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:19.917915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:19.917915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.918448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:19.918448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:19.918448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:19.918448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:19.918448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:19.918448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:19.918448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:19.918448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:19.918448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.918448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:19.918448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.918448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.918448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:19.918937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.918937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:19.919784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.919784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:19.919784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:19.919784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:19.919784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:19.919784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:19.919784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.919784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:19.919784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:19.919784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.919784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:19.919784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:19.919784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.919784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:19.919784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:19.919784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:19.920462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:19.921146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:19.921146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:19.921146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:24.750130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:24.751155 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:24.751237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:24.752609 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:24.783632 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:24.784077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.785003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:24.785003 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.785003 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:24.785003 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.785003 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.785003 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:24.785003 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.785003 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:24.786099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.786099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:24.786099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:24.786099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:24.786099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.786099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:24.786099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:24.786099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.786099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:24.786099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:24.786099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:24.786099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:24.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:24.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:24.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:24.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:24.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:24.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:24.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:24.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:24.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.786791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:24.787603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.787603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:24.787603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.787603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:24.787603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:24.787603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:24.787603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:24.787603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:24.787603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.787603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:24.787603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:24.787603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.787603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:24.787603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:24.787603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:24.788440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.789581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:24.789581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.789581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.789581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:24.789581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.789581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:24.833640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:24.833640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:24.833939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:24.834772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:24.835107 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:24.835334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.836165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:24.836165 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.836165 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:24.836165 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.836165 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.836165 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:24.836165 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.836165 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:24.837769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.837769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:24.837769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:24.837769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:24.837769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.837769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:24.837769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:24.837769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.837769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:24.837769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:24.837769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:24.837769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.838395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:24.838395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:24.838395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:24.838395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:24.838395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:24.838395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:24.838395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:24.838395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:24.838395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.838395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:24.838395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.838395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.838395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:24.838946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.838946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:24.839612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.839612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:24.839612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:24.839612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:24.839612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:24.839612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:24.839612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.839612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:24.839612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:24.839612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.839612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:24.839612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:24.839612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.839612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:24.839612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:24.839612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.840396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.841395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:24.841395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.841395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:24.841395 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:24.841395 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:24.841395 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:24.841395 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:47:24.841693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:24.842038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.842894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:24.842894 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.842894 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:24.842894 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.842894 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.842894 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:24.842894 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.842894 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:24.843853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.843853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:24.843853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:24.843853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:24.843853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.843853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:24.843853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:24.843853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:24.843853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.843853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:24.843853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:24.843853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:24.843853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:24.843853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:24.843853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:24.844397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:24.844397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:24.844397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.844397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:24.844397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.844397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.844397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:24.844397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.844397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:24.844762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.844762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:24.844762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:24.844762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:24.844762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.844762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:24.844762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:24.844762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:47:24.844762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:24.844762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:24.844762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.844762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:24.845156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:24.845156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:24.845156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.845156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:24.845156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:24.845156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:24.845156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:24.845156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:24.845156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:24.845156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:24.845156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:24.845156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.845156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:24.845156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.845743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.845743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:24.845743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.845743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:24.845743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.845743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:24.845743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:24.845743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:24.845743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:24.845743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:24.845743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.845743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:24.845743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:24.845743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:24.846132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:24.846659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:24.846659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:24.846659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:24.846659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:24.846659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:24.846659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.846659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:24.846659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.846659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.846659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:24.846659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.846659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:24.846659 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:24.846659 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:24.847024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:24.847024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:24.847024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:24.847119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.847627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:24.847627 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.847627 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:24.847627 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.847627 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.847627 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:24.847627 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.847627 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:24.848324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.848324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:24.848324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:24.848324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:24.848324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.848324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:24.848324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:24.848324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:24.848324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.848324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:24.848324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:24.848324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:24.848324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:24.848324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:24.848324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:24.848855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:24.848855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:24.848855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.848855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:24.848855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.848855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.848855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:24.848855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.848855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:24.849229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.849229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:24.849229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:24.849229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:24.849229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.849229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:24.849229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:24.849229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:24.849229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:24.849229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.849229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:24.849643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:24.849643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:24.849643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.849643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:24.849643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:24.849643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:24.849643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:24.849643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:24.849643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:24.849643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:24.849643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:24.849643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.849643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:24.849643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.850074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.850074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:24.850074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.850074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.850409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:24.850947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.851566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.851566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:24.851566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.851566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:24.914867 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:24.946001 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:24.946152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:24.946363 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:24.947104 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:24.947432 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:24.947550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.948009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:24.948009 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.948009 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:24.948009 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.948009 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.948009 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:24.948009 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.948009 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:24.949029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.949029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:24.949029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:24.949029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:24.949029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.949029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:24.949029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:24.949029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.949029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:24.949029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:24.949029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:24.949029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.949312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:24.949312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:24.949312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:24.949312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:24.949312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:24.949312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:24.949312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:24.949312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:24.949312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.949312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:24.949312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.949312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.949312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:24.949597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.949597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:24.950024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.950024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:24.950024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:24.950024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:24.950024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:24.950024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:24.950024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.950024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:24.950024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:24.950024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.950024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:24.950024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:24.950024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.950024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:24.950024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:24.950024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:24.950430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:24.951012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:24.951012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:24.951012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:29.751145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:29.752171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:29.752171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:29.752614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:29.787492 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:29.787728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.788523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:29.788523 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.788523 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:29.788523 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.788523 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.788523 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:29.788523 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.788523 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:29.789972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.789972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:29.789972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:29.789972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:29.789972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.789972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:29.789972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:29.789972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.789972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:29.789972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:29.789972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:29.789972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.790762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:29.790762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:29.790762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:29.790762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:29.790762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:29.790762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:29.790762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:29.790762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:29.790762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.790762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:29.790762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.790762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.790762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:29.791494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.791494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:29.791665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.791665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:29.791665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:29.791665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:29.791665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:29.791665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:29.791665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.791665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:29.791665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:29.791665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.791665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:29.791665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:29.791665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.791665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:29.791665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:29.791665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.793016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.794063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:29.794063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.794063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:29.833913 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:29.834316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:29.834466 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:29.835924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:29.836228 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:29.836482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.837289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:29.837289 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.837289 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:29.837289 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.837289 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.837289 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:29.837289 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.837289 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:29.838585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.838585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:29.838585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:29.838585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:29.838585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.838585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:29.838585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:29.838585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.838585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:29.838585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:29.838585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:29.838585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.839228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:29.839228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:29.839228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:29.839228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:29.839228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:29.839228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:29.839228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:29.839228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:29.839228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.839228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:29.839228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.839228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.839228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:29.839819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.839819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:29.840073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.840073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:29.840073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:29.840073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:29.840073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:29.840073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:29.840073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.840073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:29.840073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:29.840073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.840073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:29.840073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:29.840073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.840073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:29.840073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:29.840073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.840811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.841670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:29.841670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.841670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:29.841670 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:29.841670 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:29.841670 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:29.841980 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:47:29.842129 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:29.842289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.842811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:29.842811 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.842811 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:29.842811 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.842811 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.842811 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:29.842811 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.842811 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:29.843773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.843773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:29.843773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:29.843773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:29.843773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.843773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:29.843773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:29.843773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:29.843773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.843773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:29.843773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:29.843773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:29.843773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:29.843773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:29.843773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:29.844280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:29.844280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:29.844280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.844280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:29.844280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.844280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.844280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:29.844280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.844280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:29.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:29.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:29.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:29.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:29.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:29.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:47:29.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:29.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:29.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:29.845115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:29.845115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:29.845115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.845115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:29.845115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:29.845115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:29.845115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:29.845115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:29.845115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:29.845115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:29.845115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:29.845115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.845115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:29.845115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.845580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.845580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:29.845580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.845580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:29.846353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.846353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:29.846353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:29.846353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:29.846353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:29.846353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:29.846353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.846353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:29.846353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:29.846353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.846353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:29.846353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:29.846353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.846353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:29.846353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:29.846353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:29.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:29.847613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.847613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:29.847613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.847613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.847613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:29.847613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.847613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:29.847613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:29.847613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:29.847613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:29.848114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:29.848233 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:29.848685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.849475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:29.849475 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.849475 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:29.849475 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.849475 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.849475 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:29.849475 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.849475 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:29.850632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.850632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:29.850632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:29.850632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:29.850632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.850632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:29.850632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:29.850632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:29.850632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.850632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:29.850632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:29.850632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:29.850632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:29.850632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:29.850632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:29.851235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:29.851235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:29.851235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.851235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:29.851235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.851235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.851235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:29.851235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.851235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:29.851948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.851948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:29.851948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:29.851948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:29.851948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.851948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:29.851948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:29.851948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:29.851948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:29.851948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.851948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:29.852289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:29.852289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:29.852289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.852289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:29.852289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:29.852289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:29.852289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:29.852289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:29.852289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:29.852289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:29.852289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:29.852289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.852289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:29.852289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.852709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.852709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:29.852709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.852709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.853690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:29.854454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.854963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.854963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:29.854963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.854963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:29.945592 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:29.946164 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:29.946345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:29.946641 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:29.947207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:29.947499 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:29.947658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.948287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:29.948287 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.948287 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:29.948287 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.948287 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.948287 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:29.948287 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.948287 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:29.949509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.949509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:29.949509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:29.949509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:29.949509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.949509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:29.949509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:29.949509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.949509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:29.949509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:29.949509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:29.949509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.949862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:29.949862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:29.949862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:29.949862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:29.949862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:29.949862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:29.949862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:29.949862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:29.949862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.949862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:29.949862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.949862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.949862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:29.950180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.950180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:29.950384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.950384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:29.950384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:29.950384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:29.950384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:29.950384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:29.950384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.950384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:29.950384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:29.950384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.950384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:29.950384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:29.950384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.950384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:29.950384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:29.950384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:29.950796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:29.951236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:29.951236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:29.951236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:34.751750 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:34.752698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:34.752698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:34.753805 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:34.787643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:34.788053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.789001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:34.789001 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.789001 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:34.789001 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.789001 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.789001 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:34.789001 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.789001 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:34.789845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.789845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:34.789845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:34.789845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:34.789845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.789845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:34.789845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:34.789845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.789845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:34.789845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:34.789845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:34.789845 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.790447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:34.790447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:34.790447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:34.790447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:34.790447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:34.790447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:34.790447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:34.790447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:34.790447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.790447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:34.790447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.790447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.790447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:34.791414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.791414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:34.791414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.791414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:34.791414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:34.791414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:34.791414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:34.791414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:34.791414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.791414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:34.791414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:34.791414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.791414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:34.791414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:34.791414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:34.792743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.793548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:34.793548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.793548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.793548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:34.793548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.793548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:34.834498 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:34.835119 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:34.835302 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:34.836363 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:34.836780 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:34.837074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.837925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:34.837925 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.837925 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:34.837925 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.837925 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.837925 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:34.837925 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.837925 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:34.838799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.838799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:34.838799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:34.838799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:34.838799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.838799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:34.838799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:34.838799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.838799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:34.838799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:34.838799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:34.838799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.839494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:34.839494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:34.839494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:34.839494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:34.839494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:34.839494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:34.839494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:34.839494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:34.839494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.839494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:34.839494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.839494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.839494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:34.840148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.840148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:34.840148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.840148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:34.840148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:34.840148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:34.840148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:34.840148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:34.840148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.840148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:34.840148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:34.840148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.840148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:34.840148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:34.840148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:34.840813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.841678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:34.841678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.841678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.841678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:34.841678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.841678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:34.841678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:34.841678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:34.842083 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:34.842083 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:47:34.842359 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:34.842727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.843491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:34.843491 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.843491 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:34.843491 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.843491 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.843491 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:34.843491 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.843491 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:34.844045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.844045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:34.844045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:34.844045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:34.844045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.844045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:34.844045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:34.844045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:34.844045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.844045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:34.844045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:34.844045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:34.844045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:34.844045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:34.844045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:34.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:34.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:34.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:34.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:34.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:34.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:34.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:34.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:34.844761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.845347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:34.845347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:34.845347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:47:34.845347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:34.845347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:34.845347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.845347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:34.845347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:34.845347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:34.845347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.845347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:34.845347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:34.845347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:34.845952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:34.845952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:34.845952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:34.845952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:34.845952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:34.845952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.845952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:34.845952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.845952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.845952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:34.845952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.845952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:34.846499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.846499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:34.846499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:34.846499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:34.846499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:34.846499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:34.846499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.846499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:34.846499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:34.846499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.846499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:34.846499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:34.846499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.846499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:34.846499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:34.846499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:34.847282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:34.847950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.847950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:34.847950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.847950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.847950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:34.847950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.847950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:34.847950 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:34.847950 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:34.847950 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:34.848264 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:34.848264 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:34.848387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.848996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:34.848996 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.848996 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:34.848996 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.848996 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.848996 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:34.848996 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.848996 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:34.849829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.849829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:34.849829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:34.849829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:34.849829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.849829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:34.849829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:34.849829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:34.849829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.849829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:34.849829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:34.849829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:34.849829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:34.849829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:34.849829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:34.850287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:34.850287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:34.850287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.850287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:34.850287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.850287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.850287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:34.850287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.850287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:34.850812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.850812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:34.850812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:34.850812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:34.850812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.850812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:34.850812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:34.850812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:34.850812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:34.850812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.850812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:34.851468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:34.851468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:34.851468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.851468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:34.851468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:34.851468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:34.851468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:34.851468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:34.851468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:34.851468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:34.851468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:34.851468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.851468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:34.851468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.852075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.852075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:34.852075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.852075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:34.852075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.852075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:34.852075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:34.852075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:34.852075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:34.852075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:34.852075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.852075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:34.852075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:34.852075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:34.852720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:34.853636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:34.853636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:34.853636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:34.853636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:34.853636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.853636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:34.853636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.853636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.853636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:34.853636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.853636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:34.946143 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:34.946610 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:34.946729 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:34.946941 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:34.947571 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:34.947835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:34.948055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.948629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:34.948629 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.948629 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:34.948629 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.948629 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.948629 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:34.948629 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.948629 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:34.950450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.950450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:34.950450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:34.950450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:34.950450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.950450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:34.950450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:34.950450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.950450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:34.950450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:34.950450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:34.950450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.951042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:34.951042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:34.951042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:34.951042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:34.951042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:34.951042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:34.951042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:34.951042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:34.951042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.951042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:34.951042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.951042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.951042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:34.951532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.951532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:34.953054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.953054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:34.953054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:34.953054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:34.953054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:34.953054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:34.953054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.953054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:34.953054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:34.953054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.953054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:34.953054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:34.953054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.953054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:34.953054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:34.953054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:34.953708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:34.954398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:34.954398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:34.954398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:39.752424 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:39.753537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:39.753537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:39.754354 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:39.792801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:39.793209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.794077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:39.794077 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.794077 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:39.794077 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.794077 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.794077 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:39.794077 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.794077 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:39.794844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.794844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:39.794844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:39.794844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:39.794844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.794844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:39.794844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:39.794844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.794844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:39.794844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:39.794844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:39.794844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.795504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:39.795504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:39.795504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:39.795504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:39.795504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:39.795504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:39.795504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:39.795504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:39.795504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.795504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:39.795504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.795504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.795504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:39.796100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.796100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:39.796100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.796100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:39.796100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:39.796100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:39.796100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:39.796100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:39.796100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.796100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:39.796100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:39.796100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.796100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:39.796100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:39.796100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:39.796901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.797638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:39.797638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.797638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.797638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:39.797638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.797638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:39.835091 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:39.835621 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:39.835777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:39.836792 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:39.837124 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:39.837341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.838200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:39.838200 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.838200 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:39.838200 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.838200 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.838200 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:39.838200 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.838200 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:39.839762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.839762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:39.839762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:39.839762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:39.839762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.839762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:39.839762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:39.839762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.839762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:39.839762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:39.839762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:39.839762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.841043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:39.841043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:39.841043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:39.841043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:39.841043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:39.841043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:39.841043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:39.841043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:39.841043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.841043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:39.841043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.841043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.841043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:39.841633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.841633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:39.841633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.841633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:39.841633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:39.841633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:39.841633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:39.841633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:39.841633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.841633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:39.841633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:39.841633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.841633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:39.841633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:39.841633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:39.842316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.843169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:39.843169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.843169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.843169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:39.843169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.843169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:39.843169 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:39.843169 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:39.843169 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:39.843169 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:47:39.843911 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:39.843911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.843911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:39.843911 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.843911 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:39.843911 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.843911 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.843911 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:39.843911 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.843911 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:39.844450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.844450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:39.844450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:39.844450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:39.844450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.844450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:39.844450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:39.844450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:39.844450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.844450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:39.844450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:39.844450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:39.844450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:39.844450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:39.844450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:39.845642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:39.845642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:39.845642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.845642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:39.845642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.845642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.845642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:39.845642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.845642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:39.845642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.845642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:39.845642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:39.845642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:39.845642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.846514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:39.846514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:39.846514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:47:39.846514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:39.846514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:39.846514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.846514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:39.846514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:39.846514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:39.846514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.846514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:39.846514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:39.846514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:39.847267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:39.847267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:39.847267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:39.847267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:39.847267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:39.847267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.847267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:39.847267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.847267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.847267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:39.847267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.847267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:39.848072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.848072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:39.848072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:39.848072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:39.848072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:39.848072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:39.848072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.848072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:39.848072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:39.848072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.848072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:39.848072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:39.848072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.848072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:39.848072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:39.848072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:39.848984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:39.849973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.849973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:39.849973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.849973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.849973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:39.849973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.849973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:39.849973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:39.849973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:39.849973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:39.850257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:39.850257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:39.850257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.850257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:39.850257 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.850257 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:39.850257 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.850257 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.850257 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:39.850257 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.850257 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:39.850257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:39.850746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.851270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:39.851270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.851270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.851270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:39.851270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.851270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:39.851448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.851448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:39.851448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:39.851448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:39.851448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.851448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:39.851448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:39.851448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:39.851448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:39.851448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.851448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:39.851746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:39.851746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:39.851746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.851746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:39.851746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:39.851746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:39.851746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:39.851746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:39.851746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:39.851746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:39.851746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:39.851746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.851746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:39.851746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.852096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.852096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:39.852096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.852096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.852663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:39.853126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.853644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.853644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:39.853644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.853644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:39.946760 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:39.947406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:39.947602 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:39.948024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:39.948672 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:39.949070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:39.949305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.950178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:39.950178 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.950178 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:39.950178 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.950178 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.950178 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:39.950178 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.950178 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:39.951878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.951878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:39.951878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:39.951878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:39.951878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.951878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:39.951878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:39.951878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.951878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:39.951878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:39.951878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:39.951878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.952584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:39.952584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:39.952584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:39.952584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:39.952584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:39.952584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:39.952584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:39.952584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:39.952584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.952584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:39.952584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.952584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.952584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:39.953130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.953130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:39.953399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.953399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:39.953399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:39.953399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:39.953399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:39.953399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:39.953399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.953399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:39.953399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:39.953399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.953399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:39.953399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:39.953399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.953399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:39.953399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:39.953399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:39.954448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:39.955360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:39.955360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:39.955360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:44.753042 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:44.753873 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:44.753873 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:44.754681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:44.789657 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:44.789895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.790751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:44.790751 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.790751 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:44.790751 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.790751 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.790751 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:44.790751 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.790751 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:44.791749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.791749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:44.791749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:44.791749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:44.791749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.791749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:44.791749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:44.791749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.791749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:44.791749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:44.791749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:44.791749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.792441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:44.792441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:44.792441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:44.792441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:44.792441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:44.792441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:44.792441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:44.792441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:44.792441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.792441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:44.792441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.792441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.792441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:44.793124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.793124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:44.793124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.793124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:44.793124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:44.793124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:44.793124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:44.793124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:44.793124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.793124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:44.793124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:44.793124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.793124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:44.793124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:44.793124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:44.793985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.794991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:44.794991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.794991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.794991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:44.794991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.794991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:44.836102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:44.836299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:44.836541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:44.837625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:44.837940 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:44.838152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.839022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:44.839022 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.839022 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:44.839022 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.839022 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.839022 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:44.839022 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.839022 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:44.840500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.840500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:44.840500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:44.840500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:44.840500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.840500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:44.840500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:44.840500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.840500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:44.840500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:44.840500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:44.840500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.841261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:44.841261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:44.841261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:44.841261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:44.841261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:44.841261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:44.841261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:44.841261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:44.841261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.841261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:44.841261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.841261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.841261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:44.841837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.841837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:44.842000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.842000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:44.842000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:44.842000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:44.842000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:44.842000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:44.842000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.842000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:44.842000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:44.842000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.842000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:44.842000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:44.842000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.842000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:44.842000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:44.842000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.842926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.843884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:44.843884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.843884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:44.843884 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:44.843884 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:44.843884 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:44.843884 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:47:44.843884 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:44.844303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.844732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:44.844732 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.844732 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:44.844732 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.844732 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.844732 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:44.844732 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.844732 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:44.845441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.845441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:44.845441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:44.845441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:44.845441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.845441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:44.845441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:44.845441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:44.845441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.845441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:44.845441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:44.845441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:44.845441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:44.845441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:44.845441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:44.845965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:44.845965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:44.845965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.845965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:44.845965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.845965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.845965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:44.845965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.845965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:44.846295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.846295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:44.846295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:44.846295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:44.846295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.846295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:44.846295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:44.846295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:47:44.846295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:44.846295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:44.846295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.846295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:44.846688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:44.846688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:44.846688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.846688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:44.846688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:44.846688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:44.846688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:44.846688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:44.846688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:44.846688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:44.846688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:44.846688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.846688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:44.846688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.847104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.847104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:44.847104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.847104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:44.847638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.847638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:44.847638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:44.847638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:44.847638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:44.847638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:44.847638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.847638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:44.847638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:44.847638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.847638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:44.847638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:44.847638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.847638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:44.847638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:44.847638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:44.848237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:44.849222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.849222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:44.849222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.849222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.849222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:44.849222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.849222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:44.849222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:44.849222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:44.849222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:44.849942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:44.849942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:44.849942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.850124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:44.850124 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.850124 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:44.850124 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.850124 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.850124 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:44.850124 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.850124 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:44.850844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.850844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:44.850844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:44.850844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:44.850844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.850844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:44.850844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:44.850844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:44.850844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.850844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:44.850844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:44.850844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:44.850844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:44.850844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:44.850844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:44.851338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:44.851338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:44.851338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.851338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:44.851338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.851338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.851338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:44.851338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.851338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:44.851738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.851738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:44.851738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:44.851738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:44.851738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.851738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:44.851738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:44.851738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:44.851738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:44.851738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.851738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:44.852721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:44.852721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:44.852721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.852721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:44.852721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:44.852721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:44.852721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:44.852721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:44.852721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:44.852721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:44.852721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:44.852721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.852721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:44.852721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.853093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.853093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:44.853093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.853093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:44.853093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.853093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:44.853093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:44.853093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:44.853093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:44.853093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:44.853093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.853093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:44.853093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:44.853093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:44.853724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:44.854302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:44.854302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:44.854302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:44.854302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:44.854302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.854302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:44.854302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.854302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.854302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:44.854302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.854302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:44.947404 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:44.947841 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:44.948022 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:44.948270 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:44.948855 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:44.949250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:44.949509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.950327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:44.950327 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.950327 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:44.950327 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.950327 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.950327 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:44.950327 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.950327 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:44.951637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.951637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:44.951637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:44.951637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:44.951637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.951637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:44.951637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:44.951637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.951637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:44.951637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:44.951637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:44.951637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.952132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:44.952132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:44.952132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:44.952132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:44.952132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:44.952132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:44.952132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:44.952132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:44.952132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.952132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:44.952132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.952132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.952132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:44.952618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.952618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:44.953490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.953490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:44.953490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:44.953490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:44.953490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:44.953490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:44.953490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.953490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:44.953490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:44.953490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.953490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:44.953490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:44.953490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.953490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:44.953490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:44.953490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:44.954501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:44.955343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:44.955343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:44.955343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:49.753666 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:49.754520 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:49.754737 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:49.756406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:49.790982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:49.791301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.793058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:49.793058 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.793058 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:49.793058 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.793058 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.793058 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:49.793058 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.793058 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:49.794494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.794494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:49.794494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:49.794494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:49.794494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.794494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:49.794494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:49.794494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.794494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:49.794494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:49.794494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:49.794494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.795118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:49.795118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:49.795118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:49.795118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:49.795118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:49.795118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:49.795118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:49.795118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:49.795118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.795118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:49.795118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.795118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.795118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:49.795780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.795780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:49.795780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.795780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:49.795780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:49.795780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:49.795780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:49.795780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:49.795780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.795780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:49.795780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:49.795780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.795780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:49.795780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:49.795780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:49.796533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.797435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:49.797435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.797435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.797435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:49.797435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.797435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:49.836598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:49.837073 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:49.837167 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:49.838337 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:49.838741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:49.838989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.840022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:49.840022 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.840022 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:49.840022 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.840022 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.840022 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:49.840022 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.840022 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:49.842285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.842285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:49.842285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:49.842285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:49.842285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.842285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:49.842285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:49.842285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.842285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:49.842285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:49.842285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:49.842285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.843080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:49.843080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:49.843080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:49.843080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:49.843080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:49.843080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:49.843080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:49.843080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:49.843080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.843080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:49.843080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.843080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.843080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:49.844055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.844055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:49.845080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.845080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:49.845080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:49.845080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:49.845080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:49.845080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:49.845080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.845080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:49.845080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:49.845080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.845080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:49.845080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:49.845080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.845080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:49.845080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:49.845080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.846280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.847681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:49.847681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.847681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:49.847681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:49.847681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:49.847681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:49.847681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:47:49.847681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:49.848415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.848415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:49.848415 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.848415 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:49.848415 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.848415 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.848415 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:49.848415 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.848415 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:49.848942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.848942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:49.848942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:49.848942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:49.848942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.848942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:49.848942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:49.848942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:49.848942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.848942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:49.848942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:49.848942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:49.848942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:49.848942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:49.848942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:49.849647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:49.849647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:49.849647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.849647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:49.849647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.849647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.849647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:49.849647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.849647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:49.850199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.850199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:49.850199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:49.850199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:49.850199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.850199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:49.850199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:49.850199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:47:49.850199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:49.850199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:49.850199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.850199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:49.850752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:49.850752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:49.850752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.850752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:49.850752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:49.850752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:49.850752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:49.850752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:49.850752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:49.850752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:49.850752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:49.850752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.850752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:49.850752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.851293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.851293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:49.851293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.851293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:49.851293 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:49.851750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.851750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:49.851750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:49.851750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:49.851750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:49.851750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:49.851750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.851750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:49.851750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:49.851750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.851750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:49.851750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:49.851750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.851750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:49.851750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:49.851750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:49.852416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:49.852933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.852933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:49.852933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.852933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.852933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:49.852933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.852933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:49.852933 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:49.852933 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:49.852933 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:49.853426 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:49.853426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.854048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:49.854048 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.854048 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:49.854048 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.854048 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.854048 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:49.854048 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.854048 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:49.854648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.854648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:49.854648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:49.854648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:49.854648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.854648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:49.854648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:49.854648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:49.854648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.854648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:49.854648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:49.854648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:49.854648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:49.854648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:49.854648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:49.854954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:49.854954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:49.854954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.854954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:49.854954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.854954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.854954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:49.854954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.854954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:49.855525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.855525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:49.855525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:49.855525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:49.855525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.855525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:49.855525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:49.855525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:49.855525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:49.855525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.855525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:49.855835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:49.855835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:49.855835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.855835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:49.855835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:49.855835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:49.855835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:49.855835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:49.855835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:49.855835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:49.855835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:49.855835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.855835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:49.855835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.856193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.856193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:49.856193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.856193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.856553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:49.857021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.857543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.857543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:49.857543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.857543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:49.948068 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:49.948570 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:49.948700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:49.948904 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:49.949483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:49.949798 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:49.949951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.950606 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:49.950606 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.950606 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:49.950606 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.950606 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.950606 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:49.950606 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.950606 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:49.951595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.951595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:49.951595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:49.951595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:49.951595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.951595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:49.951595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:49.951595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.951595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:49.951595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:49.951595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:49.951595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.952238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:49.952238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:49.952238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:49.952238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:49.952238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:49.952238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:49.952238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:49.952238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:49.952238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.952238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:49.952238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.952238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.952238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:49.953043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.953043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:49.953043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.953043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:49.953043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:49.953043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:49.953043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:49.953043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:49.953043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.953043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:49.953043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:49.953043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.953043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:49.953043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:49.953043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:49.953776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:49.954717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:49.954717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:49.954717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:49.954717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:49.954717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:49.954717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:54.754340 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:54.755280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:54.755280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:54.755871 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:54.757543 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:47:54.791311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:54.791675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.792481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:54.792481 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.792481 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:54.792481 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.792481 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.792481 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:54.792481 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.792481 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:54.793575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.793575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:54.793575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:54.793575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:54.793575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.793575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:54.793575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:54.793575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.793575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:54.793575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:54.793575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:54.793575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.794167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:54.794167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:54.794167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:54.794167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:54.794167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:54.794167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:54.794167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:54.794167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:54.794167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.794167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:54.794167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.794167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.794167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:54.794745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.794745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:54.794745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.794745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:54.794745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:54.794745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:54.794745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:54.794745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:54.794745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.794745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:54.794745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:54.794745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.794745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:54.794745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:54.794745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:54.795445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.796427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:54.796427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.796427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.796427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:54.796427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.796427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:54.837232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:54.837934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:54.838129 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:54.839078 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:54.839282 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:54.839389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.840118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:54.840118 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.840118 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:54.840118 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.840118 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.840118 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:54.840118 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.840118 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:54.841887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.841887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:54.841887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:54.841887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:54.841887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.841887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:54.841887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:54.841887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.841887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:54.841887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:54.841887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:54.841887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.842487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:54.842487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:54.842487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:54.842487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:54.842487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:54.842487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:54.842487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:54.842487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:54.842487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.842487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:54.842487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.842487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.842487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:54.843060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.843060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:54.843176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.843176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:54.843176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:54.843176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:54.843176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:54.843176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:54.843176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.843176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:54.843176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:54.843176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.843176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:54.843176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:54.843176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.843176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:54.843176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:54.843176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.843919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.844724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:54.844724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.844724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:54.845925 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:54.846240 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:54.846335 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:54.846489 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:47:54.846859 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:54.847004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.847532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:54.847532 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.847532 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:54.847532 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.847532 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.847532 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:54.847532 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.847532 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:54.848271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.848271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:54.848271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:54.848271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:54.848271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.848271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:54.848271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:54.848271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:54.848271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.848271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:54.848271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:54.848271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:54.848271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:54.848271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:54.848271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:54.848697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:54.848697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:54.848697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.848697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:54.848697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.848697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.848697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:54.848697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.848697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:54.849084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.849084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:54.849084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:54.849084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:54.849084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.849084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:54.849084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:54.849084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:47:54.849084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:54.849084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:54.849084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.849084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:54.849457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:54.849457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:54.849457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.849457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:54.849457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:54.849457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:54.849457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:54.849457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:54.849457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:54.849457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:54.849457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:54.849457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.849457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:54.849457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.849881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.849881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:54.849881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.849881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:54.850130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.850130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:54.850130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:54.850130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:54.850130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:54.850130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:54.850130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.850130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:54.850130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:54.850130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.850130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:54.850130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:54.850130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.850130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:54.850130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:54.850130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:54.850898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:54.851419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.851419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:54.851419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.851419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.851419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:54.851419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.851419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:54.852123 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:54.852464 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:54.852576 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:54.852699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:54.853145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:54.853433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.854070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:54.854070 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.854070 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:54.854070 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.854070 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.854070 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:54.854070 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.854070 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:54.854820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.854820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:54.854820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:54.854820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:54.854820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.854820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:54.854820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:54.854820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:54.854820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.854820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:54.854820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:54.854820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:54.854820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:54.854820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:54.854820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:54.855270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:54.855270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:54.855270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.855270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:54.855270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.855270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.855270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:54.855270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.855270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:54.855969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.855969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:54.855969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:54.855969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:54.855969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.855969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:54.855969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:54.855969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:54.855969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:54.855969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.855969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:54.856308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:54.856308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:54.856308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.856308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:54.856308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:54.856308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:54.856308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:54.856308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:54.856308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:54.856308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:54.856308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:54.856308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.856308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:54.856308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.856811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.856811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:54.856811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.856811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.857343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:54.857867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.858398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.858398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:54.858398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.858398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:54.948918 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:54.949338 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:54.949568 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:54.949849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:54.950856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:54.951268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:54.951528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.952295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:54.952295 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.952295 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:54.952295 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.952295 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.952295 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:54.952295 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.952295 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:54.953740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.953740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:54.953740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:54.953740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:54.953740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.953740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:54.953740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:54.953740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.953740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:54.953740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:54.953740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:54.953740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.954400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:54.954400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:54.954400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:54.954400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:54.954400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:54.954400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:54.954400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:54.954400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:54.954400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.954400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:54.954400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.954400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.954400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:54.954772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.954772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:54.955955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.955955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:54.955955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:54.955955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:54.955955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:54.955955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:54.955955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.955955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:54.955955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:54.955955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.955955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:54.955955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:54.955955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.955955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:54.955955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:54.955955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:54.956400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:54.956910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:54.956910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:54.956910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:59.755072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:59.755882 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:59.755882 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:59.757060 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:59.786678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:59.786864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.787349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:59.787349 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.787349 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:59.787349 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.787349 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.787349 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:59.787349 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.787349 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:59.788569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.031 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.788569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:59.788569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:59.788569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:59.788569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.788569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:59.788569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:59.788569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.788569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:59.788569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:59.788569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:59.788569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.789770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:59.789770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:59.789770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:59.789770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:59.789770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:59.789770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:59.789770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:59.789770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:59.789770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.789770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:59.789770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.789770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.789770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:59.790109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.790109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:59.790109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.790109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:59.790109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:59.790109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:59.790109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:59.790109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:59.790109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.790109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:59.790109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:59.790109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.790109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:59.790109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:59.790109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:59.790524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.791052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:59.791052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.791052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.791052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:59.791052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.791052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:59.837871 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:59.838379 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:59.838600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:59.839573 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:59.839845 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:59.840069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.840883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:59.840883 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.840883 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:59.840883 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.840883 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.840883 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:59.840883 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.840883 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:59.842281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.842281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:59.842281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:59.842281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:59.842281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.842281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:59.842281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:59.842281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.842281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:59.842281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:59.842281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:59.842281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.842867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:59.842867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:59.842867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:59.842867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:59.842867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:59.842867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:59.842867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:59.842867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:59.842867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.842867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:59.842867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.842867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.842867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:59.843531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.843531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:59.843982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.843982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:59.843982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:59.843982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:59.843982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:59.843982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:59.843982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.843982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:59.843982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:59.843982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.843982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:59.843982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:59.843982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.843982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:59.843982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:59.843982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.844833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.845810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:59.845810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.845810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:59.846411 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:59.846587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:59.846690 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:59.846803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:47:59.847040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:59.847212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.847748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:59.847748 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.847748 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:59.847748 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.847748 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.847748 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:59.847748 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.847748 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:59.848478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.848478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:59.848478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:59.848478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:59.848478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.848478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:59.848478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:59.848478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:59.848478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.848478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:59.848478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:59.848478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:59.848478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:59.848478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:59.848478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:59.848879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:59.848879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:59.848879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.848879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:59.848879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.848879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.848879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:59.848879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.848879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:59.849251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.849251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:59.849251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:59.849251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:59.849251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.849251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:59.849251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:59.849251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:47:59.849251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:59.849251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:59.849251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.849251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:59.849631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:59.849631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:59.849631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.849631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:59.849631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:59.849631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:59.849631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:59.849631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:59.849631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:59.849631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:59.849631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:59.849631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.849631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:59.849631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.850026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.850026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:59.850026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.850026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:59.850230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.850230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:59.850230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:59.850230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:59.850230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:59.850230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:59.850230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.850230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:59.850230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:59.850230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.850230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:59.850230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:59.850230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.850230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:59.850230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:59.850230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:59.850682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:59.851169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.851169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:59.851169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.851169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.851169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:59.851169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.851169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:59.852495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:59.852744 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:59.852851 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:59.852971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:59.854345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:59.854345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.854593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:59.854593 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.854593 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:59.854593 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.854593 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.854593 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:59.854593 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.854593 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:59.855168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.855168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:47:59.855168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:59.855168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:59.855168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.855168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:59.855168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:59.855168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:59.855168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.855168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:47:59.855168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:59.855168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:47:59.855168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:59.855168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:47:59.855168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:47:59.855730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:59.855730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:47:59.855730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.855730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:47:59.855730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.855730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.855730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:47:59.855730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.855730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:47:59.856461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.856461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:59.856461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:59.856461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:59.856461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.856461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:59.856461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:59.856461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:59.856461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:59.856461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.856461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:59.856832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:59.856832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:59.856832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.856832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:59.856832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:59.856832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:59.856832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:59.856832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:59.856832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:59.856832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:59.856832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:59.856832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.856832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:59.856832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.857297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.857297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:59.857297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.857297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.857744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:59.858351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.858955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.858955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:59.858955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.858955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:47:59.949579 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:47:59.949995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:47:59.950193 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:47:59.950533 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:47:59.951593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:59.951839 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:47:59.952024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.952987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:47:59.952987 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.952987 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:47:59.952987 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.952987 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.952987 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:47:59.952987 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.952987 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:47:59.954478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.954478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:47:59.954478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:59.954478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:47:59.954478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.954478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:59.954478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:59.954478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.954478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:59.954478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:59.954478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:59.954478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.955250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:47:59.955250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:59.955250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:47:59.955250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:59.955250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:47:59.955250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:47:59.955250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:59.955250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:47:59.955250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.955250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:47:59.955250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.955250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.955250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:47:59.956152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.956152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:47:59.956523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.956523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:47:59.956523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:47:59.956523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:47:59.956523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:47:59.956523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:47:59.956523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.956523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:47:59.956523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:47:59.956523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.956523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:47:59.956523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:47:59.956523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.956523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:47:59.956523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:47:59.956523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:47:59.957523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:47:59.958937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:47:59.958937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:47:59.958937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:04.755866 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:04.756829 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:04.756829 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:04.757933 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:04.789731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:04.790028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.790711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:04.790711 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.790711 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:04.790711 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.790711 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.790711 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:04.790711 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.790711 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:04.791716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.791716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:04.791716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:04.791716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:04.791716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.791716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:04.791716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:04.791716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.791716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:04.791716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:04.791716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:04.791716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.792412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:04.792412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:04.792412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:04.792412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:04.792412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:04.792412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:04.792412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:04.792412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:04.792412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.792412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:04.792412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.792412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.792412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:04.793769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.793769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:04.793769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.793769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:04.793769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:04.793769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:04.793769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:04.793769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:04.793769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.793769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:04.793769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:04.793769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.793769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:04.793769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:04.793769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:04.794244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.794806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:04.794806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.794806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.794806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:04.794806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.794806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:04.838745 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:04.839258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:04.839460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:04.840544 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:04.840900 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:04.841185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.842204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:04.842204 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.842204 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:04.842204 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.842204 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.842204 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:04.842204 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.842204 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:04.843756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.843756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:04.843756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:04.843756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:04.843756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.843756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:04.843756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:04.843756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.843756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:04.843756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:04.843756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:04.843756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.844481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:04.844481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:04.844481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:04.844481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:04.844481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:04.844481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:04.844481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:04.844481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:04.844481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.844481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:04.844481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.844481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.844481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:04.845082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.845082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:04.845320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.845320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:04.845320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:04.845320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:04.845320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:04.845320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:04.845320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.845320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:04.845320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:04.845320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.845320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:04.845320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:04.845320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.845320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:04.845320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:04.845320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.846035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.846527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:04.846527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.846527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:04.846875 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:04.847308 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:04.847308 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:04.847431 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:48:04.847971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:04.848175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.848918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:04.848918 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.848918 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:04.848918 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.848918 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.848918 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:04.848918 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.848918 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:04.849676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.849676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:04.849676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:04.849676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:04.849676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.849676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:04.849676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:04.849676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:04.849676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.849676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:04.849676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:04.849676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:04.849676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:04.849676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:04.849676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:04.850380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:04.850380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:04.850380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.850380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:04.850380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.850380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.850380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:04.850380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.850380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:04.850683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.850683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:04.850683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:04.850683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:04.850683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.850683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:04.850683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:04.850683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:48:04.850683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:04.850683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:04.850683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.850683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:04.851034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:04.851034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:04.851034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.851034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:04.851034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:04.851034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:04.851034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:04.851034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:04.851034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:04.851034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:04.851034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:04.851034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.851034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:04.851034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.851428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.851428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:04.851428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.851428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:04.851428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.851428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:04.851428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:04.851428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:04.851428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:04.851428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:04.851428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.851428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:04.851428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:04.851428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:04.851813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:04.852345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:04.852345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:04.852345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:04.852345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:04.852345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:04.852345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.852345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:04.852345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.852345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.852345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:04.852345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.852345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:04.853092 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:04.853174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:04.853219 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:04.853354 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:04.853941 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:04.854378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.855088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:04.855088 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.855088 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:04.855088 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.855088 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.855088 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:04.855088 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.855088 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:04.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:04.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:04.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:04.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:04.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:04.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:04.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:04.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:04.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:04.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:04.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:04.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:04.856211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:04.856211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:04.856211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.856211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:04.856211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.856211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.856211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:04.856211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.856211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:04.856975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.856975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:04.856975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:04.856975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:04.856975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.856975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:04.856975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:04.856975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:04.856975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:04.856975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.856975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:04.857200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:04.857200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:04.857200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.857200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:04.857200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:04.857200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:04.857200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:04.857200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:04.857200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:04.857200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:04.857200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:04.857200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.857200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:04.857200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.857493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.857493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:04.857493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.857493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.858035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:04.858357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.858700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.858700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:04.858700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.858700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:04.950703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:04.951012 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:04.951212 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:04.951528 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:04.952135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:04.952977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:04.952977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.953488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:04.953488 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.953488 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:04.953488 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.953488 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.953488 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:04.953488 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.953488 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:04.954785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.954785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:04.954785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:04.954785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:04.954785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.954785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:04.954785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:04.954785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.954785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:04.954785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:04.954785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:04.954785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.955200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:04.955200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:04.955200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:04.955200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:04.955200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:04.955200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:04.955200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:04.955200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:04.955200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.955200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:04.955200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.955200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.955200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:04.955566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.955566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:04.955983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.955983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:04.955983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:04.955983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:04.955983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:04.955983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:04.955983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.955983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:04.955983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:04.955983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.955983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:04.955983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:04.955983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.955983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:04.955983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:04.955983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:04.956467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:04.956989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:04.956989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:04.956989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:09.756614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:09.757444 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:09.757444 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:09.759278 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:09.790391 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:09.790775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.791767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:09.791767 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.791767 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:09.791767 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.791767 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.791767 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:09.791767 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.791767 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:09.793064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.793064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:09.793064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:09.793064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:09.793064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.793064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:09.793064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:09.793064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.793064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:09.793064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:09.793064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:09.793064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.793852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:09.793852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:09.793852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:09.793852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:09.793852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:09.793852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:09.793852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:09.793852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:09.793852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.793852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:09.793852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.793852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.793852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:09.794573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.794573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:09.794573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.794573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:09.794573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:09.794573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:09.794573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:09.794573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:09.794573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.794573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:09.794573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:09.794573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.794573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:09.794573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:09.794573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:09.795391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.796345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:09.796345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.796345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.796345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:09.796345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.796345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:09.839403 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:09.839969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:09.840161 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:09.841165 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:09.841662 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:09.841967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.842827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:09.842827 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.842827 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:09.842827 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.842827 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.842827 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:09.842827 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.842827 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:09.844297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.844297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:09.844297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:09.844297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:09.844297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.844297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:09.844297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:09.844297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.844297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:09.844297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:09.844297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:09.844297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.844898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:09.844898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:09.844898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:09.844898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:09.844898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:09.844898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:09.844898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:09.844898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:09.844898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.844898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:09.844898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.844898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.844898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:09.845552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.845552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:09.845997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.845997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:09.845997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:09.845997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:09.845997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:09.845997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:09.845997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.845997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:09.845997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:09.845997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.845997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:09.845997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:09.845997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.845997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:09.845997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:09.845997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.846740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.847679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:09.847679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.847679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:09.847679 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:09.847679 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:09.847679 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:09.847679 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:48:09.848301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:09.848701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.849503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:09.849503 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.849503 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:09.849503 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.849503 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.849503 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:09.849503 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.849503 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:09.850388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.850388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:09.850388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:09.850388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:09.850388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.850388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:09.850388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:09.850388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:09.850388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.850388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:09.850388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:09.850388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:09.850388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:09.850388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:09.850388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:09.850877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:09.850877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:09.850877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.850877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:09.850877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.850877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.850877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:09.850877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.850877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:09.851303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.851303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:09.851303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:09.851303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:09.851303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.851303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:09.851303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:09.851303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:48:09.851303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:09.851303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:09.851303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.851303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:09.851767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:09.851767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:09.851767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.851767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:09.851767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:09.851767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:09.851767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:09.851767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:09.851767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:09.851767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:09.851767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:09.851767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.851767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:09.851767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.852168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.852168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:09.852168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.852168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:09.852569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.852569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:09.852569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:09.852569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:09.852569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:09.852569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:09.852569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.852569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:09.852569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:09.852569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.852569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:09.852569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:09.852569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.852569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:09.852569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:09.852569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:09.853193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:09.854018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.854018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:09.854018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.854018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.854018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:09.854018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.854018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:09.854018 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:09.854018 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:09.854018 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:09.854339 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:09.854339 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:09.854629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.855207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:09.855207 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.855207 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:09.855207 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.855207 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.855207 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:09.855207 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.855207 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:09.855990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.855990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:09.855990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:09.855990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:09.855990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.855990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:09.855990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:09.855990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:09.855990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.855990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:09.855990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:09.855990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:09.855990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:09.855990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:09.855990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:09.856400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:09.856400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:09.856400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.856400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:09.856400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.856400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.856400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:09.856400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.856400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:09.856911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.856911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:09.856911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:09.856911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:09.856911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.856911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:09.856911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:09.856911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:09.856911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:09.856911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.856911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:09.857255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:09.857255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:09.857255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.857255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:09.857255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:09.857255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:09.857255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:09.857255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:09.857255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:09.857255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:09.857255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:09.857255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.857255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:09.857255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.857684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.857684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:09.857684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.857684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.858015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:09.858516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.859078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.859078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:09.859078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.859078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:09.951476 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:09.951812 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:09.951936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:09.952214 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:09.952954 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:09.953384 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:09.953720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.954632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:09.954632 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.954632 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:09.954632 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.954632 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.954632 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:09.954632 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.954632 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:09.956042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.956042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:09.956042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:09.956042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:09.956042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.956042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:09.956042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:09.956042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.956042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:09.956042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:09.956042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:09.956042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.956645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:09.956645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:09.956645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:09.956645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:09.956645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:09.956645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:09.956645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:09.956645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:09.956645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.956645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:09.956645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.956645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.956645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:09.957186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.957186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:09.957842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.957842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:09.957842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:09.957842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:09.957842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:09.957842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:09.957842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.957842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:09.957842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:09.957842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.957842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:09.957842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:09.957842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.957842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:09.957842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:09.957842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:09.958621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:09.959523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:09.959523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:09.959523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:14.757393 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:14.758132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:14.758288 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:14.759694 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:14.792216 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:14.792971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.793733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:14.793733 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.793733 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:14.793733 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.793733 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.793733 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:14.793733 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.793733 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:14.794754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.794754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:14.794754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:14.794754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:14.794754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.794754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:14.794754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:14.794754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.794754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:14.794754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:14.794754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:14.794754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.795482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:14.795482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:14.795482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:14.795482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:14.795482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:14.795482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:14.795482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:14.795482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:14.795482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.795482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:14.795482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.795482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.795482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:14.796626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.796626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:14.796626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.796626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:14.796626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:14.796626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:14.796626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:14.796626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:14.796626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.796626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:14.796626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:14.796626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.796626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:14.796626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:14.796626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:14.798636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.800331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:14.800331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.800331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.800331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:14.800331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.800331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:14.840100 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:14.840583 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:14.840761 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:14.841869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:14.842199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:14.842490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.843386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:14.843386 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.843386 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:14.843386 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.843386 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.843386 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:14.843386 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.843386 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:14.844976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.844976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:14.844976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:14.844976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:14.844976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.844976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:14.844976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:14.844976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.844976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:14.844976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:14.844976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:14.844976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.845348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:14.845348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:14.845348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:14.845348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:14.845348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:14.845348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:14.845348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:14.845348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:14.845348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.845348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:14.845348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.845348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.845348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:14.845713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.845713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:14.846641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.846641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:14.846641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:14.846641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:14.846641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:14.846641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:14.846641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.846641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:14.846641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:14.846641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.846641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:14.846641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:14.846641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.846641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:14.846641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:14.846641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.847108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.847694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:14.847694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.847694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:14.847694 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:14.848047 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:14.848254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:14.848480 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:48:14.848979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:14.849284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.850060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:14.850060 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.850060 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:14.850060 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.850060 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.850060 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:14.850060 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.850060 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:14.851333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.851333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:14.851333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:14.851333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:14.851333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.851333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:14.851333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:14.851333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:14.851333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.851333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:14.851333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:14.851333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:14.851333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:14.851333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:14.851333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:14.851855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:14.851855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:14.851855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.851855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:14.851855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.851855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.851855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:14.851855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.851855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:14.852780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.852780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:14.852780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:14.852780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:14.852780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.852780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:14.852780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:14.852780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:48:14.852780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:14.852780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:14.852780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.852780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:14.853136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:14.853136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:14.853136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.853136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:14.853136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:14.853136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:14.853136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:14.853136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:14.853136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:14.853136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:14.853136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:14.853136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.853136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:14.853136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.853549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.853549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:14.853549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.853549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:14.854645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.854645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:14.854645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:14.854645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:14.854645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:14.854645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:14.854645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.854645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:14.854645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:14.854645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.854645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:14.854645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:14.854645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.854645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:14.854645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:14.854645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:14.855304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:14.855867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.855867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:14.855867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.855867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.855867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:14.855867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.855867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:14.855867 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:14.855867 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:14.855867 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:14.856173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:14.856173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:14.856248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.856774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:14.856774 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.856774 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:14.856774 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.856774 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.856774 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:14.856774 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.856774 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:14.857507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.857507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:14.857507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:14.857507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:14.857507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.857507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:14.857507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:14.857507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:14.857507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.857507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:14.857507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:14.857507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:14.857507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:14.857507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:14.857507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:14.857976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:14.857976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:14.857976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.857976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:14.857976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.857976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.857976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:14.857976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.857976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:14.858326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.858326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:14.858326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:14.858326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:14.858326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.858326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:14.858326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:14.858326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:14.858326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:14.858326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.858326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:14.858758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:14.858758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:14.858758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.858758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:14.858758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:14.858758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:14.858758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:14.858758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:14.858758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:14.858758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:14.858758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:14.858758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.858758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:14.858758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.859158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.859158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:14.859158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.859158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.859334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:14.859986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.860564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.860564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:14.860564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.860564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:14.951870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:14.952305 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:14.952427 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:14.952652 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:14.953309 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:14.953774 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:14.954032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.954907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:14.954907 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.954907 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:14.954907 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.954907 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.954907 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:14.954907 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.954907 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:14.955999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.955999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:14.955999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:14.955999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:14.955999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.955999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:14.955999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:14.955999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.955999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:14.955999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:14.955999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:14.955999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.956613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:14.956613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:14.956613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:14.956613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:14.956613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:14.956613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:14.956613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:14.956613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:14.956613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.956613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:14.956613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.956613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.956613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:14.957111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.957111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:14.957279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.957279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:14.957279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:14.957279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:14.957279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:14.957279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:14.957279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.957279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:14.957279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:14.957279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.957279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:14.957279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:14.957279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.957279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:14.957279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:14.957279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:14.957864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:14.958449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:14.958449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:14.958449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:19.758035 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:19.758981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:19.758981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:19.759854 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:19.790930 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:19.791313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.792310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:19.792310 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.792310 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:19.792310 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.792310 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.792310 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:19.792310 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.792310 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:19.793498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.793498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:19.793498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:19.793498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:19.793498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.793498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:19.793498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:19.793498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.793498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:19.793498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:19.793498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:19.793498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.794115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:19.794115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:19.794115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:19.794115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:19.794115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:19.794115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:19.794115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:19.794115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:19.794115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.794115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:19.794115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.794115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.794115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:19.794807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.794807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:19.794807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.794807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:19.794807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:19.794807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:19.794807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:19.794807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:19.794807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.794807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:19.794807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:19.794807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.794807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:19.794807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:19.794807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:19.795571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.797947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:19.797947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.797947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.797947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:19.797947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.797947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:19.840994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:19.841321 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:19.841441 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:19.842280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:19.842843 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:19.842843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.843301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:19.843301 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.843301 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:19.843301 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.843301 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.843301 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:19.843301 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.843301 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:19.844315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.844315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:19.844315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:19.844315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:19.844315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.844315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:19.844315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:19.844315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.844315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:19.844315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:19.844315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:19.844315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.844978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:19.844978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:19.844978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:19.844978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:19.844978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:19.844978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:19.844978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:19.844978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:19.844978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.844978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:19.844978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.844978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.844978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:19.845987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.845987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:19.845987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.845987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:19.845987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:19.845987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:19.845987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:19.845987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:19.845987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.845987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:19.845987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:19.845987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.845987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:19.845987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:19.845987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:19.846718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.847898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:19.847898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.847898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.847898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:19.847898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.847898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:19.848174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:19.848763 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:19.849012 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:19.849218 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:48:19.849611 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:19.849868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.850539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:19.850539 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.850539 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:19.850539 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.850539 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.850539 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:19.850539 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.850539 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:19.851555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.851555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:19.851555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:19.851555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:19.851555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.851555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:19.851555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:19.851555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:19.851555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.851555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:19.851555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:19.851555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:19.851555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:19.851555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:19.851555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:19.851909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:19.851909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:19.851909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.851909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:19.851909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.851909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.851909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:19.851909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.851909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:19.852428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.852428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:19.852428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:19.852428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:19.852428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.852428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:19.852428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:19.852428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:48:19.852428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:19.852428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:19.852428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.852428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:19.852753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:19.852753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:19.852753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.852753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:19.852753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:19.852753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:19.852753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:19.852753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:19.852753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:19.852753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:19.852753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:19.852753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.852753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:19.852753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.853022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.853022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:19.853022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.853022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:19.853609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.853609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:19.853609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:19.853609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:19.853609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:19.853609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:19.853609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.853609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:19.853609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:19.853609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.853609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:19.853609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:19.853609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.853609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:19.853609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:19.853609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:19.853922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:19.854266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.854266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:19.854266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.854266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.854266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:19.854266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.854266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:19.855156 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:19.855495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:19.855607 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:19.855787 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:19.856202 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:19.856506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.857156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:19.857156 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.857156 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:19.857156 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.857156 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.857156 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:19.857156 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.857156 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:19.857990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.857990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:19.857990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:19.857990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:19.857990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.857990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:19.857990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:19.857990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:19.857990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.857990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:19.857990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:19.857990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:19.857990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:19.857990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:19.857990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:19.858676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:19.858676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:19.858676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.858676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:19.858676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.858676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.858676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:19.858676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.858676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:19.858985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.858985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:19.858985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:19.858985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:19.858985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.858985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:19.858985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:19.858985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:19.858985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:19.858985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.858985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:19.859321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:19.859321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:19.859321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.859321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:19.859321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:19.859321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:19.859321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:19.859321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:19.859321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:19.859321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:19.859321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:19.859321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.859321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:19.859321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:19.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.860196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:19.860705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.861206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.861206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:19.861206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.861206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:19.952469 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:19.953210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:19.953933 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:19.953933 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:19.954768 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:19.954957 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:19.955488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.959425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:19.959425 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.959425 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:19.959425 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.959425 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.959425 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:19.959425 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.959425 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:19.959425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.959425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:19.959425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:19.959425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:19.959425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.959425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:19.959425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:19.960481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.960481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:19.960481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:19.960481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:19.960481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.960481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:19.960481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:19.960481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:19.960481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:19.960481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:19.960481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:19.960481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:19.960481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:19.960481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.961112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:19.961112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.961112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.961112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:19.961112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.961112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:19.961112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.961112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:19.961112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:19.961112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:19.961112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:19.961112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:19.961112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.961112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:19.961622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:19.962169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:19.962169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:19.962169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:19.962169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:19.962169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:19.962169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:19.962169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:19.962169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:19.962169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:19.962169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:24.758987 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:24.759967 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:24.760279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:24.761585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:24.792867 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:24.793155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.793897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:24.793897 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.793897 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:24.793897 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.793897 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.793897 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:24.793897 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.793897 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:24.794667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.794667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:24.794667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:24.794667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:24.794667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.794667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:24.794667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:24.794667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.794667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:24.794667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:24.794667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:24.794667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.794992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:24.794992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:24.794992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:24.794992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:24.794992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:24.794992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:24.794992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:24.794992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:24.794992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.794992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:24.794992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.794992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.794992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:24.795337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.795337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:24.795420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.795420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:24.795420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:24.795420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:24.795420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:24.795420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:24.795420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.795420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:24.795420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:24.795420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.795420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:24.795420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:24.795420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.795420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:24.795420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:24.795420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.795859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.796682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:24.796682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.796682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:24.841571 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:24.842338 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:24.842591 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:24.843839 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:24.844193 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:24.844529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:24.845622 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.845622 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:24.845622 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.845622 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.845622 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:24.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.845622 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:24.846828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.846828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:24.846828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:24.846828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:24.846828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.846828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:24.846828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:24.846828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.846828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:24.846828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:24.846828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:24.846828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.847928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:24.847928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:24.847928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:24.847928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:24.847928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:24.847928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:24.847928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:24.847928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:24.847928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.847928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:24.847928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.847928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.847928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:24.849221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.849221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:24.849221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.849221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:24.849221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:24.849221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:24.849221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:24.849221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:24.849221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.849221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:24.849221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:24.849221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.849221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:24.849221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:24.849221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:24.849825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.850325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:24.850325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.850325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.850325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:24.850325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.850325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:24.850325 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:24.850325 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:24.850325 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:24.850325 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:48:24.850627 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:24.850627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.851160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:24.851160 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.851160 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:24.851160 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.851160 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.851160 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:24.851160 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.851160 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:24.852061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.852061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:24.852061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:24.852061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:24.852061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.852061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:24.852061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:24.852061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:24.852061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.852061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:24.852061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:24.852061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:24.852061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:24.852061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:24.852061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:24.853325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:24.853325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:24.853325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.853325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:24.853325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.853325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.853325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:24.853325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.853325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:24.853325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.853325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:24.853325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:24.853325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:24.853325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.854447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:24.854447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:24.854447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:48:24.854447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:24.854447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:24.854447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.854447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:24.854447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:24.854447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:24.854447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.854447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:24.854447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:24.854447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:24.855164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:24.855164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:24.855164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:24.855164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:24.855164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:24.855164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.855164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:24.855164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.855164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.855164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:24.855164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.855164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:24.855503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.855503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:24.855503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:24.855503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:24.855503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:24.855503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:24.855503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.855503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:24.855503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:24.855503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.855503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:24.855503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:24.855503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.855503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:24.855503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:24.855503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:24.855949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:24.857210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.857210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:24.857210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.857210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.857210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:24.857210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.857210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:24.857210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:24.857210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:24.857210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:24.857868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:24.857868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:24.857868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.857868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:24.857868 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.857868 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:24.857868 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.857868 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.857868 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:24.857868 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.857868 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:24.858673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.858673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:24.858673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:24.858673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:24.858673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.858673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:24.858673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:24.858673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:24.858673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.858673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:24.858673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:24.858673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:24.858673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:24.858673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:24.858673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:24.859952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:24.859952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:24.859952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.859952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:24.859952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.859952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.859952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:24.859952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.859952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:24.860402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.860402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:24.860402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:24.860402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:24.860402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.860402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:24.860402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:24.860402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:24.860402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:24.860402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.860402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:24.860939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:24.860939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:24.860939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.860939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:24.860939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:24.860939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:24.860939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:24.860939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:24.860939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:24.860939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:24.860939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:24.860939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.860939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:24.860939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.861523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.861523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:24.861523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.861523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:24.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.862538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.862538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:24.862538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.862538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:24.953296 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:24.954129 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:24.954343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:24.954683 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:24.955452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:24.955922 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:24.956150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.957178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:24.957178 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.957178 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:24.957178 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.957178 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.957178 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:24.957178 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.957178 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:24.958813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.958813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:24.958813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:24.958813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:24.958813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.958813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:24.958813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:24.958813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.958813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:24.958813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:24.958813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:24.958813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.959114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:24.959114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:24.959114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:24.959114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:24.959114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:24.959114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:24.959114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:24.959114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:24.959114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.959114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:24.959114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.959114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.959114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:24.959447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.959447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:24.960529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.960529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:24.960529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:24.960529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:24.960529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:24.960529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:24.960529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.960529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:24.960529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:24.960529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.960529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:24.960529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:24.960529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.960529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:24.960529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:24.960529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:24.960964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:24.961447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:24.961447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:24.961447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:29.759811 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:29.760851 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:29.760851 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:29.761423 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:29.797108 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:29.797512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.798649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:29.798649 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.798649 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:29.798649 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.798649 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.798649 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:29.798649 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.798649 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:29.799731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.799731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:29.799731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:29.799731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:29.799731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.799731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:29.799731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:29.799731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.799731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:29.799731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:29.799731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:29.799731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.800338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:29.800338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:29.800338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:29.800338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:29.800338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:29.800338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:29.800338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:29.800338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:29.800338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.800338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:29.800338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.800338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.800338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:29.801016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.801016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:29.801276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.801276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:29.801276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:29.801276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:29.801276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:29.801276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:29.801276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.801276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:29.801276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:29.801276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.801276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:29.801276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:29.801276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.801276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:29.801276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:29.801276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.801823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.802428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:29.802428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.802428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:29.842253 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:29.842973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:29.843191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:29.844333 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:29.844717 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:29.844971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.845908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:29.845908 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.845908 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:29.845908 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.845908 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.845908 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:29.845908 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.845908 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:29.847560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.847560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:29.847560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:29.847560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:29.847560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.847560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:29.847560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:29.847560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.847560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:29.847560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:29.847560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:29.847560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.848267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:29.848267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:29.848267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:29.848267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:29.848267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:29.848267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:29.848267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:29.848267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:29.848267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.848267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:29.848267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.848267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.848267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:29.848906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.848906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:29.849316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.849316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:29.849316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:29.849316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:29.849316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:29.849316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:29.849316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.849316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:29.849316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:29.849316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.849316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:29.849316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:29.849316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.849316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:29.849316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:29.849316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.850038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.850874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:29.850874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.850874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:29.850874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:29.850874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:29.850874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:29.850874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:48:29.850874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:29.851283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.851800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:29.851800 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.851800 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:29.851800 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.851800 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.851800 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:29.851800 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.851800 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:29.852634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.852634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:29.852634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:29.852634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:29.852634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.852634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:29.852634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:29.852634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:29.852634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.852634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:29.852634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:29.852634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:29.852634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:29.852634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:29.852634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:29.853098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:29.853098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:29.853098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.853098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:29.853098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.853098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.853098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:29.853098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.853098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:29.853490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.853490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:29.853490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:29.853490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:29.853490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.853490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:29.853490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:29.853490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:48:29.853490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:29.853490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:29.853490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.853490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:29.853850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:29.853850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:29.853850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.853850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:29.853850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:29.853850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:29.853850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:29.853850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:29.853850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:29.853850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:29.853850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:29.853850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.853850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:29.853850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.854232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.854232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:29.854232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.854232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:29.854511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.854511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:29.854511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:29.854511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:29.854511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:29.854511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:29.854511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.854511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:29.854511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:29.854511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.854511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:29.854511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:29.854511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.854511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:29.854511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:29.854511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:29.854945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:29.855453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.855453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:29.855453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.855453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.855453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:29.855453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.855453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:29.856022 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:29.856287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:29.856423 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:29.856557 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:29.857013 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:29.857435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.858144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:29.858144 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.858144 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:29.858144 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.858144 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.858144 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:29.858144 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.858144 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:29.858912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.858912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:29.858912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:29.858912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:29.858912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.858912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:29.858912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:29.858912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:29.858912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.858912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:29.858912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:29.858912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:29.858912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:29.858912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:29.858912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:29.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:29.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:29.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:29.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:29.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:29.859850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.859850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:29.859850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:29.859850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:29.859850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.859850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:29.859850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:29.859850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:29.859850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:29.859850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.859850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:29.860212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:29.860212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:29.860212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.860212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:29.860212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:29.860212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:29.860212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:29.860212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:29.860212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:29.860212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:29.860212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:29.860212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.860212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:29.860212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.860927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.860927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:29.860927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.860927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:29.860927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.860927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:29.860927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:29.860927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:29.860927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:29.860927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:29.860927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.860927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:29.860927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:29.860927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:29.861324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:29.862066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:29.862066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:29.862066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:29.862066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:29.862066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.862066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:29.862066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.862066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.862066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:29.862066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.862066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:29.954023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:29.954562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:29.954744 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:29.955000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:29.955728 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:29.956153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:29.956396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.957249 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:29.957249 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.957249 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:29.957249 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.957249 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.957249 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:29.957249 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.957249 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:29.958661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.958661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:29.958661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:29.958661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:29.958661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.958661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:29.958661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:29.958661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.958661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:29.958661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:29.958661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:29.958661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.959258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:29.959258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:29.959258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:29.959258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:29.959258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:29.959258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:29.959258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:29.959258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:29.959258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.959258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:29.959258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.959258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.959258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:29.959811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.959811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:29.960293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.960293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:29.960293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:29.960293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:29.960293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:29.960293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:29.960293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.960293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:29.960293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:29.960293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.960293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:29.960293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:29.960293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.960293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:29.960293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:29.960293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:29.961014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:29.961843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:29.961843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:29.961843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:34.760768 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:34.761758 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:34.761758 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:34.762942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:34.797897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:34.798315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.799273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:34.799273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.799273 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:34.799273 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.799273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.799273 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:34.799273 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.799273 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:34.800134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.800134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:34.800134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:34.800134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:34.800134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.800134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:34.800134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:34.800134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.800134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:34.800134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:34.800134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:34.800134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.800906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:34.800906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:34.800906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:34.800906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:34.800906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:34.800906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:34.800906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:34.800906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:34.800906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.800906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:34.800906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.800906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.800906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:34.801625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.801625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:34.801625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.801625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:34.801625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:34.801625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:34.801625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:34.801625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:34.801625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.801625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:34.801625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:34.801625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.801625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:34.801625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:34.801625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:34.802459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.803638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:34.803638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.803638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.803638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:34.803638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.803638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:34.843033 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:34.843509 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:34.843702 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:34.844721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:34.845126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:34.845483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.846385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:34.846385 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.846385 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:34.846385 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.846385 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.846385 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:34.846385 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.846385 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:34.848250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.848250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:34.848250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:34.848250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:34.848250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.848250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:34.848250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:34.848250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.848250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:34.848250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:34.848250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:34.848250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.848972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:34.848972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:34.848972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:34.848972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:34.848972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:34.848972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:34.848972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:34.848972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:34.848972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.848972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:34.848972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.848972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.848972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:34.849586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.849586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:34.850203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.850203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:34.850203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:34.850203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:34.850203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:34.850203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:34.850203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.850203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:34.850203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:34.850203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.850203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:34.850203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:34.850203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.850203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:34.850203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:34.850203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.851039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.851870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:34.851870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.851870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:34.851870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:34.851870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:34.851870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:34.851870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:48:34.851870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:34.852271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.852910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:34.852910 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.852910 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:34.852910 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.852910 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.852910 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:34.852910 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.852910 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:34.853627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.853627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:34.853627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:34.853627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:34.853627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.853627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:34.853627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:34.853627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:34.853627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.853627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:34.853627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:34.853627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:34.853627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:34.853627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:34.853627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:34.854478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:34.854478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:34.854478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.854478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:34.854478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.854478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.854478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:34.854478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.854478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:34.856185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.856185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:34.856185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:34.856185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:34.856185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.856185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:34.856185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:34.856185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:48:34.856185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:34.856185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:34.856185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.856185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:34.856841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:34.856841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:34.856841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.856841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:34.856841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:34.856841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:34.856841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:34.856841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:34.856841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:34.856841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:34.856841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:34.856841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.856841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:34.856841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.857869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.857869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:34.857869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.857869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:34.857869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.857869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:34.857869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:34.857869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:34.857869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:34.857869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:34.857869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.857869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:34.857869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:34.857869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:34.858903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:34.860050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:34.860050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:34.860050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:34.860050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:34.860050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:34.860050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.860050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:34.860050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.860050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.860050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:34.860050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.860050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:34.860050 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:34.860050 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:34.860452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:34.860452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:34.860452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:34.860452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.860452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:34.860452 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.860452 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:34.860452 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.860452 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.860452 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:34.860452 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.860452 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:34.860790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.860790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:34.860790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:34.860790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:34.860790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.860790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:34.860790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:34.860790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:34.860790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.860790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:34.860790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:34.860790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:34.860790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:34.860790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:34.860790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:34.861194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:34.861194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:34.861194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.861194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:34.861194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.861194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.861194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:34.861194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.861194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:34.861194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.861194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:34.861194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:34.861194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:34.861194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.861595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:34.861595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:34.861595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:34.861595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:34.861595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.861595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:34.861595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:34.861595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:34.861595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.861595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:34.861595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:34.861595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:34.861595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:34.861943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:34.861943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:34.861943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:34.861943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:34.861943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.861943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:34.861943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.861943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.861943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:34.861943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.861943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:34.861943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:34.862257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.862757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:34.954649 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:34.955309 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:34.955663 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:34.955860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:34.956328 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:34.956644 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:34.956837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.957587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:34.957587 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.957587 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:34.957587 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.957587 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.957587 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:34.957587 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.957587 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:34.959099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.959099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:34.959099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:34.959099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:34.959099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.959099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:34.959099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:34.959099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.959099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:34.959099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:34.959099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:34.959099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.959485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:34.959485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:34.959485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:34.959485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:34.959485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:34.959485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:34.959485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:34.959485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:34.959485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.959485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:34.959485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.959485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.959485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:34.959840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.959840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:34.960932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.960932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:34.960932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:34.960932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:34.960932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:34.960932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:34.960932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.960932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:34.960932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:34.960932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.960932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:34.960932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:34.960932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.960932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:34.960932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:34.960932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:34.961769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:34.962626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:34.962626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:34.962626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:39.762117 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:39.763750 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:39.763860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:39.764517 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:39.805164 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:39.805462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.806064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:39.806064 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.806064 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:39.806064 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.806064 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.806064 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:39.806064 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.806064 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:39.807075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.807075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:39.807075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:39.807075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:39.807075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.807075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:39.807075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:39.807075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.807075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:39.807075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:39.807075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:39.807075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.807487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:39.807487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:39.807487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:39.807487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:39.807487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:39.807487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:39.807487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:39.807487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:39.807487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.807487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:39.807487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.807487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.807487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:39.808298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.808298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:39.808298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.808298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:39.808298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:39.808298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:39.808298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:39.808298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:39.808298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.808298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:39.808298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:39.808298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.808298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:39.808298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:39.808298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:39.808901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.809578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:39.809578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.809578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.809578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:39.809578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.809578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:39.843579 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:39.844076 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:39.844282 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:39.845288 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:39.845680 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:39.845914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.846827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:39.846827 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.846827 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:39.846827 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.846827 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.846827 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:39.846827 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.846827 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:39.848442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.848442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:39.848442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:39.848442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:39.848442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.848442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:39.848442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:39.848442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.848442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:39.848442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:39.848442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:39.848442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.849048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:39.849048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:39.849048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:39.849048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:39.849048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:39.849048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:39.849048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:39.849048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:39.849048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.849048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:39.849048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.849048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.849048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:39.849754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.849754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:39.850266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.850266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:39.850266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:39.850266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:39.850266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:39.850266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:39.850266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.850266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:39.850266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:39.850266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.850266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:39.850266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:39.850266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.850266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:39.850266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:39.850266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.851029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.851542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:39.851542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.851542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:39.851542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:39.851542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:39.851542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:39.851722 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:48:39.852088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:39.852385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.853258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:39.853258 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.853258 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:39.853258 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.853258 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.853258 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:39.853258 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.853258 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:39.854391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.854391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:39.854391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:39.854391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:39.854391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.854391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:39.854391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:39.854391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:39.854391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.854391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:39.854391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:39.854391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:39.854391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:39.854391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:39.854391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:39.855041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:39.855041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:39.855041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.855041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:39.855041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.855041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.855041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:39.855041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.855041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:39.855474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.855474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:39.855474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:39.855474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:39.855474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.855474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:39.855474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:39.855474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:48:39.855474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:39.855474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:39.855474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.855474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:39.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:39.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:39.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:39.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:39.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:39.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:39.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:39.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:39.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:39.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:39.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:39.855905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:39.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:39.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:39.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:39.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:39.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:39.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:39.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:39.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:39.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:39.856757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:39.857286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:39.857286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:39.857286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:39.857286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:39.857286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:39.857286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.857286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:39.857286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.857286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.857286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:39.857286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.857286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:39.857286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:39.857286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:39.858059 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:39.858059 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:39.858059 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:39.858059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.858646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:39.858646 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.858646 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:39.858646 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.858646 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.858646 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:39.858646 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.858646 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:39.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:39.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:39.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:39.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:39.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:39.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:39.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:39.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:39.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:39.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:39.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:39.859342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:39.859789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:39.859789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:39.859789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.859789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:39.859789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.859789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.859789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:39.859789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.859789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:39.860210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.860210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:39.860210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:39.860210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:39.860210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.860210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:39.860210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:39.860210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:39.860210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:39.860210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.860210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:39.860582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:39.860582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:39.860582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.860582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:39.860582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:39.860582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:39.860582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:39.860582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:39.860582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:39.860582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:39.860582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:39.860582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.860582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:39.860582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.861160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.861160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:39.861160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.861160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.861452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:39.862056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.862809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.862809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:39.862809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.862809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:39.955413 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:39.955936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:39.956121 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:39.956421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:39.957258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:39.957738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:39.957974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.958871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:39.958871 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.958871 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:39.958871 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.958871 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.958871 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:39.958871 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.958871 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:39.960543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.960543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:39.960543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:39.960543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:39.960543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.960543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:39.960543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:39.960543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.960543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:39.960543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:39.960543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:39.960543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.961116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:39.961116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:39.961116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:39.961116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:39.961116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:39.961116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:39.961116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:39.961116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:39.961116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.961116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:39.961116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.961116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.961116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:39.961687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.961687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:39.962260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.962260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:39.962260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:39.962260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:39.962260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:39.962260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:39.962260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.962260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:39.962260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:39.962260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.962260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:39.962260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:39.962260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.962260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:39.962260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:39.962260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:39.963010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:39.963936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:39.963936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:39.963936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:44.764000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:44.764897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:44.764897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:44.765766 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:44.802191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:44.802428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.803072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:44.803072 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.803072 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:44.803072 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.803072 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.803072 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:44.803072 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.803072 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:44.804290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.804290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:44.804290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:44.804290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:44.804290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.804290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:44.804290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:44.804290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.804290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:44.804290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:44.804290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:44.804290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.805033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:44.805033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:44.805033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:44.805033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:44.805033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:44.805033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:44.805033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:44.805033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:44.805033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.805033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:44.805033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.805033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.805033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:44.805717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.805717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:44.805838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.805838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:44.805838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:44.805838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:44.805838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:44.805838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:44.805838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.805838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:44.805838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:44.805838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.805838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:44.805838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:44.805838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.805838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:44.805838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:44.805838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.806674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.807880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:44.807880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.807880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:44.843968 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:44.844153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:44.844425 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:44.845123 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:44.845479 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:44.845718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.846556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:44.846556 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.846556 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:44.846556 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.846556 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.846556 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:44.846556 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.846556 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:44.847646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.847646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:44.847646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:44.847646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:44.847646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.847646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:44.847646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:44.847646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.847646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:44.847646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:44.847646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:44.847646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.848515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:44.848515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:44.848515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:44.848515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:44.848515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:44.848515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:44.848515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:44.848515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:44.848515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.848515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:44.848515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.848515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.848515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:44.849085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.849085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:44.849085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.849085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:44.849085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:44.849085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:44.849085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:44.849085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:44.849085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.849085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:44.849085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:44.849085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.849085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:44.849085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:44.849085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:44.849913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.850742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:44.850742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.850742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.850742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:44.850742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.850742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:44.851546 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:44.851944 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:44.852029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:44.852228 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:48:44.852732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:44.853033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.853871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:44.853871 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.853871 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:44.853871 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.853871 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.853871 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:44.853871 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.853871 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:44.854639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.854639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:44.854639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:44.854639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:44.854639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.854639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:44.854639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:44.854639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:44.854639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.854639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:44.854639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:44.854639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:44.854639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:44.854639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:44.854639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:44.855280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:44.855280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:44.855280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.855280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:44.855280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.855280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.855280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:44.855280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.855280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:44.855747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.855747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:44.855747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:44.855747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:44.855747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.855747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:44.855747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:44.855747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:48:44.855747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:44.855747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:44.855747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.855747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:44.856204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:44.856204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:44.856204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.856204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:44.856204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:44.856204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:44.856204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:44.856204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:44.856204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:44.856204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:44.856204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:44.856204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.856204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:44.856204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.856611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.856611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:44.856611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.856611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:44.857140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.857140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:44.857140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:44.857140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:44.857140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:44.857140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:44.857140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.857140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:44.857140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:44.857140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.857140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:44.857140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:44.857140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.857140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:44.857140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:44.857140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:44.857797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:44.858406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.858406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:44.858406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.858406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.858406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:44.858406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.858406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:44.858406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:44.858406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:44.858406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:44.858759 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:44.858759 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:44.859113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.859878 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:44.859878 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.859878 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:44.859878 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.859878 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.859878 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:44.859878 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.859878 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:44.860707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.860707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:44.860707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:44.860707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:44.860707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.860707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:44.860707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:44.860707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:44.860707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.860707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:44.860707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:44.860707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:44.860707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:44.860707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:44.860707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:44.861129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:44.861129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:44.861129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.861129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:44.861129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.861129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.861129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:44.861129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.861129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:44.861790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.861790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:44.861790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:44.861790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:44.861790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.861790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:44.861790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:44.861790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:44.861790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:44.861790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.861790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:44.862144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:44.862144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:44.862144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.862144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:44.862144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:44.862144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:44.862144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:44.862144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:44.862144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:44.862144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:44.862144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:44.862144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.862144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:44.862144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.862561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.862561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:44.862561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.862561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.863125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:44.863801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.864478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.864478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:44.864478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.864478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:44.955962 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:44.956403 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:44.956556 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:44.956786 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:44.957316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:44.957632 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:44.957794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.958417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:44.958417 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.958417 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:44.958417 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.958417 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.958417 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:44.958417 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.958417 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:44.959481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.959481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:44.959481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:44.959481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:44.959481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.959481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:44.959481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:44.959481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.959481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:44.959481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:44.959481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:44.959481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.960137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:44.960137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:44.960137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:44.960137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:44.960137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:44.960137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:44.960137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:44.960137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:44.960137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.960137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:44.960137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.960137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.960137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:44.960823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.960823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:44.960823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.960823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:44.960823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:44.960823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:44.960823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:44.960823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:44.960823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.960823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:44.960823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:44.960823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.960823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:44.960823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:44.960823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:44.961573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:44.962438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:44.962438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:44.962438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:44.962438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:44.962438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:44.962438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:49.764775 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:49.765548 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:49.765548 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:49.766630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:49.802204 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:49.802725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.803616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:49.803616 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.803616 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:49.803616 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.803616 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.803616 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:49.803616 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.803616 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:49.804312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.804312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:49.804312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:49.804312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:49.804312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.804312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:49.804312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:49.804312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.804312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:49.804312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:49.804312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:49.804312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.804748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:49.804748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:49.804748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:49.804748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:49.804748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:49.804748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:49.804748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:49.804748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:49.804748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.804748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:49.804748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.804748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.804748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:49.805098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.805098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:49.805341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.805341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:49.805341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:49.805341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:49.805341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:49.805341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:49.805341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.805341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:49.805341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:49.805341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.805341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:49.805341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:49.805341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.805341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:49.805341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:49.805341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.806246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.806864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:49.806864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.806864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:49.844659 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:49.844868 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:49.844935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:49.845804 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:49.846149 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:49.846399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.847619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:49.847619 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.847619 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:49.847619 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.847619 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.847619 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:49.847619 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.847619 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:49.848190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.848190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:49.848190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:49.848190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:49.848190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.848190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:49.848190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:49.848190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.848190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:49.848190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:49.848190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:49.848190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.848809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:49.848809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:49.848809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:49.848809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:49.848809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:49.848809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:49.848809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:49.848809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:49.848809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.848809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:49.848809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.848809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.848809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:49.849360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.849360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:49.849360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.849360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:49.849360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:49.849360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:49.849360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:49.849360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:49.849360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.849360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:49.849360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:49.849360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.849360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:49.849360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:49.849360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:49.850064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.850870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:49.850870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.850870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.850870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:49.850870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.850870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:49.852075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:49.852433 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:49.852643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:49.852804 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:48:49.853306 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:49.853637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.854699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:49.854699 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.854699 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:49.854699 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.854699 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.854699 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:49.854699 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.854699 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:49.856983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.856983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:49.856983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:49.856983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:49.856983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.856983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:49.856983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:49.856983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:49.856983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.856983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:49.856983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:49.856983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:49.856983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:49.856983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:49.856983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:49.857439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:49.857439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:49.857439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.857439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:49.857439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.857439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.857439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:49.857439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.857439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:49.858434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.858434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:49.858434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:49.858434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:49.858434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.858434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:49.858434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:49.858434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:48:49.858434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:49.858434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:49.858434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.858434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:49.858799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:49.858799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:49.858799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.858799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:49.858799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:49.858799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:49.858799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:49.858799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:49.858799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:49.858799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:49.858799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:49.858799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.858799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:49.858799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.859162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.859162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:49.859162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.859162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:49.859162 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:49.860957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.860957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:49.860957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:49.860957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:49.860957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:49.860957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:49.860957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.860957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:49.860957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:49.860957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.860957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:49.860957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:49.860957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.860957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:49.860957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:49.860957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:49.861404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:49.861909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.861909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:49.861909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.861909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.861909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:49.861909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.861909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:49.861909 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:49.861909 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:49.862157 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:49.862657 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:49.863013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.863749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:49.863749 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.863749 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:49.863749 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.863749 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.863749 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:49.863749 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.863749 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:49.864499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.864499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:49.864499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:49.864499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:49.864499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.864499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:49.864499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:49.864499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:49.864499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.864499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:49.864499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:49.864499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:49.864499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:49.864499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:49.864499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:49.864892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:49.864892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:49.864892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.864892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:49.864892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.864892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.864892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:49.864892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.864892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:49.865328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.865328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:49.865328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:49.865328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:49.865328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.865328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:49.865328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:49.865328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:49.865328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:49.865328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.865328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:49.865681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:49.865681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:49.865681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.865681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:49.865681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:49.865681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:49.865681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:49.865681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:49.865681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:49.865681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:49.865681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:49.865681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.865681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:49.865681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.866028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.866028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:49.866028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.866028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.866375 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:49.866854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.867408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.867408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:49.867408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.867408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:49.956643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:49.957076 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:49.957151 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:49.957323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:49.957968 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:49.958496 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:49.958741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.959504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:49.959504 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.959504 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:49.959504 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.959504 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.959504 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:49.959504 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.959504 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:49.960220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.960220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:49.960220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:49.960220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:49.960220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.960220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:49.960220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:49.960220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.960220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:49.960220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:49.960220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:49.960220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.960850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:49.960850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:49.960850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:49.960850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:49.960850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:49.960850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:49.960850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:49.960850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:49.960850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.960850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:49.960850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.960850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.960850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:49.961401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.961401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:49.961401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.961401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:49.961401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:49.961401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:49.961401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:49.961401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:49.961401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.961401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:49.961401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:49.961401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.961401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:49.961401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:49.961401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:49.962184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:49.963074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:49.963074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:49.963074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:49.963074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:49.963074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:49.963074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:54.765290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:54.765962 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:54.765962 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:54.767149 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:54.768813 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:48:54.800829 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:54.800993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.801431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:54.801431 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.801431 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:54.801431 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.801431 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.801431 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:54.801431 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.801431 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:54.802056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.802056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:54.802056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:54.802056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:54.802056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.802056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:54.802056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:54.802056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.802056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:54.802056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:54.802056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:54.802056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.802726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:54.802726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:54.802726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:54.802726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:54.802726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:54.802726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:54.802726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:54.802726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:54.802726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.802726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:54.802726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.802726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.802726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:54.803393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.803393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:54.803393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.803393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:54.803393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:54.803393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:54.803393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:54.803393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:54.803393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.803393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:54.803393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:54.803393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.803393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:54.803393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:54.803393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:54.804232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.805172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:54.805172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.805172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.805172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:54.805172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.805172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:54.845040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:54.845439 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:54.845697 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:54.846684 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:54.846999 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:54.847200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.848234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:54.848234 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.848234 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:54.848234 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.848234 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.848234 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:54.848234 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.848234 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:54.849791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.849791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:54.849791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:54.849791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:54.849791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.849791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:54.849791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:54.849791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.849791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:54.849791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:54.849791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:54.849791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.850488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:54.850488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:54.850488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:54.850488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:54.850488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:54.850488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:54.850488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:54.850488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:54.850488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.850488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:54.850488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.850488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.850488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:54.851052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.851052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:54.851751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.851751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:54.851751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:54.851751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:54.851751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:54.851751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:54.851751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.851751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:54.851751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:54.851751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.851751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:54.851751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:54.851751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.851751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:54.851751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:54.851751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.852501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.853323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:54.853323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.853323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:54.853323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:54.853323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:54.853323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:54.853323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:48:54.853755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:54.854057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.854899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:54.854899 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.854899 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:54.854899 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.854899 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.854899 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:54.854899 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.854899 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:54.855856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.855856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:54.855856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:54.855856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:54.855856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.855856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:54.855856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:54.855856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:54.855856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.855856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:54.855856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:54.855856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:54.855856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:54.855856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:54.855856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:54.856529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:54.856529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:54.856529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.856529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:54.856529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.856529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.856529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:54.856529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.856529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:54.856817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.856817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:54.856817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:54.856817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:54.856817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.856817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:54.856817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:54.856817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:48:54.856817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:54.856817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:54.856817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.856817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:54.857160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:54.857160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:54.857160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.857160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:54.857160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:54.857160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:54.857160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:54.857160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:54.857160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:54.857160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:54.857160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:54.857160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.857160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:54.857160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.857540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.857540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:54.857540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.857540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:54.857772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.857772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:54.857772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:54.857772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:54.857772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:54.857772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:54.857772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.857772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:54.857772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:54.857772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.857772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:54.857772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:54.857772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.857772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:54.857772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:54.857772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:54.858208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:54.858707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.858707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:54.858707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.858707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.858707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:54.858707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.858707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:54.861244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:54.861473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:54.861581 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:54.861701 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:54.862005 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:54.862224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.862732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:54.862732 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.862732 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:54.862732 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.862732 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.862732 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:54.862732 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.862732 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:54.863437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.863437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:54.863437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:54.863437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:54.863437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.863437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:54.863437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:54.863437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:54.863437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.863437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:54.863437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:54.863437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:54.863437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:54.863437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:54.863437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:54.863858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:54.863858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:54.863858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.863858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:54.863858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.863858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.863858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:54.863858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.863858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:54.864448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.864448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:54.864448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:54.864448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:54.864448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.864448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:54.864448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:54.864448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:54.864448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:54.864448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.864448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:54.864760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:54.864760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:54.864760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.864760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:54.864760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:54.864760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:54.864760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:54.864760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:54.864760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:54.864760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:54.864760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:54.864760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.864760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:54.864760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.865122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.865122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:54.865122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.865122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.865471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:54.865942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.866460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.866460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:54.866460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.866460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:54.957232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:54.957616 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:54.957713 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:54.957886 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:54.958224 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:54.958545 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:54.958787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.959618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:54.959618 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.959618 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:54.959618 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.959618 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.959618 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:54.959618 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.959618 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:54.960455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.960455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:54.960455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:54.960455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:54.960455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.960455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:54.960455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:54.960455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.960455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:54.960455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:54.960455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:54.960455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.961151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:54.961151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:54.961151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:54.961151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:54.961151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:54.961151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:54.961151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:54.961151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:54.961151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.961151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:54.961151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.961151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.961151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:54.961710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.961710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:54.961710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.961710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:54.961710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:54.961710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:54.961710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:54.961710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:54.961710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.961710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:54.961710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:54.961710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.961710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:54.961710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:54.961710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:54.962490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:54.963537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:54.963537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:54.963537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:54.963537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:54.963537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:54.963537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:59.765918 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:59.766827 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:59.766827 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:59.768046 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:59.804042 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:59.804465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.805339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:59.805339 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.805339 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:59.805339 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.805339 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.805339 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:59.805339 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.805339 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:59.806462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.806462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:59.806462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:59.806462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:59.806462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.806462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:59.806462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:59.806462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.806462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:59.806462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:59.806462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:59.806462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.807082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:59.807082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:59.807082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:59.807082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:59.807082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:59.807082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:59.807082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:59.807082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:59.807082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.807082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:59.807082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.807082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.807082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:59.807779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.807779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:59.807779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.807779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:59.807779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:59.807779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:59.807779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:59.807779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:59.807779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.807779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:59.807779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:59.807779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.807779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:59.807779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:59.807779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:59.808515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.809476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:59.809476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.809476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.809476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:59.809476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.809476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:59.845847 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:59.846411 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:59.846612 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:59.847579 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:59.847899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:59.848156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.848980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:59.848980 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.848980 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:59.848980 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.848980 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.848980 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:59.848980 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.848980 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:59.850662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.850662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:59.850662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:59.850662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:59.850662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.850662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:59.850662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:59.850662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.850662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:59.850662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:59.850662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:59.850662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.851265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:59.851265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:59.851265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:59.851265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:59.851265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:59.851265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:59.851265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:59.851265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:59.851265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.851265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:59.851265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.851265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.851265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:59.851847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.851847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:59.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:59.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:59.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:59.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:59.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:59.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:59.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:59.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:59.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:59.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:59.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:59.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.853340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.854304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:59.854304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.854304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:59.854304 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:59.854304 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:59.854304 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:59.854304 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:48:59.854304 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:59.854712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.855158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:59.855158 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.855158 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:59.855158 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.855158 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.855158 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:59.855158 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.855158 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:59.855950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.855950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:59.855950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:59.855950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:59.855950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.855950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:59.855950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:59.855950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:59.855950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.855950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:59.855950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:59.855950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:59.855950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:59.855950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:59.855950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:59.856411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:59.856411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:59.856411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.856411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:59.856411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.856411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.856411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:59.856411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.856411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:59.856942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.856942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:59.856942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:59.856942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:59.856942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.856942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:59.856942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:59.856942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:48:59.856942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:59.856942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:59.856942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.856942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:59.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:59.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:59.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:59.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:59.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:59.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:59.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:59.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:59.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:59.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:59.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:59.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.857688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.857688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:59.857688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.857688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:59.858126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.858126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:59.858126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:59.858126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:59.858126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:59.858126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:59.858126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.858126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:59.858126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:59.858126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.858126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:59.858126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:59.858126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.858126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:59.858126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:59.858126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:59.858558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:59.859034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.859034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:59.859034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.859034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.859034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:59.859034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.859034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:59.861764 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:59.862116 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:59.862285 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:59.862510 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:59.862967 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:59.863305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.864050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:59.864050 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.864050 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:59.864050 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.864050 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.864050 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:59.864050 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.864050 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:59.864864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.864864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:48:59.864864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:59.864864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:59.864864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.864864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:59.864864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:59.864864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:59.864864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.864864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:48:59.864864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:59.864864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:48:59.864864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:59.864864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:48:59.864864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:48:59.865236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:59.865236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:48:59.865236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.865236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:48:59.865236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.865236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.865236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:48:59.865236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.865236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:48:59.865881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.865881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:59.865881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:59.865881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:59.865881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.865881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:59.865881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:59.865881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:59.865881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:59.865881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.865881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:59.866200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:59.866200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:59.866200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.866200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:59.866200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:59.866200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:59.866200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:59.866200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:59.866200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:59.866200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:59.866200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:59.866200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.866200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:59.866200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.866559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.866559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:59.866559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.866559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:59.867522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.867999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.867999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:59.867999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.867999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:48:59.957942 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:48:59.958872 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:48:59.958975 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:48:59.959181 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:48:59.959785 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:59.960157 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:48:59.960385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.961185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:48:59.961185 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.961185 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:48:59.961185 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.961185 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.961185 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:48:59.961185 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.961185 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:48:59.962215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.962215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:48:59.962215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:59.962215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:48:59.962215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.962215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:59.962215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:59.962215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.962215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:59.962215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:59.962215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:59.962215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.962997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:48:59.962997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:59.962997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:48:59.962997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:59.962997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:48:59.962997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:48:59.962997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:59.962997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:48:59.962997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.962997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:48:59.962997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.962997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.962997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:48:59.963776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.963776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:48:59.963776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.963776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:48:59.963776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:48:59.963776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:48:59.963776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:48:59.963776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:48:59.963776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.963776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:48:59.963776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:48:59.963776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.963776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:48:59.963776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:48:59.963776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:48:59.964738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:48:59.965948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:48:59.965948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:48:59.965948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:48:59.965948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:48:59.965948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:48:59.965948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:04.766561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:04.767565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:04.767565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:04.768731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:04.806427 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:04.806786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.807626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:04.807626 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.807626 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:04.807626 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.807626 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.807626 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:04.807626 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.807626 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:04.808446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.808446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:04.808446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:04.808446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:04.808446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.808446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:04.808446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:04.808446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.808446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:04.808446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:04.808446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:04.808446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.809125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:04.809125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:04.809125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:04.809125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:04.809125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:04.809125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:04.809125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:04.809125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:04.809125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.809125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:04.809125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.809125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.809125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:04.809798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.809798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:04.809798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.809798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:04.809798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:04.809798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:04.809798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:04.809798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:04.809798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.809798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:04.809798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:04.809798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.809798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:04.809798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:04.809798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:04.810572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.811430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:04.811430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.811430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.811430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:04.811430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.811430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:04.847016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:04.847388 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:04.848085 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:04.848549 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:04.848891 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:04.849313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.850587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:04.850587 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.850587 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:04.850587 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.850587 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.850587 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:04.850587 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.850587 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:04.852101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.852101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:04.852101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:04.852101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:04.852101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.852101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:04.852101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:04.852101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.852101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:04.852101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:04.852101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:04.852101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.852809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:04.852809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:04.852809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:04.852809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:04.852809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:04.852809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:04.852809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:04.852809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:04.852809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.852809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:04.852809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.852809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.852809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:04.853456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.853456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:04.854122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.854122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:04.854122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:04.854122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:04.854122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:04.854122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:04.854122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.854122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:04.854122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:04.854122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.854122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:04.854122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:04.854122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.854122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:04.854122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:04.854122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.854910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.855963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:04.855963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.855963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:04.855963 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:04.855963 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:04.855963 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:04.855963 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:49:04.855963 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:04.856443 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.858775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:04.858775 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.858775 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:04.858775 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.858775 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.858775 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:04.858775 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.858775 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:04.860024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.860024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:04.860024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:04.860024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:04.860024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.860024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:04.860024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:04.860024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:04.860024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.860024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:04.860024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:04.860024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:04.860024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:04.860024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:04.860024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:04.860546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:04.860546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:04.860546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.860546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:04.860546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.860546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.860546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:04.860546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.860546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:04.860546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.860546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:04.860546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:04.860546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:04.860546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.860968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:04.860968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:04.860968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:49:04.860968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:04.860968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:04.860968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.860968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:04.860968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:04.860968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:04.860968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.860968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:04.860968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:04.860968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:04.861345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:04.861345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:04.861345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:04.861345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:04.861345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:04.861345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.861345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:04.861345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.861345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.861345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:04.861345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.861345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:04.861676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.861676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:04.861676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:04.861676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:04.861676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:04.861676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:04.861676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.861676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:04.861676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:04.861676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.861676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:04.861676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:04.861676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.861676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:04.861676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:04.861676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:04.862092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:04.863960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.863960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:04.863960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.863960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.863960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:04.863960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.863960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:04.863960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:04.863960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:04.863960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:04.865972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:04.865972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:04.865972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.865972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:04.865972 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.865972 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:04.865972 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.865972 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.865972 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:04.865972 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.865972 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:04.865972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:04.866295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.866623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:04.866623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.866623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.866623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:04.866623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.866623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:04.866623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.866623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:04.866623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:04.866623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:04.866623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.866623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:04.866623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:04.866876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:04.866876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:04.866876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.866876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:04.866876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:04.866876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:04.866876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.866876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:04.866876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:04.866876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:04.866876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:04.866876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:04.866876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:04.867101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:04.867101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:04.867101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.867101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:04.867101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.867101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.867101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:04.867101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.867101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:04.867101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.867101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:04.867101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.867322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.867682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:04.959265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:04.959836 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:04.960101 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:04.960481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:04.961177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:04.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:04.962142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.963232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:04.963232 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.963232 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:04.963232 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.963232 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.963232 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:04.963232 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.963232 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:04.964784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.964784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:04.964784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:04.964784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:04.964784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.964784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:04.964784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:04.964784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.964784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:04.964784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:04.964784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:04.964784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.965617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:04.965617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:04.965617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:04.965617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:04.965617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:04.965617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:04.965617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:04.965617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:04.965617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.965617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:04.965617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.965617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.965617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:04.966240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.966240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:04.966649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.966649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:04.966649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:04.966649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:04.966649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:04.966649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:04.966649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.966649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:04.966649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:04.966649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.966649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:04.966649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:04.966649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.966649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:04.966649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:04.966649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:04.967783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:04.969053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:04.969053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:04.969053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:09.781658 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:09.782591 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:09.782591 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:09.784280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:09.828200 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:09.828628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.829529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:09.829529 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.829529 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:09.829529 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.829529 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.829529 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:09.829529 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.829529 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:09.830440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.047 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.830440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:09.830440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:09.830440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:09.830440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.830440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:09.830440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:09.830440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.830440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:09.830440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:09.830440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:09.830440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.831073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:09.831073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:09.831073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:09.831073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:09.831073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:09.831073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:09.831073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:09.831073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:09.831073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.831073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:09.831073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.831073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.831073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:09.831950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.831950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:09.831950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.831950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:09.831950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:09.831950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:09.831950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:09.831950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:09.831950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.831950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:09.831950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:09.831950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.831950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:09.831950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:09.831950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:09.832784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:09.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:09.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.833744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:09.847762 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:09.848259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:09.848482 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:09.849405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:09.849766 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:09.850024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.850923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:09.850923 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.850923 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:09.850923 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.850923 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.850923 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:09.850923 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.850923 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:09.852389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.852389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:09.852389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:09.852389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:09.852389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.852389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:09.852389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:09.852389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.852389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:09.852389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:09.852389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:09.852389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.852974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:09.852974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:09.852974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:09.852974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:09.852974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:09.852974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:09.852974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:09.852974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:09.852974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.852974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:09.852974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.852974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.852974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:09.853537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.853537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:09.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:09.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:09.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:09.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:09.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:09.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:09.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:09.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:09.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:09.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:09.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:09.854185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.854985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.855644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:09.855644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.855644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:09.855644 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:09.856120 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:09.856312 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:09.856523 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:49:09.856995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:09.857268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.858058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:09.858058 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.858058 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:09.858058 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.858058 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.858058 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:09.858058 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.858058 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:09.859266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.859266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:09.859266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:09.859266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:09.859266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.859266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:09.859266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:09.859266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:09.859266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.859266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:09.859266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:09.859266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:09.859266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:09.859266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:09.859266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:09.859771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:09.859771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:09.859771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.859771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:09.859771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.859771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.859771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:09.859771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.859771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:09.860614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.860614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:09.860614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:09.860614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:09.860614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.860614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:09.860614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:09.860614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:49:09.860614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:09.860614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:09.860614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.860614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:09.860975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:09.860975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:09.860975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.860975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:09.860975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:09.860975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:09.860975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:09.860975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:09.860975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:09.860975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:09.860975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:09.860975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.860975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:09.860975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.861347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.861347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:09.861347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.861347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:09.862261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.862261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:09.862261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:09.862261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:09.862261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:09.862261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:09.862261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.862261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:09.862261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:09.862261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.862261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:09.862261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:09.862261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.862261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:09.862261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:09.862261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:09.862779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:09.863290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.863290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:09.863290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.863290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.863290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:09.863290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.863290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:09.863290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:09.863290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:09.863290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:09.863612 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:09.863783 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:09.864139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.864883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:09.864883 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.864883 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:09.864883 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.864883 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.864883 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:09.864883 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.864883 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:09.865507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.865507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:09.865507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:09.865507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:09.865507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.865507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:09.865507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:09.865507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:09.865507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.865507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:09.865507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:09.865507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:09.865507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:09.865507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:09.865507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:09.865924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:09.865924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:09.865924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.865924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:09.865924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.865924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.865924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:09.865924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.865924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:09.866463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.866463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:09.866463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:09.866463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:09.866463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.866463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:09.866463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:09.866463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:09.866463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:09.866463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.866463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:09.866851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:09.866851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:09.866851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.866851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:09.866851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:09.866851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:09.866851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:09.866851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:09.866851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:09.866851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:09.866851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:09.866851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.866851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:09.866851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.867233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.867233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:09.867233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.867233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:09.867233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.867233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:09.867233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:09.867233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:09.867233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:09.867233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:09.867233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.867233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:09.867233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:09.867233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:09.867677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:09.868183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:09.868183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:09.868183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:09.868183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:09.868183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.868183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:09.868183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.868183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.868183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:09.868183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.868183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:09.960004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:09.960783 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:09.961003 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:09.961297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:09.961926 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:09.962301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:09.962576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:09.963426 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.963426 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:09.963426 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.963426 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.963426 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:09.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:09.965113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.965113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:09.965113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:09.965113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:09.965113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.965113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:09.965113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:09.965113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.965113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:09.965113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:09.965113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:09.965113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.965875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:09.965875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:09.965875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:09.965875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:09.965875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:09.965875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:09.965875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:09.965875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:09.965875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.965875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:09.965875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.965875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.965875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:09.966435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.966435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:09.967033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.967033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:09.967033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:09.967033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:09.967033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:09.967033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:09.967033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.967033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:09.967033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:09.967033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.967033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:09.967033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:09.967033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.967033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:09.967033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:09.967033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:09.967840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:09.969508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:09.969508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:09.969508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:14.782473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:14.783145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:14.783293 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:14.784588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:14.818513 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:14.818788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.819437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:14.819437 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.819437 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:14.819437 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.819437 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.819437 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:14.819437 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.819437 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:14.820209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.820209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:14.820209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:14.820209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:14.820209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.820209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:14.820209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:14.820209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.820209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:14.820209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:14.820209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:14.820209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.820940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:14.820940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:14.820940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:14.820940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:14.820940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:14.820940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:14.820940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:14.820940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:14.820940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.820940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:14.820940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.820940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.820940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:14.821762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.821762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:14.821762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.821762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:14.821762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:14.821762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:14.821762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:14.821762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:14.821762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.821762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:14.821762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:14.821762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.821762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:14.821762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:14.821762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:14.822618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.823574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:14.823574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.823574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.823574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:14.823574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.823574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:14.848622 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:14.849010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:14.849117 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:14.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:14.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:14.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:14.882241 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.882241 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:14.882241 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.882241 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.882241 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:14.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:14.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.882546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:14.882546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:14.882546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:14.882546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.882546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:14.882546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:14.882546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.882546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:14.882546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:14.882546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:14.882546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.882546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:14.882546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:14.882546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:14.883216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:14.883216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:14.883216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:14.883216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:14.883216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:14.883216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.883216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:14.883216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.883216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.883216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:14.883216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.883216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:14.883698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.883698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:14.883698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:14.883698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:14.883698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:14.883698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:14.883698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.883698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:14.883698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:14.883698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.883698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:14.883698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:14.883698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.883698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:14.883698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:14.883698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.883996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.884385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:14.884385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.884385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:14.884385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:14.884385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:14.884385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:14.884385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:49:14.884385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:14.884576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:14.884944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.884944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:14.884944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:14.884944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:14.884944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:14.884944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:14.884944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:14.884944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:14.884944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:14.884944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.884944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:14.884944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.884944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.884944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:14.884944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.884944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:14.885306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.885306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:14.885306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:14.885306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:14.885306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.885306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:14.885306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:14.885306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:49:14.885306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:14.885306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:14.885306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.885306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:14.885585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:14.885585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:14.885585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.885585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:14.885585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:14.885585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:14.885585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:14.885585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:14.885585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:14.885585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:14.885585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:14.885585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.885585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:14.885585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.885848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.885848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:14.885848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.885848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:14.885848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.885848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:14.885848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:14.885848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:14.885848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:14.885848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:14.885848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.885848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:14.885848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:14.885848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:14.886135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:14.886519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:14.886519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:14.886519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:14.886519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:14.886519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:14.886519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.886519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:14.886519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.886519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.886519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:14.886519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.886519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:14.886519 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:14.886519 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:14.886817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:14.886817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:14.886817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:14.886817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.886817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:14.886817 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.886817 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:14.886817 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.886817 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.886817 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:14.886817 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.886817 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:14.888309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.888309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:14.888309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:14.888309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:14.888309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.888309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:14.888309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:14.888309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:14.888309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.888309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:14.888309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:14.888309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:14.888309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:14.888309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:14.888309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:14.888635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:14.888635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:14.888635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.888635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:14.888635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.888635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.888635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:14.888635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.888635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:14.888635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.021 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.888635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:14.888635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:14.888635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:14.888635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.888929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:14.888929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:14.888929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:14.888929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:14.888929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.888929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:14.888929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:14.888929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:14.888929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.888929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:14.888929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:14.888929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:14.888929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:14.889218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:14.889218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:14.889218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:14.889218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:14.889218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.889218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:14.889218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.889218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.889218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:14.889218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.889218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:14.889218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:14.889490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.889875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:14.960603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:14.960944 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:14.961056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:14.961241 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:14.961787 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:14.962172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:14.962413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.963211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:14.963211 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.963211 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:14.963211 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.963211 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.963211 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:14.963211 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.963211 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:14.964735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.964735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:14.964735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:14.964735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:14.964735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.964735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:14.964735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:14.964735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.964735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:14.964735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:14.964735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:14.964735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.965434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:14.965434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:14.965434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:14.965434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:14.965434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:14.965434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:14.965434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:14.965434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:14.965434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.965434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:14.965434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.965434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.965434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:14.966043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.966043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:14.966289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.966289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:14.966289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:14.966289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:14.966289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:14.966289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:14.966289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.966289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:14.966289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:14.966289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.966289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:14.966289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:14.966289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.966289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:14.966289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:14.966289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:14.967146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:14.968105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:14.968105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:14.968105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:19.783448 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:19.784497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:19.784497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:19.785952 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:19.815852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:19.816254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.817200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:19.817200 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.817200 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:19.817200 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.817200 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.817200 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:19.817200 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.817200 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:19.817955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.817955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:19.817955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:19.817955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:19.817955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.817955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:19.817955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:19.817955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.817955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:19.817955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:19.817955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:19.817955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.818625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:19.818625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:19.818625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:19.818625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:19.818625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:19.818625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:19.818625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:19.818625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:19.818625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.818625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:19.818625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.818625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.818625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:19.819283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.819283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:19.819283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.819283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:19.819283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:19.819283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:19.819283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:19.819283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:19.819283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.819283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:19.819283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:19.819283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.819283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:19.819283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:19.819283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:19.820156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.820846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:19.820846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.820846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.820846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:19.820846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.820846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:19.849342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:19.850022 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:19.850229 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:19.851239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:19.851674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:19.851896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.852728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:19.852728 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.852728 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:19.852728 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.852728 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.852728 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:19.852728 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.852728 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:19.854265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.854265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:19.854265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:19.854265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:19.854265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.854265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:19.854265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:19.854265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.854265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:19.854265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:19.854265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:19.854265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.854853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:19.854853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:19.854853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:19.854853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:19.854853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:19.854853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:19.854853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:19.854853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:19.854853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.854853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:19.854853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.854853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.854853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:19.855493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.855493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:19.856108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.856108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:19.856108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:19.856108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:19.856108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:19.856108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:19.856108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.856108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:19.856108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:19.856108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.856108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:19.856108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:19.856108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.856108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:19.856108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:19.856108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.856837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.857663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:19.857663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.857663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:19.857663 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:19.857663 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:19.857663 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:19.857663 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:49:19.858019 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:19.858079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.858854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:19.858854 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.858854 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:19.858854 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.858854 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.858854 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:19.858854 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.858854 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:19.860146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.860146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:19.860146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:19.860146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:19.860146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.860146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:19.860146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:19.860146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:19.860146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.860146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:19.860146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:19.860146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:19.860146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:19.860146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:19.860146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:19.860902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:19.860902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:19.860902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.860902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:19.860902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.860902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.860902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:19.860902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.860902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:19.861615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.861615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:19.861615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:19.861615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:19.861615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.861615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:19.861615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:19.861615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:49:19.861615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:19.861615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:19.861615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.861615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:19.862189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:19.862189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:19.862189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.862189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:19.862189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:19.862189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:19.862189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:19.862189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:19.862189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:19.862189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:19.862189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:19.862189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.862189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:19.862189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.862663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.862663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:19.862663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.862663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:19.863384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.863384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:19.863384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:19.863384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:19.863384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:19.863384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:19.863384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.863384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:19.863384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:19.863384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.863384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:19.863384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:19.863384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.863384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:19.863384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:19.863384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:19.863926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:19.864488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.864488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:19.864488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.864488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.864488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:19.864488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.864488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:19.864488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:19.864488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:19.864488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:19.864820 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:19.864820 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:19.865059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.865516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:19.865516 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.865516 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:19.865516 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.865516 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.865516 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:19.865516 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.865516 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:19.866041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.866041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:19.866041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:19.866041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:19.866041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.866041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:19.866041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:19.866041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:19.866041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.866041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:19.866041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:19.866041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:19.866041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:19.866041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:19.866041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:19.866492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:19.866492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:19.866492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.866492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:19.866492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.866492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.866492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:19.866492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.866492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:19.866780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.866780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:19.866780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:19.866780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:19.866780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.866780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:19.866780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:19.866780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:19.866780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:19.866780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.866780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:19.867128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:19.867128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:19.867128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.867128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:19.867128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:19.867128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:19.867128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:19.867128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:19.867128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:19.867128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:19.867128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:19.867128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.867128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:19.867128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.867583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.867583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:19.867583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.867583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:19.867583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.867583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:19.867583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:19.867583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:19.867583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:19.867583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:19.867583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.867583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:19.867583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:19.867583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:19.868013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:19.868611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:19.868611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:19.868611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:19.868611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:19.868611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.868611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:19.868611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.868611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.868611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:19.868611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.868611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:19.961660 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:19.962261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:19.962471 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:19.962745 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:19.963395 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:19.963817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:19.964084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.964917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:19.964917 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.964917 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:19.964917 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.964917 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.964917 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:19.964917 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.964917 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:19.966306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.966306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:19.966306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:19.966306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:19.966306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.966306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:19.966306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:19.966306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.966306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:19.966306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:19.966306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:19.966306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.966930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:19.966930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:19.966930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:19.966930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:19.966930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:19.966930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:19.966930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:19.966930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:19.966930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.966930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:19.966930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.966930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.966930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:19.967528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.967528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:19.968026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.968026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:19.968026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:19.968026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:19.968026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:19.968026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:19.968026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.968026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:19.968026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:19.968026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.968026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:19.968026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:19.968026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.968026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:19.968026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:19.968026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:19.968631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:19.969138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:19.969138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:19.969138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:24.784187 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:24.784991 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:24.784991 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:24.785705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:24.817798 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:24.818262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.819301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:24.819301 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.819301 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:24.819301 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.819301 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.819301 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:24.819301 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.819301 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:24.820299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.820299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:24.820299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:24.820299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:24.820299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.820299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:24.820299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:24.820299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.820299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:24.820299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:24.820299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:24.820299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.821124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:24.821124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:24.821124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:24.821124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:24.821124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:24.821124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:24.821124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:24.821124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:24.821124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.821124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:24.821124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.821124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.821124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:24.821720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.821720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:24.821720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.821720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:24.821720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:24.821720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:24.821720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:24.821720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:24.821720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.821720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:24.821720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:24.821720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.821720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:24.821720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:24.821720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:24.822910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.824077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:24.824077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.824077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.824077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:24.824077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.824077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:24.849986 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:24.850574 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:24.850756 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:24.851672 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:24.851986 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:24.852216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.852999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:24.852999 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.852999 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:24.852999 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.852999 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.852999 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:24.852999 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.852999 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:24.854553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.854553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:24.854553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:24.854553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:24.854553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.854553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:24.854553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:24.854553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.854553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:24.854553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:24.854553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:24.854553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.855290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:24.855290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:24.855290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:24.855290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:24.855290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:24.855290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:24.855290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:24.855290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:24.855290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.855290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:24.855290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.855290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.855290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:24.855852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.855852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:24.856118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.856118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:24.856118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:24.856118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:24.856118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:24.856118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:24.856118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.856118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:24.856118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:24.856118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.856118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:24.856118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:24.856118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.856118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:24.856118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:24.856118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.856887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.857818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:24.857818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.857818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:24.857818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:24.857818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:24.857818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:24.858125 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:49:24.858590 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:24.858961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.859863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:24.859863 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.859863 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:24.859863 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.859863 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.859863 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:24.859863 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.859863 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:24.860621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.860621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:24.860621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:24.860621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:24.860621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.860621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:24.860621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:24.860621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:24.860621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.860621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:24.860621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:24.860621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:24.860621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:24.860621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:24.860621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:24.861434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:24.861434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:24.861434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.861434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:24.861434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.861434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.861434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:24.861434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.861434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:24.861434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.861434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:24.861434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:24.861434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:24.861434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.862130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:24.862130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:24.862130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:49:24.862130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:24.862130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:24.862130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.862130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:24.862130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:24.862130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:24.862130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.862130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:24.862130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:24.862130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:24.862640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:24.862640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:24.862640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:24.862640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:24.862640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:24.862640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.862640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:24.862640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.862640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.862640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:24.862640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.862640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:24.862942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.862942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:24.862942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:24.862942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:24.862942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:24.862942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:24.862942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.862942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:24.862942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:24.862942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.862942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:24.862942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:24.862942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.862942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:24.862942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:24.862942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:24.863316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:24.863770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.863770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:24.863770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.863770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.863770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:24.863770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.863770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:24.864603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:24.864761 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:24.864866 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:24.864984 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:24.865336 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:24.865595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.866102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:24.866102 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.866102 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:24.866102 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.866102 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.866102 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:24.866102 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.866102 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:24.866814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.866814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:24.866814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:24.866814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:24.866814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.866814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:24.866814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:24.866814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:24.866814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.866814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:24.866814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:24.866814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:24.866814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:24.866814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:24.866814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:24.867206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:24.867206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:24.867206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.867206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:24.867206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.867206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.867206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:24.867206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.867206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:24.867711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.867711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:24.867711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:24.867711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:24.867711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.867711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:24.867711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:24.867711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:24.867711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:24.867711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.867711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:24.868307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:24.868307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:24.868307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.868307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:24.868307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:24.868307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:24.868307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:24.868307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:24.868307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:24.868307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:24.868307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:24.868307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.868307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:24.868307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.868691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.868691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:24.868691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.868691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:24.868691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.868691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:24.868691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:24.868691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:24.868691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:24.868691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:24.868691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.868691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:24.868691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:24.868691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:24.869048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:24.869644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:24.869644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:24.869644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:24.869644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:24.869644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.869644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:24.869644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.869644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.869644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:24.869644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.869644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:24.962702 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:24.963013 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:24.963188 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:24.963444 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:24.964144 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:24.964697 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:24.964946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.965820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:24.965820 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.965820 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:24.965820 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.965820 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.965820 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:24.965820 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.965820 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:24.967162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.967162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:24.967162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:24.967162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:24.967162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.967162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:24.967162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:24.967162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.967162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:24.967162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:24.967162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:24.967162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.967788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:24.967788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:24.967788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:24.967788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:24.967788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:24.967788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:24.967788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:24.967788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:24.967788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.967788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:24.967788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.967788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.967788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:24.968526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.968526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:24.968638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.968638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:24.968638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:24.968638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:24.968638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:24.968638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:24.968638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.968638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:24.968638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:24.968638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.968638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:24.968638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:24.968638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.968638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:24.968638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:24.968638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:24.969401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:24.970239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:24.970239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:24.970239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:29.785275 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:29.785978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:29.786281 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:29.788019 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:29.822290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:29.822583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.823273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:29.823273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.823273 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:29.823273 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.823273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.823273 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:29.823273 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.823273 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:29.824032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.824032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:29.824032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:29.824032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:29.824032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.824032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:29.824032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:29.824032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.824032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:29.824032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:29.824032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:29.824032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.824332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:29.824332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:29.824332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:29.824332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:29.824332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:29.824332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:29.824332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:29.824332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:29.824332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.824332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:29.824332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.824332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.824332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:29.824647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.824647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:29.824831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.824831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:29.824831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:29.824831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:29.824831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:29.824831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:29.824831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.824831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:29.824831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:29.824831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.824831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:29.824831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:29.824831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.824831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:29.824831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:29.824831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.825210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.825659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:29.825659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.825659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:29.850577 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:29.852393 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:29.852393 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:29.852393 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:29.852393 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:29.852610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.853480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:29.853480 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.853480 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:29.853480 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.853480 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.853480 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:29.853480 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.853480 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:29.854819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.854819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:29.854819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:29.854819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:29.854819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.854819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:29.854819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:29.854819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.854819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:29.854819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:29.854819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:29.854819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.855104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:29.855104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:29.855104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:29.855104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:29.855104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:29.855104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:29.855104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:29.855104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:29.855104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.855104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:29.855104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.855104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.855104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:29.855384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.855384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:29.856853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.856853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:29.856853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:29.856853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:29.856853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:29.856853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:29.856853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.856853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:29.856853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:29.856853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.856853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:29.856853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:29.856853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.856853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:29.856853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:29.856853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.857202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.857613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:29.857613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.857613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:29.857613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:29.857870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:29.858038 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:29.858210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:49:29.858606 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:29.858881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.859552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:29.859552 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.859552 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:29.859552 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.859552 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.859552 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:29.859552 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.859552 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:29.860712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.860712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:29.860712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:29.860712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:29.860712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.860712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:29.860712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:29.860712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:29.860712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.860712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:29.860712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:29.860712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:29.860712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:29.860712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:29.860712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:29.861071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:29.861071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:29.861071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.861071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:29.861071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.861071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.861071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:29.861071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.861071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:29.862060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.862060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:29.862060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:29.862060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:29.862060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.862060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:29.862060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:29.862060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:49:29.862060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:29.862060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:29.862060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.862060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:29.862352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:29.862352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:29.862352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.862352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:29.862352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:29.862352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:29.862352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:29.862352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:29.862352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:29.862352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:29.862352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:29.862352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.862352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:29.862352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.862638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.862638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:29.862638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.862638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:29.863950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.863950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:29.863950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:29.863950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:29.863950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:29.863950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:29.863950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.863950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:29.863950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:29.863950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.863950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:29.863950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:29.863950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.863950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:29.863950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:29.863950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:29.864293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:29.864684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.864684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:29.864684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.864684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.864684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:29.864684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.864684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:29.864953 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:29.865237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:29.865350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:29.865502 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:29.865932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:29.866225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.866762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:29.866762 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.866762 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:29.866762 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.866762 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.866762 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:29.866762 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.866762 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:29.867528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.867528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:29.867528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:29.867528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:29.867528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.867528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:29.867528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:29.867528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:29.867528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.867528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:29.867528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:29.867528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:29.867528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:29.867528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:29.867528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:29.867827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:29.867827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:29.867827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.867827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:29.867827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.867827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.867827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:29.867827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.867827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:29.868429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.868429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:29.868429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:29.868429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:29.868429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.868429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:29.868429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:29.868429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:29.868429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:29.868429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.868429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:29.868698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:29.868698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:29.868698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.868698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:29.868698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:29.868698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:29.868698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:29.868698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:29.868698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:29.868698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:29.868698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:29.868698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.868698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:29.868698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.868970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.868970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:29.868970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.868970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.869515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:29.869874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.870246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.870246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:29.870246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.870246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:29.963214 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:29.963849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:29.963849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:29.964014 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:29.964629 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:29.964731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:29.964860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.965454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:29.965454 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.965454 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:29.965454 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.965454 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.965454 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:29.965454 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.965454 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:29.966528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.966528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:29.966528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:29.966528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:29.966528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.966528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:29.966528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:29.966528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.966528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:29.966528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:29.966528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:29.966528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.967143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:29.967143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:29.967143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:29.967143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:29.967143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:29.967143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:29.967143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:29.967143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:29.967143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.967143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:29.967143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.967143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.967143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:29.967834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.967834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:29.967834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.967834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:29.967834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:29.967834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:29.967834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:29.967834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:29.967834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.967834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:29.967834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:29.967834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.967834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:29.967834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:29.967834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:29.968560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:29.969424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:29.969424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:29.969424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:29.969424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:29.969424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:29.969424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:34.786062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:34.787016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:34.787016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:34.788167 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:34.822026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:34.822514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.823439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:34.823439 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.823439 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:34.823439 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.823439 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.823439 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:34.823439 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.823439 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:34.824918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.824918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:34.824918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:34.824918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:34.824918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.824918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:34.824918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:34.824918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.824918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:34.824918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:34.824918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:34.824918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.825597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:34.825597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:34.825597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:34.825597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:34.825597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:34.825597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:34.825597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:34.825597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:34.825597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.825597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:34.825597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.825597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.825597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:34.826268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.826268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:34.826458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.826458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:34.826458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:34.826458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:34.826458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:34.826458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:34.826458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.826458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:34.826458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:34.826458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.826458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:34.826458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:34.826458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.826458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:34.826458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:34.826458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.827261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.828246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:34.828246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.828246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:34.851416 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:34.852020 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:34.852195 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:34.853257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:34.853726 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:34.854014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.854902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:34.854902 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.854902 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:34.854902 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.854902 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.854902 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:34.854902 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.854902 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:34.855903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.855903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:34.855903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:34.855903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:34.855903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.855903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:34.855903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:34.855903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.855903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:34.855903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:34.855903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:34.855903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.856536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:34.856536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:34.856536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:34.856536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:34.856536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:34.856536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:34.856536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:34.856536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:34.856536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.856536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:34.856536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.856536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.856536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:34.857088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.857088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:34.857088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.857088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:34.857088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:34.857088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:34.857088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:34.857088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:34.857088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.857088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:34.857088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:34.857088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.857088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:34.857088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:34.857088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:34.857873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.858696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:34.858696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.858696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.858696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:34.858696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.858696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:34.858696 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:34.858696 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:34.858696 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:34.858696 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:49:34.859188 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:34.859413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.860103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:34.860103 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.860103 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:34.860103 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.860103 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.860103 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:34.860103 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.860103 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:34.860694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.860694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:34.860694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:34.860694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:34.860694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.860694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:34.860694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:34.860694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:34.860694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.860694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:34.860694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:34.860694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:34.860694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:34.860694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:34.860694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:34.861213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:34.861213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:34.861213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.861213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:34.861213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.861213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.861213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:34.861213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.861213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:34.861542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.861542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:34.861542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:34.861542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:34.861542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.861542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:34.861542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:34.861542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:49:34.861542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:34.861542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:34.861542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.861542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:34.862004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:34.862004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:34.862004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.862004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:34.862004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:34.862004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:34.862004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:34.862004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:34.862004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:34.862004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:34.862004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:34.862004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.862004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:34.862004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.862397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.862397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:34.862397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.862397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:34.862604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.862604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:34.862604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:34.862604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:34.862604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:34.862604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:34.862604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.862604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:34.862604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:34.862604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.862604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:34.862604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:34.862604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.862604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:34.862604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:34.862604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:34.863068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:34.863581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.863581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:34.863581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.863581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.863581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:34.863581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.863581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:34.865390 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:34.865727 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:34.865849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:34.865982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:34.866318 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:34.866559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:34.867040 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.867040 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:34.867040 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.867040 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.867040 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:34.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.867040 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:34.867864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.867864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:34.867864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:34.867864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:34.867864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.867864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:34.867864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:34.867864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:34.867864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.867864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:34.867864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:34.867864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:34.867864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:34.867864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:34.867864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:34.868267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:34.868267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:34.868267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.868267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:34.868267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.868267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.868267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:34.868267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.868267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:34.868842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.868842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:34.868842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:34.868842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:34.868842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.868842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:34.868842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:34.868842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:34.868842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:34.868842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.868842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:34.869185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:34.869185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:34.869185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.869185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:34.869185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:34.869185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:34.869185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:34.869185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:34.869185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:34.869185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:34.869185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:34.869185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.869185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:34.869185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.869592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.869592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:34.869592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.869592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.870162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:34.870662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.871183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.871183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:34.871183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.871183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:34.963857 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:34.964416 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:34.964685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:34.964971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:34.965600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:34.965895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:34.966002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.966702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:34.966702 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.966702 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:34.966702 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.966702 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.966702 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:34.966702 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.966702 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:34.968253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.968253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:34.968253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:34.968253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:34.968253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.968253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:34.968253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:34.968253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.968253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:34.968253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:34.968253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:34.968253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.968915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:34.968915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:34.968915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:34.968915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:34.968915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:34.968915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:34.968915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:34.968915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:34.968915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.968915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:34.968915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.968915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.968915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:34.969267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.969267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:34.970057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.970057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:34.970057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:34.970057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:34.970057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:34.970057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:34.970057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.970057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:34.970057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:34.970057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.970057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:34.970057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:34.970057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.970057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:34.970057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:34.970057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:34.970529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:34.971047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:34.971047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:34.971047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:39.786715 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:39.787686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:39.787686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:39.788027 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:39.818633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:39.818916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.819651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:39.819651 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.819651 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:39.819651 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.819651 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.819651 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:39.819651 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.819651 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:39.820448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.032 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.820448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:39.820448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:39.820448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:39.820448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.820448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:39.820448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:39.820448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.820448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:39.820448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:39.820448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:39.820448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.821301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:39.821301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:39.821301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:39.821301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:39.821301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:39.821301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:39.821301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:39.821301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:39.821301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.821301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:39.821301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.821301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.821301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:39.822246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.822246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:39.822246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.822246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:39.822246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:39.822246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:39.822246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:39.822246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:39.822246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.822246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:39.822246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:39.822246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.822246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:39.822246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:39.822246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:39.823290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.824664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:39.824664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.824664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.824664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:39.824664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.824664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:39.851987 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:39.852354 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:39.852724 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:39.853758 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:39.854110 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:39.854390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.855354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:39.855354 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.855354 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:39.855354 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.855354 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.855354 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:39.855354 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.855354 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:39.856970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.856970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:39.856970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:39.856970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:39.856970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.856970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:39.856970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:39.856970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.856970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:39.856970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:39.856970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:39.856970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.857805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:39.857805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:39.857805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:39.857805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:39.857805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:39.857805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:39.857805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:39.857805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:39.857805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.857805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:39.857805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.857805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.857805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:39.858570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.858570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:39.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:39.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:39.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:39.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:39.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:39.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:39.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:39.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:39.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:39.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:39.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:39.859726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.861311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.861840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:39.861840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.861840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:39.861840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:39.861840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:39.861840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:39.861840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:49:39.861840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:39.862105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.862105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:39.862105 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.862105 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:39.862105 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.862105 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.862105 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:39.862105 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.862105 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:39.862358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.862358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:39.862358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:39.862358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:39.862358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.862358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:39.862358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:39.862358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:39.862358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.862358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:39.862358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:39.862358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:39.862358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:39.862358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:39.862358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:39.862847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:39.862847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:39.862847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.862847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:39.862847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.862847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.862847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:39.862847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.862847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:39.863152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.863152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:39.863152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:39.863152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:39.863152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.863152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:39.863152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:39.863152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:49:39.863152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:39.863152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:39.863152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.863152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:39.863768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:39.863768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:39.863768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.863768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:39.863768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:39.863768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:39.863768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:39.863768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:39.863768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:39.863768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:39.863768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:39.863768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.863768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:39.863768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.864149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.864149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:39.864149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.864149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:39.864149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.864149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:39.864149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:39.864149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:39.864149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:39.864149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:39.864149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.864149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:39.864149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:39.864149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:39.864559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:39.865152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:39.865152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:39.865152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:39.865152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:39.865152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:39.865152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.865152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:39.865152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.865152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.865152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:39.865152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.865152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:39.865711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:39.865906 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:39.866014 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:39.866133 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:39.866915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:39.867079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.867902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:39.867902 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.867902 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:39.867902 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.867902 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.867902 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:39.867902 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.867902 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:39.868758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.868758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:39.868758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:39.868758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:39.868758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.868758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:39.868758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:39.868758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:39.868758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.868758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:39.868758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:39.868758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:39.868758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:39.868758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:39.868758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:39.869143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:39.869143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:39.869143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.869143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:39.869143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.869143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.869143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:39.869143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.869143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:39.869712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.869712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:39.869712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:39.869712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:39.869712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.869712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:39.869712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:39.869712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:39.869712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:39.869712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.869712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:39.870048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:39.870048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:39.870048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.870048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:39.870048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:39.870048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:39.870048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:39.870048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:39.870048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:39.870048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:39.870048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:39.870048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.870048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:39.870048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.870518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.870518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:39.870518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.870518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.870813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:39.871295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.872221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.872221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:39.872221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.872221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:39.964555 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:39.965627 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:39.965627 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:39.965809 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:39.966389 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:39.966800 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:39.967029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.967995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:39.967995 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.967995 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:39.967995 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.967995 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.967995 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:39.967995 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.967995 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:39.969605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.969605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:39.969605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:39.969605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:39.969605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.969605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:39.969605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:39.969605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.969605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:39.969605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:39.969605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:39.969605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.970204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:39.970204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:39.970204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:39.970204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:39.970204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:39.970204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:39.970204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:39.970204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:39.970204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.970204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:39.970204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.970204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.970204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:39.970826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.970826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:39.971340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.971340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:39.971340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:39.971340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:39.971340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:39.971340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:39.971340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.971340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:39.971340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:39.971340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.971340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:39.971340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:39.971340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.971340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:39.971340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:39.971340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:39.972150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:39.973064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:39.973064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:39.973064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:44.787320 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:44.788299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:44.788299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:44.789919 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:44.823627 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:44.824039 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.824890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:44.824890 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.824890 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:44.824890 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.824890 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.824890 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:44.824890 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.824890 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:44.825653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.825653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:44.825653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:44.825653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:44.825653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.825653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:44.825653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:44.825653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.825653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:44.825653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:44.825653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:44.825653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.826631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:44.826631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:44.826631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:44.826631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:44.826631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:44.826631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:44.826631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:44.826631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:44.826631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.826631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:44.826631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.826631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.826631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:44.827616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.827616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:44.827616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.827616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:44.827616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:44.827616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:44.827616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:44.827616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:44.827616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.827616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:44.827616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:44.827616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.827616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:44.827616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:44.827616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:44.828324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:44.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:44.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.828907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:44.852359 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:44.852687 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:44.852808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:44.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:44.853844 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:44.854357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.854838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:44.854838 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.854838 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:44.854838 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.854838 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.854838 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:44.854838 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.854838 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:44.855535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.855535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:44.855535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:44.855535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:44.855535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.855535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:44.855535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:44.855535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.855535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:44.855535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:44.855535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:44.855535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:44.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:44.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:44.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:44.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:44.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:44.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:44.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:44.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:44.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.856310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:44.857029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.857029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:44.857029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.857029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:44.857029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:44.857029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:44.857029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:44.857029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:44.857029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.857029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:44.857029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:44.857029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.857029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:44.857029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:44.857029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:44.857754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.858595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:44.858595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.858595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.858595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:44.858595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.858595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:44.859793 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:44.860076 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:44.860174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:44.860260 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:49:44.860874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:44.861277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.862164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:44.862164 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.862164 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:44.862164 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.862164 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.862164 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:44.862164 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.862164 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:44.863379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.863379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:44.863379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:44.863379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:44.863379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.863379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:44.863379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:44.863379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:44.863379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.863379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:44.863379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:44.863379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:44.863379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:44.863379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:44.863379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:44.863851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:44.863851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:44.863851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.863851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:44.863851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.863851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.863851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:44.863851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.863851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:44.864819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.864819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:44.864819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:44.864819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:44.864819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.864819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:44.864819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:44.864819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:49:44.864819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:44.864819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:44.864819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.864819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:44.865194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:44.865194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:44.865194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.865194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:44.865194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:44.865194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:44.865194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:44.865194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:44.865194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:44.865194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:44.865194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:44.865194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.865194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:44.865194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.865581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.865581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:44.865581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.865581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:44.866573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.866573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:44.866573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:44.866573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:44.866573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:44.866573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:44.866573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.866573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:44.866573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:44.866573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.866573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:44.866573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:44.866573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.866573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:44.866573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:44.866573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:44.867575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.867575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:44.867575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.867575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.867575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:44.867575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.867575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:44.867767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:44.868104 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:44.868351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:44.868672 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:44.869081 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:44.869383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.870303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:44.870303 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.870303 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:44.870303 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.870303 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.870303 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:44.870303 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.870303 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:44.871447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.871447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:44.871447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:44.871447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:44.871447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.871447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:44.871447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:44.871447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:44.871447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.871447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:44.871447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:44.871447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:44.871447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:44.871447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:44.871447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:44.871922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:44.871922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:44.871922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.871922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:44.871922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.871922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.871922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:44.871922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.871922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:44.872693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.872693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:44.872693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:44.872693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:44.872693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.872693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:44.872693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:44.872693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:44.872693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:44.872693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.872693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:44.873200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:44.873200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:44.873200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.873200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:44.873200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:44.873200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:44.873200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:44.873200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:44.873200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:44.873200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:44.873200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:44.873200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.873200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:44.873200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.873781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.873781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:44.873781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.873781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.874185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:44.874744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.875302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.875302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:44.875302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.875302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:44.965142 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:44.965797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:44.966042 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:44.966444 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:44.966904 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:44.967168 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:44.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.968055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:44.968055 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.968055 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:44.968055 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.968055 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.968055 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:44.968055 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.968055 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:44.969810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.969810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:44.969810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:44.969810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:44.969810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.969810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:44.969810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:44.969810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.969810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:44.969810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:44.969810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:44.969810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.970193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:44.970193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:44.970193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:44.970193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:44.970193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:44.970193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:44.970193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:44.970193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:44.970193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.970193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:44.970193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.970193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.970193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:44.970548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.970548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:44.971876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.971876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:44.971876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:44.971876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:44.971876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:44.971876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:44.971876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.971876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:44.971876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:44.971876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.971876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:44.971876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:44.971876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.971876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:44.971876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:44.971876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:44.972613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:44.973401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:44.973401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:44.973401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:49.788065 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:49.788764 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:49.788764 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:49.790234 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:49.820627 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:49.820991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.821973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:49.821973 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.821973 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:49.821973 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.821973 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.821973 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:49.821973 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.821973 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:49.823049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.823049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:49.823049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:49.823049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:49.823049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.823049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:49.823049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:49.823049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.823049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:49.823049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:49.823049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:49.823049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.823767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:49.823767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:49.823767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:49.823767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:49.823767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:49.823767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:49.823767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:49.823767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:49.823767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.823767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:49.823767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.823767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.823767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:49.824554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.824554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:49.824554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.824554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:49.824554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:49.824554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:49.824554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:49.824554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:49.824554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.824554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:49.824554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:49.824554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.824554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:49.824554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:49.824554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:49.825420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.826449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:49.826449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.826449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.826449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:49.826449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.826449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:49.853025 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:49.853651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:49.853834 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:49.854902 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:49.855253 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:49.855537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.856438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:49.856438 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.856438 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:49.856438 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.856438 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.856438 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:49.856438 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.856438 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:49.857907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.857907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:49.857907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:49.857907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:49.857907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.857907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:49.857907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:49.857907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.857907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:49.857907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:49.857907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:49.857907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.858553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:49.858553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:49.858553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:49.858553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:49.858553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:49.858553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:49.858553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:49.858553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:49.858553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.858553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:49.858553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.858553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.858553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:49.859095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.859095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:49.860093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.860093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:49.860093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:49.860093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:49.860093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:49.860093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:49.860093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.860093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:49.860093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:49.860093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.860093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:49.860093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:49.860093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.860093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:49.860093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:49.860093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.861159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.862245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:49.862245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.862245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:49.862245 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:49.862245 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:49.862245 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:49.862245 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:49:49.862245 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:49.862717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.863048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:49.863048 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.863048 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:49.863048 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.863048 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.863048 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:49.863048 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.863048 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:49.864339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.864339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:49.864339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:49.864339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:49.864339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.864339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:49.864339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:49.864339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:49.864339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.864339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:49.864339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:49.864339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:49.864339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:49.864339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:49.864339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:49.865168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:49.865168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:49.865168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.865168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:49.865168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.865168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.865168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:49.865168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.865168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:49.865168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.865168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:49.865168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:49.865168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:49.865168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.865935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:49.865935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:49.865935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:49:49.865935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:49.865935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:49.865935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.865935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:49.865935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:49.865935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:49.865935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.865935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:49.865935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:49.865935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:49.866748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:49.866748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:49.866748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:49.866748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:49.866748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:49.866748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.866748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:49.866748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.866748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.866748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:49.866748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.866748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:49.867302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.867302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:49.867302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:49.867302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:49.867302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:49.867302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:49.867302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.867302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:49.867302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:49.867302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.867302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:49.867302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:49.867302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.867302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:49.867302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:49.867302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:49.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:49.869132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.869132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:49.869132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.869132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.869132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:49.869132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.869132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:49.869132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:49.869132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:49.869132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:49.869525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:49.869525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:49.869717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.870504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:49.870504 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.870504 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:49.870504 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.870504 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.870504 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:49.870504 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.870504 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:49.871299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.871299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:49.871299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:49.871299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:49.871299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.871299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:49.871299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:49.871299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:49.871299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.871299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:49.871299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:49.871299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:49.871299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:49.871299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:49.871299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:49.871755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:49.871755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:49.871755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.871755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:49.871755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.871755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.871755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:49.871755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.871755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:49.875744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.875744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:49.875744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:49.875744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:49.875744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.875744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:49.875744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:49.875744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:49.875744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:49.875744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.875744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:49.876143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:49.876143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:49.876143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.876143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:49.876143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:49.876143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:49.876143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:49.876143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:49.876143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:49.876143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:49.876143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:49.876143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.876143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:49.876143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.876564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.876564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:49.876564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.876564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:49.876564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.876564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:49.876564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:49.876564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:49.876564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:49.876564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:49.876564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.876564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:49.876564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:49.876564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:49.876971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:49.877504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:49.877504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:49.877504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:49.877504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:49.877504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.877504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:49.877504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.877504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.877504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:49.877504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.877504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:49.965737 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:49.967012 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:49.967012 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:49.967012 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:49.967186 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:49.967601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:49.967693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.969489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:49.969489 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.969489 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:49.969489 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.969489 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.969489 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:49.969489 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.969489 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:49.969489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.969489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:49.969489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:49.969489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:49.969489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.969489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:49.969489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:49.970414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.970414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:49.970414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:49.970414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:49.970414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.970414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:49.970414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:49.970414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:49.970414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:49.970414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:49.970414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:49.970414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:49.970414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:49.970414 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.971016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:49.971016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.971016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.971016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:49.971016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.971016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:49.971016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.971016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:49.971016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:49.971016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:49.971016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:49.971016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:49.971016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.971016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:49.971916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:49.973551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:49.973551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:49.973551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:49.973551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:49.973551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:49.973551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:49.973551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:49.973551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:49.973551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:49.973551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:54.788767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:54.790096 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:54.790288 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:54.791680 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:54.793472 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:49:54.831335 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:54.831738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.832445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:54.832445 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.832445 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:54.832445 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.832445 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.832445 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:54.832445 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.832445 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:54.833237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.833237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:54.833237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:54.833237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:54.833237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.833237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:54.833237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:54.833237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.833237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:54.833237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:54.833237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:54.833237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.833938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:54.833938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:54.833938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:54.833938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:54.833938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:54.833938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:54.833938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:54.833938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:54.833938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.833938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:54.833938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.833938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.833938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:54.834526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.834526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:54.834526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.834526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:54.834526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:54.834526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:54.834526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:54.834526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:54.834526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.834526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:54.834526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:54.834526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.834526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:54.834526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:54.834526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:54.835202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.836231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:54.836231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.836231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.836231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:54.836231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.836231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:54.853752 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:54.854094 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:54.854256 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:54.855188 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:54.855507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:54.855723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.856382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:54.856382 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.856382 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:54.856382 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.856382 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.856382 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:54.856382 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.856382 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:54.857157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.857157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:54.857157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:54.857157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:54.857157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.857157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:54.857157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:54.857157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.857157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:54.857157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:54.857157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:54.857157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.858227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:54.858227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:54.858227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:54.858227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:54.858227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:54.858227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:54.858227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:54.858227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:54.858227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.858227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:54.858227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.858227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.858227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:54.859204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.859204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:54.859204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.859204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:54.859204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:54.859204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:54.859204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:54.859204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:54.859204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.859204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:54.859204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:54.859204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.859204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:54.859204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:54.859204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:54.860519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.861583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:54.861583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.861583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.861583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:54.861583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.861583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:54.862209 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:54.862303 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:54.862451 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:54.862593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:49:54.863184 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:54.863552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.864546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:54.864546 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.864546 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:54.864546 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.864546 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.864546 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:54.864546 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.864546 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:54.865751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.865751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:54.865751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:54.865751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:54.865751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.865751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:54.865751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:54.865751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:54.865751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.865751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:54.865751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:54.865751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:54.865751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:54.865751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:54.865751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:54.866161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:54.866161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:54.866161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.866161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:54.866161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.866161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.866161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:54.866161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.866161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:54.867059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.867059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:54.867059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:54.867059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:54.867059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.867059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:54.867059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:54.867059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:49:54.867059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:54.867059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:54.867059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.867059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:54.867400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:54.867400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:54.867400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.867400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:54.867400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:54.867400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:54.867400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:54.867400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:54.867400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:54.867400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:54.867400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:54.867400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.867400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:54.867400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.867729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.867729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:54.867729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.867729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:54.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:54.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:54.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:54.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:54.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:54.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:54.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:54.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:54.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:54.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:54.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:54.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:54.869163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:54.869615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.869615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:54.869615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.869615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.869615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:54.869615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.869615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:54.869615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:54.869615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:54.869615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:54.869873 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:54.870242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:54.870756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.871600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:54.871600 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.871600 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:54.871600 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.871600 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.871600 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:54.871600 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.871600 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:54.872744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.872744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:54.872744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:54.872744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:54.872744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.872744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:54.872744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:54.872744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:54.872744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.872744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:54.872744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:54.872744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:54.872744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:54.872744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:54.872744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:54.873158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:54.873158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:54.873158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.873158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:54.873158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.873158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.873158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:54.873158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.873158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:54.874113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.874113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:54.874113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:54.874113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:54.874113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.874113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:54.874113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:54.874113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:54.874113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:54.874113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.874113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:54.874415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:54.874415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:54.874415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.874415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:54.874415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:54.874415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:54.874415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:54.874415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:54.874415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:54.874415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:54.874415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:54.874415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.874415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:54.874415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.874767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.874767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:54.874767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.874767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.875908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:54.876338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.876824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.876824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:54.876824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.876824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:54.966686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:54.967263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:54.967505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:54.967788 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:54.968617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:54.969086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:54.969535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.970192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:54.970192 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.970192 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:54.970192 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.970192 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.970192 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:54.970192 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.970192 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:54.971230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.971230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:54.971230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:54.971230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:54.971230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.971230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:54.971230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:54.971230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.971230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:54.971230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:54.971230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:54.971230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.971846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:54.971846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:54.971846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:54.971846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:54.971846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:54.971846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:54.971846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:54.971846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:54.971846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.971846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:54.971846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.971846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.971846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:54.972357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.972357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:54.972357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.972357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:54.972357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:54.972357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:54.972357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:54.972357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:54.972357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.972357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:54.972357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:54.972357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.972357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:54.972357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:54.972357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:54.972978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:54.973710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:54.973710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:54.973710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:54.973710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:54.973710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:54.973710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:59.790178 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:59.793813 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:59.793813 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:59.793813 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:59.831391 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:59.831902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.834951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:59.834951 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.834951 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:59.834951 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.834951 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.834951 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:59.834951 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.834951 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:59.834951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.834951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:59.834951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:59.834951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:59.834951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.834951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:59.834951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:59.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:59.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:59.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:59.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:59.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:59.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:59.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:59.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:59.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:59.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:59.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:59.836235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.837390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:59.837390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.837390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.837390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:59.837390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.837390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:59.837390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.837390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:59.837390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:59.837390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:59.837390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:59.837390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:59.837390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.837390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:59.838466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:59.839048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:59.839048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:59.839048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.839048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:59.839048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.839048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.839048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:59.839048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.839048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:59.854390 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:59.854874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:59.855337 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:59.856508 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:59.856801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:59.857030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.858487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:59.858487 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.858487 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:59.858487 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.858487 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.858487 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:59.858487 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.858487 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:59.860009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.860009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:59.860009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:59.860009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:59.860009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.860009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:59.860009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:59.860009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.860009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:59.860009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:59.860009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:59.860009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.860810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:59.860810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:59.860810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:59.860810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:59.860810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:59.860810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:59.860810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:59.860810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:59.860810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.860810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:59.860810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.860810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.860810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:59.862528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.862528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:59.862528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.862528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:59.862528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:59.862528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:59.862528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:59.862528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:59.862528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.862528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:59.862528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:59.862528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.862528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:59.862528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:59.862528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:59.863029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.864714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:59.864714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.864714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.864714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:59.864714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.864714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:59.864714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:59.864714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:59.864714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:59.864714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:49:59.865535 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:59.865535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.865535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:59.865535 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.865535 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:59.865535 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.865535 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.865535 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:59.865535 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.865535 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:59.866172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.866172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:59.866172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:59.866172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:59.866172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.866172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:59.866172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:59.866172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:59.866172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.866172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:59.866172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:59.866172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:59.866172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:59.866172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:59.866172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:59.866790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:59.866790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:59.866790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.866790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:59.866790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.866790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.866790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:59.866790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.866790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:59.867600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.867600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:59.867600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:59.867600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:59.867600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.867600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:59.867600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:59.867600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:49:59.867600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:59.867600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:59.867600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.867600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:59.868642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:59.868642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:59.868642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.868642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:59.868642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:59.868642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:59.868642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:59.868642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:59.868642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:59.868642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:59.868642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:59.868642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.868642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:59.868642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:59.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:59.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:59.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:59.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:59.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:59.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:59.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:59.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:59.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:59.870136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:59.870759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:59.870759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:59.870759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:59.870759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:59.870759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:59.870759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.870759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:59.870759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.870759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.870759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:59.870759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.870759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:59.870759 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:59.870759 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:59.871138 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:59.871138 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:59.871138 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:59.871138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.871952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:59.871952 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.871952 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:59.871952 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.871952 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.871952 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:59.871952 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.871952 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:59.872810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.872810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:49:59.872810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:59.872810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:59.872810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.872810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:59.872810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:59.872810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:59.872810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.872810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:49:59.872810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:59.872810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:49:59.872810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:59.872810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:49:59.872810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:49:59.873445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:59.873445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:49:59.873445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.873445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:49:59.873445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.873445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.873445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:49:59.873445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.873445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:49:59.874035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.874035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:59.874035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:59.874035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:59.874035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.874035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:59.874035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:59.874035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:59.874035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:59.874035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.874035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:59.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:59.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:59.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:59.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:59.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:59.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:59.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:59.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:59.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:59.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:59.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:59.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.874995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.874995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:59.874995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.874995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.875289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:59.875687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.876066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.876066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:59.876066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.876066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:49:59.967540 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:49:59.968316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:49:59.968603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:49:59.968939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:49:59.969898 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:59.970304 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:49:59.970559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.971535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:49:59.971535 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.971535 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:49:59.971535 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.971535 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.971535 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:49:59.971535 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.971535 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:49:59.973144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.973144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:49:59.973144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:59.973144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:49:59.973144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.973144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:59.973144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:59.973144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.973144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:59.973144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:59.973144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:59.973144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.973828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:49:59.973828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:59.973828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:49:59.973828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:59.973828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:49:59.973828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:49:59.973828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:59.973828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:49:59.973828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.973828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:49:59.973828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.973828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.973828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:49:59.974411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.974411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:49:59.975134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.975134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:49:59.975134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:49:59.975134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:49:59.975134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:49:59.975134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:49:59.975134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.975134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:49:59.975134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:49:59.975134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.975134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:49:59.975134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:49:59.975134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.975134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:49:59.975134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:49:59.975134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:49:59.975894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:49:59.976740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:49:59.976740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:49:59.976740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:03.775026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:03.775860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_for_inconsistencies {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:03.775860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Checking Neutron and OVN revision consistency. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:03.785115 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:440}}
Apr 24 10:50:03.785235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=106381) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:419}}
Apr 24 10:50:03.785323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 412fe0fb-d3c8-41ef-b742-c7e091bf5e56 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:50:03.826580 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, resource={'id': '412fe0fb-d3c8-41ef-b742-c7e091bf5e56', 'name': 'private', 'tenant_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'project_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['bedea127-581a-4245-bdcf-823b49c82996', 'd98dd98c-3740-4b7b-9054-95b7f384275a'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:19:49Z', 'updated_at': '2026-04-24T10:19:53Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 21598}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:03.827152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:03.827529 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-d9e6c44e-2c1f-4e1c-97fa-3abe15d536c8, external_ids_update=None, columns={'tag': 21598}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:03.827716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.829041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:03.829041 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:03.829041 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:03.829041 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:03.829041 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:03.829041 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:03.829041 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.829041 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:03.829738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 412fe0fb-d3c8-41ef-b742-c7e091bf5e56 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.829738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:03.829738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:50:03.829738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:50:03.829738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:50:03.829738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:50:03.829738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:50:03.829738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:03.829738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:03.829738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:03.829738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:03.830319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:03.830319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:03.830319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:03.830319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:03.830319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:03.830319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:03.830319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:03.830319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:03.830319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:03.830319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:03.830319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:03.830319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:03.830319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:03.830319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:03.830900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:03.830900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.830900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:03.830900 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 86c46bc9-7739-46e7-9c49-62d2723e0d83 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:50:03.853659 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, resource={'id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'name': 'public', 'tenant_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'project_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['4daf396b-50dc-4100-9154-fd24fc0e5f1d', '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-24T10:19:55Z', 'updated_at': '2026-04-24T10:20:05Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:03.853923 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:03.854300 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-b792be55-4fbf-4e4f-a9dc-10cee932ceea, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:03.854576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.855099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:03.855099 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:03.855099 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:03.855099 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:03.855099 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:03.855099 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:03.855099 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.855099 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:03.855908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 86c46bc9-7739-46e7-9c49-62d2723e0d83 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.855908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:03.855908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:50:03.855908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:50:03.855908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:50:03.855908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:50:03.855908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:50:03.855908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:03.855908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:03.855908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:03.855908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:03.856270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:03.856270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:03.856270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:03.856270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:03.856270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:03.856270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:03.856270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:03.856270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:03.856270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:03.856270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:03.856270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:03.856270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:03.856270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:03.856270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:03.856729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:03.856729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.856729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:03.856729 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 64c3f969-5120-406a-afc1-20f8f45b7533 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:50:03.877294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-64c3f969-5120-406a-afc1-20f8f45b7533, resource={'id': '64c3f969-5120-406a-afc1-20f8f45b7533', 'name': 'admin_net', 'tenant_id': '91bc93878b40449c8fd1c9924d8a3e8b', 'project_id': '91bc93878b40449c8fd1c9924d8a3e8b', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['18db2f65-6ba9-4ddd-8ab7-55370a16debc'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:23:22Z', 'updated_at': '2026-04-24T10:23:23Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 10837}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:03.877712 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-64c3f969-5120-406a-afc1-20f8f45b7533, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:03.878043 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-a26d15c8-ce05-4e3e-84bc-9aa33edf96fe, external_ids_update=None, columns={'tag': 10837}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:03.878165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.878743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:03.878743 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:03.878743 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:03.878743 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:03.878743 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:03.878743 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:03.878743 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.878743 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:03.879551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 64c3f969-5120-406a-afc1-20f8f45b7533 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.879551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:03.879551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:50:03.879551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:50:03.879551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:50:03.879551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:50:03.879551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:50:03.879551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:03.879551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:03.879551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:03.879551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:03.880152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:03.880152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:03.880152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:03.880152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:03.880152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:03.880152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:03.880152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:03.880152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:03.880152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:03.880152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:03.880152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:03.880152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:03.880152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:03.880152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:03.880865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:03.880865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.880865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:03.880865 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource b30b34a1-477c-4ef7-aea4-d9540988f10a (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:50:03.900812 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a, resource={'id': 'b30b34a1-477c-4ef7-aea4-d9540988f10a', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'tenant_id': '277dd31c279b430f90665727a827242c', 'project_id': '277dd31c279b430f90665727a827242c', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['a3090689-5a84-48d5-9685-f418bb1fd559'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:24:04Z', 'updated_at': '2026-04-24T10:24:05Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 23713}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:03.901200 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:03.901734 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-6d5b7906-0378-49b8-88fc-e9fa642055e4, external_ids_update=None, columns={'tag': 23713}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:03.901918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.903356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:03.903356 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:03.903356 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:03.903356 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:03.903356 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:03.903356 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:03.903356 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.903356 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:03.904145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource b30b34a1-477c-4ef7-aea4-d9540988f10a (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.904145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:03.904145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:50:03.904145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:50:03.904145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:50:03.904145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:50:03.904145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:50:03.904145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:03.904145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:03.904145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:03.904145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:03.904766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:03.904766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:03.904766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:03.904766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:03.904766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:03.904766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:03.904766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:03.904766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:03.904766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:03.904766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:03.904766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:03.904766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:03.904766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:03.904766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:03.905361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:03.905361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.905361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:03.905361 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 931f18d3-b7f8-4874-928b-3c06d4d5d355 (type: routers) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:50:03.961639 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, resource={'id': '931f18d3-b7f8-4874-928b-3c06d4d5d355', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'project_id': '277dd31c279b430f90665727a827242c', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'external_fixed_ips': [{'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7', 'ip_address': '172.24.5.167'}, {'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'ip_address': '2001:db8::1b3'}], 'enable_snat': True}, 'gw_port_id': '77659748-a2b4-448f-aa2d-e166be8f2be9', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-7ytfi', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'external_fixed_ips': [{'ip_address': '172.24.5.167', 'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7'}, {'ip_address': '2001:db8::1b3', 'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-24T10:24:05Z', 'updated_at': '2026-04-24T10:24:08Z', 'revision_number': 3, 'tenant_id': '277dd31c279b430f90665727a827242c'}, resource_type=routers, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:03.961975 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:03.962262 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "77659748-a2b4-448f-aa2d-e166be8f2be9"')], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:03.962496 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "77659748-a2b4-448f-aa2d-e166be8f2be9"')], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:03.962671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.963542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:03.963542 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:03.963542 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:03.963542 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:03.963542 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:03.963542 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:03.963542 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.963542 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:03.963908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Unable to update router 931f18d3-b7f8-4874-928b-3c06d4d5d355. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.965325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 931f18d3-b7f8-4874-928b-3c06d4d5d355 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.965325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:03.965325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:50:03.965325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:50:03.965325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:50:03.965325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:50:03.965325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1634, in update_router
Apr 24 10:50:03.965325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 24 10:50:03.965325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
Apr 24 10:50:03.965325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 24 10:50:03.965325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 24 10:50:03.965921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 24 10:50:03.965921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1568, in update_router
Apr 24 10:50:03.965921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:03.965921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:03.965921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:03.965921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:03.965921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:03.965921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:03.965921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:03.965921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:03.965921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:03.965921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:03.965921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:03.965921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:03.966608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:03.966608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:03.966608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:03.966608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:03.966608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:03.966608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:03.966608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:03.966608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:03.966608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:03.966608 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 77659748-a2b4-448f-aa2d-e166be8f2be9 (type: router_ports) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:50:04.069638 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, resource={'id': '77659748-a2b4-448f-aa2d-e166be8f2be9', 'name': '', 'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'project_id': '', 'mac_address': 'fa:16:3e:fa:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '931f18d3-b7f8-4874-928b-3c06d4d5d355', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7', 'ip_address': '172.24.5.167'}, {'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'ip_address': '2001:db8::1b3'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000170011', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-24T10:24:06Z', 'updated_at': '2026-04-24T10:24:07Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:04.070019 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7 4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'neutron:network_name': 'neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.167/24', '2001:db8::1b3/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:04.070614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=77659748-a2b4-448f-aa2d-e166be8f2be9, lrouter_port=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:04.070972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.071843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:04.071843 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.071843 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:04.071843 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.071843 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.071843 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:04.071843 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.071843 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:04.072929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 77659748-a2b4-448f-aa2d-e166be8f2be9 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.072929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:04.072929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:50:04.072929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:50:04.072929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:50:04.072929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:50:04.072929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1971, in update_router_port
Apr 24 10:50:04.072929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:04.072929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.072929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:04.072929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:04.073592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:04.073592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.073592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:04.073592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:04.073592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:04.073592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:04.073592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:04.073592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:04.073592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:04.073592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:04.073592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.073592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:04.073592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.073592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.074302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:04.074302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.074302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:04.074302 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_for_inconsistencies finished in 0.297 seconds
Apr 24 10:50:04.791711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:04.792669 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:04.792669 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:04.793885 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:04.825892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:04.826104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.826879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:04.826879 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.826879 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:04.826879 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.826879 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.826879 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:04.826879 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.826879 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:04.827707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.827707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:04.827707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:04.827707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:04.827707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.827707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:04.827707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:04.827707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.827707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:04.827707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:04.827707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:04.827707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.828461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:04.828461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:04.828461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:04.828461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:04.828461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:04.828461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:04.828461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:04.828461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:04.828461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.828461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:04.828461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.828461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.828461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:04.829217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.829217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:04.829217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.829217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:04.829217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:04.829217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:04.829217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:04.829217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:04.829217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.829217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:04.829217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:04.829217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.829217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:04.829217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:04.829217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:04.830211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.831081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:04.831081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.831081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.831081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:04.831081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.831081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:04.854966 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:04.855526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:04.855720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:04.856668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:04.857024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:04.857245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.858049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:04.858049 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.858049 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:04.858049 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.858049 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.858049 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:04.858049 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.858049 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:04.859394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.859394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:04.859394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:04.859394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:04.859394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.859394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:04.859394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:04.859394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.859394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:04.859394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:04.859394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:04.859394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.860492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:04.860492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:04.860492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:04.860492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:04.860492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:04.860492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:04.860492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:04.860492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:04.860492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.860492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:04.860492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.860492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.860492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:04.861055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.861055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:04.861055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.861055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:04.861055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:04.861055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:04.861055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:04.861055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:04.861055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.861055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:04.861055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:04.861055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.861055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:04.861055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:04.861055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:04.861692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.862684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:04.862684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.862684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.862684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:04.862684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.862684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:04.863267 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:04.863687 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:04.863861 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:04.864034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:50:04.864525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:04.864897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.865570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:04.865570 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.865570 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:04.865570 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.865570 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.865570 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:04.865570 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.865570 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:04.866830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.866830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:04.866830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:04.866830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:04.866830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.866830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:04.866830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:04.866830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:04.866830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.866830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:04.866830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:04.866830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:04.866830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:04.866830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:04.866830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:04.867274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:04.867274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:04.867274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.867274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:04.867274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.867274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.867274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:04.867274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.867274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:04.868181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.868181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:04.868181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:04.868181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:04.868181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.868181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:04.868181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:04.868181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:50:04.868181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:04.868181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:04.868181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.868181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:04.868647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:04.868647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:04.868647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.868647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:04.868647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:04.868647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:04.868647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:04.868647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:04.868647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:04.868647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:04.868647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:04.868647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.868647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:04.868647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.869082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.869082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:04.869082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.869082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:04.869195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.869195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:04.869195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:04.869195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:04.869195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:04.869195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:04.869195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.869195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:04.869195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:04.869195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.869195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:04.869195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:04.869195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.869195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:04.869195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:04.869195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:04.869613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:04.870121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.870121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:04.870121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.870121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.870121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:04.870121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.870121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:04.870121 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:04.870121 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:04.870453 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:04.870453 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:04.870580 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:04.870799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.871236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:04.871236 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.871236 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:04.871236 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.871236 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.871236 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:04.871236 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.871236 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:04.871953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.871953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:04.871953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:04.871953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:04.871953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.871953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:04.871953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:04.871953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:04.871953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.871953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:04.871953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:04.871953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:04.871953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:04.871953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:04.871953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:04.872353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:04.872353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:04.872353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.872353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:04.872353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.872353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.872353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:04.872353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.872353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:04.872786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.872786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:04.872786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:04.872786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:04.872786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.872786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:04.872786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:04.872786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:04.872786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:04.872786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.872786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:04.873091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:04.873091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:04.873091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.873091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:04.873091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:04.873091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:04.873091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:04.873091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:04.873091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:04.873091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:04.873091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:04.873091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.873091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:04.873091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.873594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.873594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:04.873594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.873594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.873809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:04.874270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.874766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.874766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:04.874766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.874766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:04.968064 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:04.968561 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:04.968691 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:04.968894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:04.969286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:04.969586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:04.969746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.970351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:04.970351 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.970351 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:04.970351 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.970351 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.970351 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:04.970351 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.970351 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:04.971536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.971536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:04.971536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:04.971536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:04.971536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.971536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:04.971536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:04.971536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.971536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:04.971536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:04.971536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:04.971536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.972119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:04.972119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:04.972119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:04.972119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:04.972119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:04.972119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:04.972119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:04.972119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:04.972119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.972119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:04.972119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.972119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.972119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:04.972764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.972764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:04.972764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.972764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:04.972764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:04.972764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:04.972764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:04.972764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:04.972764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.972764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:04.972764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:04.972764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.972764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:04.972764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:04.972764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:04.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:04.974268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:04.974268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:04.974268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:04.974268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:04.974268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:04.974268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:09.792245 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:09.792995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:09.792995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:09.794159 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:09.834507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:09.834968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.835656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:09.835656 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.835656 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:09.835656 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.835656 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.835656 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:09.835656 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.835656 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:09.836832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.836832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:09.836832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:09.836832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:09.836832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.836832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:09.836832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:09.836832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.836832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:09.836832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:09.836832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:09.836832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.837506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:09.837506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:09.837506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:09.837506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:09.837506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:09.837506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:09.837506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:09.837506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:09.837506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.837506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:09.837506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.837506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.837506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:09.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:09.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:09.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:09.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:09.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:09.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:09.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:09.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:09.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:09.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:09.838622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:09.839683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:09.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:09.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.841137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:09.855640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:09.855999 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:09.856154 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:09.856914 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:09.857257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:09.857515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.858230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:09.858230 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.858230 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:09.858230 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.858230 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.858230 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:09.858230 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.858230 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:09.859135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.859135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:09.859135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:09.859135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:09.859135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.859135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:09.859135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:09.859135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.859135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:09.859135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:09.859135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:09.859135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.859713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:09.859713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:09.859713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:09.859713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:09.859713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:09.859713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:09.859713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:09.859713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:09.859713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.859713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:09.859713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.859713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.859713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:09.860467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.860467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:09.860467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.860467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:09.860467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:09.860467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:09.860467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:09.860467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:09.860467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.860467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:09.860467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:09.860467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.860467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:09.860467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:09.860467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:09.861362 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.862160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:09.862160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.862160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.862160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:09.862160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.862160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:09.863711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:09.864077 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:09.864258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:09.864478 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:50:09.864973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:09.865236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.865943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:09.865943 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.865943 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:09.865943 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.865943 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.865943 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:09.865943 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.865943 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:09.866722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.866722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:09.866722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:09.866722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:09.866722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.866722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:09.866722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:09.866722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:09.866722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.866722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:09.866722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:09.866722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:09.866722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:09.866722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:09.866722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:09.867814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:09.867814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:09.867814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.867814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:09.867814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.867814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.867814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:09.867814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.867814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:09.867814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.867814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:09.867814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:09.867814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:09.867814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.868658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:09.868658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:09.868658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:50:09.868658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:09.868658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:09.868658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.868658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:09.868658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:09.868658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:09.868658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.868658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:09.868658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:09.868658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:09.869069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:09.869069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:09.869069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:09.869069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:09.869069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:09.869069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.869069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:09.869069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.869069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.869069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:09.869069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.869069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:09.869428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.869428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:09.869428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:09.869428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:09.869428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:09.869428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:09.869428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.869428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:09.869428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:09.869428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.869428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:09.869428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:09.869428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.869428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:09.869428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:09.869428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:09.869885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:09.870331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.870331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:09.870331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.870331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.870331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:09.870331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.870331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:09.870331 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:09.870640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:09.870704 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:09.870809 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:09.871243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:09.871659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.872455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:09.872455 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.872455 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:09.872455 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.872455 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.872455 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:09.872455 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.872455 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:09.873180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.873180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:09.873180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:09.873180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:09.873180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.873180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:09.873180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:09.873180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:09.873180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.873180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:09.873180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:09.873180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:09.873180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:09.873180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:09.873180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:09.873605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:09.873605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:09.873605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.873605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:09.873605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.873605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.873605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:09.873605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.873605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:09.874038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.874038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:09.874038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:09.874038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:09.874038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.874038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:09.874038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:09.874038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:09.874038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:09.874038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.874038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:09.874350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:09.874350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:09.874350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.874350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:09.874350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:09.874350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:09.874350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:09.874350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:09.874350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:09.874350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:09.874350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:09.874350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.874350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:09.874350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.874730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.874730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:09.874730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.874730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.875068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:09.875538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.876036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.876036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:09.876036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.876036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:09.968706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:09.969394 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:09.969707 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:09.970065 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:09.970832 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:09.971245 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:09.971529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.972463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:09.972463 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.972463 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:09.972463 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.972463 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.972463 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:09.972463 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.972463 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:09.974313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.974313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:09.974313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:09.974313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:09.974313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.974313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:09.974313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:09.974313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.974313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:09.974313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:09.974313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:09.974313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.975036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:09.975036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:09.975036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:09.975036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:09.975036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:09.975036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:09.975036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:09.975036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:09.975036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.975036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:09.975036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.975036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.975036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:09.975810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.975810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:09.976300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.976300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:09.976300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:09.976300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:09.976300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:09.976300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:09.976300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.976300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:09.976300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:09.976300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.976300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:09.976300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:09.976300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.976300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:09.976300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:09.976300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:09.977164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:09.978137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:09.978137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:09.978137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:14.792957 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:14.793937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:14.793937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:14.795195 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:14.827299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:14.827695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.828528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:14.828528 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.828528 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:14.828528 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.828528 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.828528 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:14.828528 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.828528 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:14.829279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.829279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:14.829279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:14.829279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:14.829279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.829279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:14.829279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:14.829279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.829279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:14.829279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:14.829279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:14.829279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.830021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:14.830021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:14.830021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:14.830021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:14.830021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:14.830021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:14.830021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:14.830021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:14.830021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.830021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:14.830021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.830021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.830021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:14.830816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.830816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:14.830816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.830816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:14.830816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:14.830816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:14.830816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:14.830816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:14.830816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.830816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:14.830816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:14.830816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.830816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:14.830816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:14.830816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:14.831826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.833436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:14.833436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.833436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.833436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:14.833436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.833436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:14.856418 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:14.856991 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:14.857188 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:14.858264 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:14.858717 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:14.859054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.859933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:14.859933 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.859933 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:14.859933 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.859933 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.859933 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:14.859933 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.859933 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:14.861591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.861591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:14.861591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:14.861591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:14.861591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.861591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:14.861591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:14.861591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.861591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:14.861591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:14.861591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:14.861591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.862125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:14.862125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:14.862125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:14.862125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:14.862125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:14.862125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:14.862125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:14.862125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:14.862125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.862125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:14.862125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.862125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.862125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:14.862500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.862500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:14.863461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.863461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:14.863461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:14.863461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:14.863461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:14.863461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:14.863461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.863461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:14.863461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:14.863461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.863461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:14.863461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:14.863461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.863461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:14.863461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:14.863461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.863914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.864544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:14.864544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.864544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:14.864544 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:14.864678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:14.864795 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:14.864979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:50:14.865557 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:14.865829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.866525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:14.866525 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.866525 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:14.866525 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.866525 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.866525 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:14.866525 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.866525 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:14.867445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.867445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:14.867445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:14.867445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:14.867445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.867445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:14.867445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:14.867445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:14.867445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.867445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:14.867445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:14.867445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:14.867445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:14.867445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:14.867445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:14.867941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:14.867941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:14.867941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.867941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:14.867941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.867941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.867941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:14.867941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.867941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:14.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:14.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:14.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:14.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:14.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:14.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:50:14.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:14.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:14.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.868289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:14.868696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:14.868696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:14.868696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.868696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:14.868696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:14.868696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:14.868696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:14.868696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:14.868696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:14.868696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:14.868696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:14.868696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.868696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:14.868696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.869076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.869076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:14.869076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.869076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:14.869703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.869703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:14.869703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:14.869703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:14.869703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:14.869703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:14.869703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.869703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:14.869703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:14.869703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.869703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:14.869703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:14.869703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.869703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:14.869703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:14.869703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:14.870149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:14.870693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.870693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:14.870693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.870693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.870693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:14.870693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.870693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:14.870693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:14.871001 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:14.871116 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:14.871237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:14.871703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:14.872043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.872815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:14.872815 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.872815 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:14.872815 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.872815 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.872815 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:14.872815 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.872815 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:14.873796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.873796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:14.873796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:14.873796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:14.873796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.873796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:14.873796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:14.873796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:14.873796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.873796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:14.873796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:14.873796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:14.873796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:14.873796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:14.873796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:14.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:14.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:14.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:14.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:14.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:14.874973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.874973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:14.874973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:14.874973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:14.874973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.874973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:14.874973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:14.874973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:14.874973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:14.874973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.874973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:14.875321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:14.875321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:14.875321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.875321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:14.875321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:14.875321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:14.875321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:14.875321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:14.875321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:14.875321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:14.875321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:14.875321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.875321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:14.875321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.875727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.875727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:14.875727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.875727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.876006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:14.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.877023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.877023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:14.877023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.877023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:14.969604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:14.970075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:14.970176 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:14.970385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:14.971107 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:14.971562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:14.971887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.972836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:14.972836 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.972836 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:14.972836 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.972836 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.972836 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:14.972836 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.972836 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:14.973851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.973851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:14.973851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:14.973851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:14.973851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.973851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:14.973851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:14.973851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.973851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:14.973851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:14.973851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:14.973851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.974533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:14.974533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:14.974533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:14.974533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:14.974533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:14.974533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:14.974533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:14.974533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:14.974533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.974533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:14.974533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.974533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.974533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:14.975336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.975336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:14.975336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.975336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:14.975336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:14.975336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:14.975336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:14.975336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:14.975336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.975336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:14.975336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:14.975336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.975336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:14.975336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:14.975336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:14.976138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:14.977026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:14.977026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:14.977026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:14.977026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:14.977026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:14.977026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:19.793644 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:19.794595 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:19.794595 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:19.795731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:19.826353 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:19.826826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.827702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:19.827702 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.827702 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:19.827702 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.827702 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.827702 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:19.827702 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.827702 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:19.828618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.828618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:19.828618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:19.828618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:19.828618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.828618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:19.828618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:19.828618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.828618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:19.828618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:19.828618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:19.828618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.829243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:19.829243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:19.829243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:19.829243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:19.829243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:19.829243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:19.829243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:19.829243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:19.829243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.829243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:19.829243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.829243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.829243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:19.830064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.830064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:19.830064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.830064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:19.830064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:19.830064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:19.830064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:19.830064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:19.830064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.830064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:19.830064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:19.830064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.830064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:19.830064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:19.830064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:19.830910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.831852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:19.831852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.831852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.831852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:19.831852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.831852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:19.857104 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:19.857527 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:19.857688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:19.858708 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:19.859130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:19.859498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.860396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:19.860396 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.860396 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:19.860396 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.860396 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.860396 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:19.860396 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.860396 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:19.861856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.861856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:19.861856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:19.861856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:19.861856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.861856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:19.861856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:19.861856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.861856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:19.861856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:19.861856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:19.861856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.862426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:19.862426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:19.862426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:19.862426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:19.862426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:19.862426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:19.862426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:19.862426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:19.862426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.862426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:19.862426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.862426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.862426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:19.862946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.862946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:19.863592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.863592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:19.863592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:19.863592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:19.863592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:19.863592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:19.863592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.863592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:19.863592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:19.863592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.863592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:19.863592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:19.863592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.863592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:19.863592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:19.863592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.864394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.865159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:19.865159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.865159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:19.865159 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:19.865159 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:19.865421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:19.865475 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:50:19.866010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:19.866329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.866900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:19.866900 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.866900 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:19.866900 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.866900 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.866900 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:19.866900 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.866900 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:19.868254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.868254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:19.868254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:19.868254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:19.868254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.868254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:19.868254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:19.868254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:19.868254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.868254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:19.868254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:19.868254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:19.868254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:19.868254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:19.868254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:19.868790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:19.868790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:19.868790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.868790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:19.868790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.868790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.868790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:19.868790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.868790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:19.870837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.870837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:19.870837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:19.870837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:19.870837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.870837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:19.870837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:19.870837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:50:19.870837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:19.870837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:19.870837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.870837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:19.871287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:19.871287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:19.871287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.871287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:19.871287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:19.871287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:19.871287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:19.871287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:19.871287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:19.871287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:19.871287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:19.871287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.871287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:19.871287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.871669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.871669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:19.871669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.871669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:19.872309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.872309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:19.872309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:19.872309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:19.872309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:19.872309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:19.872309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.872309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:19.872309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:19.872309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.872309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:19.872309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:19.872309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.872309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:19.872309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:19.872309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:19.872778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:19.873350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.873350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:19.873350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.873350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.873350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:19.873350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.873350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:19.873350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:19.873350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:19.873350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:19.873818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:19.873818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:19.873818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.874277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:19.874277 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.874277 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:19.874277 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.874277 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.874277 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:19.874277 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.874277 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:19.874981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.874981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:19.874981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:19.874981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:19.874981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.874981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:19.874981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:19.874981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:19.874981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.874981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:19.874981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:19.874981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:19.874981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:19.874981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:19.874981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:19.875449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:19.875449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:19.875449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.875449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:19.875449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.875449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.875449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:19.875449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.875449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:19.875843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.875843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:19.875843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:19.875843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:19.875843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.875843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:19.875843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:19.875843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:19.875843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:19.875843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.875843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:19.876193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:19.876193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:19.876193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.876193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:19.876193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:19.876193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:19.876193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:19.876193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:19.876193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:19.876193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:19.876193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:19.876193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.876193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:19.876193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.876584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.876584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:19.876584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.876584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.876890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:19.877545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.878076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.878076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:19.878076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.878076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:19.970279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:19.970982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:19.971175 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:19.971493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:19.972120 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:19.972701 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:19.972974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.973968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:19.973968 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.973968 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:19.973968 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.973968 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.973968 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:19.973968 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.973968 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:19.975745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.975745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:19.975745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:19.975745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:19.975745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.975745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:19.975745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:19.975745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.975745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:19.975745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:19.975745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:19.975745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.976531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:19.976531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:19.976531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:19.976531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:19.976531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:19.976531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:19.976531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:19.976531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:19.976531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.976531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:19.976531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.976531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.976531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:19.977252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.977252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:19.977422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.977422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:19.977422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:19.977422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:19.977422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:19.977422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:19.977422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.977422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:19.977422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:19.977422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.977422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:19.977422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:19.977422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.977422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:19.977422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:19.977422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:19.978468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:19.979723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:19.979723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:19.979723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:24.794332 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:24.795274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:24.795274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:24.796524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:24.828153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:24.828289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.829181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:24.829181 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.829181 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:24.829181 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.829181 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.829181 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:24.829181 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.829181 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:24.829916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.829916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:24.829916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:24.829916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:24.829916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.829916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:24.829916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:24.829916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.829916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:24.829916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:24.829916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:24.829916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.830608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:24.830608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:24.830608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:24.830608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:24.830608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:24.830608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:24.830608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:24.830608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:24.830608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.830608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:24.830608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.830608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.830608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:24.831305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.831305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:24.831305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.831305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:24.831305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:24.831305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:24.831305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:24.831305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:24.831305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.831305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:24.831305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:24.831305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.831305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:24.831305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:24.831305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:24.832130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.833149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:24.833149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.833149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.833149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:24.833149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.833149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:24.858272 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:24.858921 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:24.859147 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:24.860213 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:24.860610 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:24.860850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.861713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:24.861713 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.861713 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:24.861713 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.861713 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.861713 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:24.861713 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.861713 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:24.863096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.863096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:24.863096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:24.863096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:24.863096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.863096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:24.863096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:24.863096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.863096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:24.863096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:24.863096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:24.863096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.863705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:24.863705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:24.863705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:24.863705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:24.863705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:24.863705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:24.863705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:24.863705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:24.863705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.863705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:24.863705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.863705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.863705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:24.864287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.864287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:24.865000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.865000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:24.865000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:24.865000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:24.865000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:24.865000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:24.865000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.865000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:24.865000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:24.865000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.865000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:24.865000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:24.865000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.865000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:24.865000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:24.865000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.865799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.866723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:24.866723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.866723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:24.866723 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:24.866723 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:24.866723 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:24.866723 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:50:24.866723 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:24.867177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.867903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:24.867903 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.867903 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:24.867903 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.867903 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.867903 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:24.867903 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.867903 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:24.868784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.868784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:24.868784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:24.868784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:24.868784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.868784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:24.868784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:24.868784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:24.868784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.868784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:24.868784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:24.868784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:24.868784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:24.868784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:24.868784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:24.869270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:24.869270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:24.869270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.869270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:24.869270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.869270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.869270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:24.869270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.869270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:24.869628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.869628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:24.869628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:24.869628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:24.869628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.869628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:24.869628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:24.869628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:50:24.869628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:24.869628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:24.869628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.869628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:24.869999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:24.869999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:24.869999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.869999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:24.869999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:24.869999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:24.869999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:24.869999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:24.869999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:24.869999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:24.869999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:24.869999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.869999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:24.869999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.870412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.870412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:24.870412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.870412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:24.870743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.870743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:24.870743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:24.870743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:24.870743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:24.870743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:24.870743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.870743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:24.870743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:24.870743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.870743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:24.870743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:24.870743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.870743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:24.870743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:24.870743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:24.871189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:24.871714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.871714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:24.871714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.871714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.871714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:24.871714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.871714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:24.872998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:24.873350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:24.873484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:24.873615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:24.874102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:24.874507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.875214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:24.875214 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.875214 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:24.875214 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.875214 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.875214 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:24.875214 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.875214 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:24.875945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.875945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:24.875945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:24.875945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:24.875945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.875945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:24.875945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:24.875945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:24.875945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.875945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:24.875945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:24.875945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:24.875945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:24.875945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:24.875945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:24.876377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:24.876377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:24.876377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.876377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:24.876377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.876377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.876377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:24.876377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.876377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:24.876825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.876825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:24.876825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:24.876825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:24.876825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.876825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:24.876825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:24.876825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:24.876825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:24.876825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.876825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:24.877182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:24.877182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:24.877182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.877182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:24.877182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:24.877182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:24.877182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:24.877182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:24.877182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:24.877182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:24.877182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:24.877182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.877182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:24.877182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.877749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.877749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:24.877749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.877749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.877867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:24.878390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.878982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.878982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:24.878982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.878982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:24.971111 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:24.971687 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:24.971862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:24.972124 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:24.972827 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:24.973424 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:24.973731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.974870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:24.974870 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.974870 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:24.974870 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.974870 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.974870 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:24.974870 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.974870 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:24.976149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.976149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:24.976149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:24.976149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:24.976149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.976149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:24.976149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:24.976149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.976149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:24.976149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:24.976149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:24.976149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.976762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:24.976762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:24.976762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:24.976762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:24.976762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:24.976762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:24.976762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:24.976762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:24.976762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.976762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:24.976762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.976762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.976762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:24.977113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.977113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:24.977707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.977707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:24.977707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:24.977707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:24.977707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:24.977707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:24.977707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.977707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:24.977707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:24.977707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.977707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:24.977707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:24.977707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.977707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:24.977707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:24.977707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:24.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:24.978748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:24.978748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:24.978748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:29.795056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:29.795986 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:29.795986 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:29.797381 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:29.829024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:29.829517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.830215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:29.830215 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.830215 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:29.830215 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.830215 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.830215 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:29.830215 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.830215 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:29.830969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.830969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:29.830969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:29.830969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:29.830969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.830969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:29.830969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:29.830969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.830969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:29.830969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:29.830969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:29.830969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.832222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:29.832222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:29.832222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:29.832222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:29.832222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:29.832222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:29.832222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:29.832222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:29.832222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.832222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:29.832222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.832222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.832222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:29.833161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.833161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:29.833161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.833161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:29.833161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:29.833161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:29.833161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:29.833161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:29.833161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.833161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:29.833161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:29.833161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.833161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:29.833161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:29.833161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:29.833831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.835023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:29.835023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.835023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.835023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:29.835023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.835023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:29.858961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:29.859324 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:29.859478 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:29.860334 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:29.860729 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:29.860976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.861865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:29.861865 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.861865 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:29.861865 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.861865 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.861865 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:29.861865 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.861865 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:29.863279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.863279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:29.863279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:29.863279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:29.863279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.863279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:29.863279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:29.863279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.863279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:29.863279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:29.863279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:29.863279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.864543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:29.864543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:29.864543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:29.864543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:29.864543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:29.864543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:29.864543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:29.864543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:29.864543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.864543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:29.864543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.864543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.864543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:29.865795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.865795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:29.865795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.865795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:29.865795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:29.865795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:29.865795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:29.865795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:29.865795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.865795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:29.865795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:29.865795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.865795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:29.865795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:29.865795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:29.866671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.867148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:29.867148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.867148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.867148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:29.867148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.867148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:29.867148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:29.867148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:29.867148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:29.867148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:50:29.867753 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:29.867753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.868390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:29.868390 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.868390 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:29.868390 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.868390 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.868390 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:29.868390 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.868390 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:29.869123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.869123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:29.869123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:29.869123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:29.869123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.869123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:29.869123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:29.869123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:29.869123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.869123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:29.869123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:29.869123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:29.869123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:29.869123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:29.869123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:29.869773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:29.869773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:29.869773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.869773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:29.869773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.869773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.869773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:29.869773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.869773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:29.870137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.870137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:29.870137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:29.870137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:29.870137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.870137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:29.870137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:29.870137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:50:29.870137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:29.870137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:29.870137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.870137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:29.870663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:29.870663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:29.870663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.870663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:29.870663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:29.870663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:29.870663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:29.870663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:29.870663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:29.870663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:29.870663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:29.870663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.870663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:29.870663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.871229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.871229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:29.871229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.871229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:29.871229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.871229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:29.871229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:29.871229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:29.871229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:29.871229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:29.871229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.871229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:29.871229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:29.871229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:29.871817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:29.872839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:29.872839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:29.872839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:29.872839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:29.872839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:29.872839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.872839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:29.872839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.872839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.872839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:29.872839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.872839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:29.873788 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:29.874164 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:29.874273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:29.874429 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:29.874948 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:29.875324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.876134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:29.876134 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.876134 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:29.876134 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.876134 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.876134 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:29.876134 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.876134 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:29.876854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.876854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:29.876854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:29.876854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:29.876854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.876854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:29.876854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:29.876854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:29.876854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.876854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:29.876854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:29.876854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:29.876854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:29.876854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:29.876854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:29.877259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:29.877259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:29.877259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.877259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:29.877259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.877259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.877259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:29.877259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.877259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:29.877706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.877706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:29.877706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:29.877706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:29.877706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.877706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:29.877706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:29.877706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:29.877706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:29.877706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.877706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:29.878043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:29.878043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:29.878043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.878043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:29.878043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:29.878043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:29.878043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:29.878043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:29.878043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:29.878043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:29.878043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:29.878043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.878043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:29.878043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.878466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.878466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:29.878466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.878466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.878749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:29.879189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:29.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:29.972222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:29.973213 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:29.973426 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:29.973720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:29.974626 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:29.975148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:29.975477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.976481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:29.976481 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.976481 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:29.976481 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.976481 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.976481 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:29.976481 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.976481 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:29.977985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.977985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:29.977985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:29.977985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:29.977985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.977985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:29.977985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:29.977985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.977985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:29.977985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:29.977985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:29.977985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.978580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:29.978580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:29.978580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:29.978580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:29.978580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:29.978580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:29.978580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:29.978580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:29.978580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.978580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:29.978580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.978580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.978580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:29.979157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.979157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:29.979267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.979267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:29.979267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:29.979267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:29.979267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:29.979267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:29.979267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.979267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:29.979267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:29.979267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.979267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:29.979267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:29.979267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.979267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:29.979267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:29.979267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:29.979932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:29.981023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:29.981023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:29.981023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:34.795755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:34.796941 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:34.796941 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:34.797503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:34.832999 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:34.833344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.834189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:34.834189 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.834189 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:34.834189 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.834189 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.834189 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:34.834189 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.834189 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:34.835200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.835200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:34.835200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:34.835200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:34.835200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.835200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:34.835200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:34.835200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.835200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:34.835200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:34.835200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:34.835200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.836559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:34.836559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:34.836559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:34.836559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:34.836559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:34.836559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:34.836559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:34.836559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:34.836559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.836559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:34.836559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.836559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.836559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:34.837400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.837400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:34.837400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.837400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:34.837400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:34.837400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:34.837400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:34.837400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:34.837400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.837400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:34.837400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:34.837400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.837400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:34.837400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:34.837400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:34.838100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.838641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:34.838641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.838641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.838641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:34.838641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.838641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:34.859565 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:34.860062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:34.860277 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:34.861333 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:34.861555 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:34.861785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.862723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:34.862723 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.862723 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:34.862723 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.862723 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.862723 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:34.862723 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.862723 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:34.864126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.864126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:34.864126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:34.864126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:34.864126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.864126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:34.864126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:34.864126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.864126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:34.864126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:34.864126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:34.864126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.864795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:34.864795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:34.864795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:34.864795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:34.864795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:34.864795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:34.864795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:34.864795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:34.864795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.864795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:34.864795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.864795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.864795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:34.865336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.865336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:34.865837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.865837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:34.865837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:34.865837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:34.865837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:34.865837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:34.865837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.865837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:34.865837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:34.865837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.865837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:34.865837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:34.865837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.865837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:34.865837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:34.865837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.866596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.867596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:34.867596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.867596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:34.867596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:34.867596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:34.867596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:34.867596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:50:34.867596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:34.868263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.868494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:34.868494 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.868494 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:34.868494 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.868494 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.868494 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:34.868494 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.868494 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:34.869593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.869593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:34.869593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:34.869593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:34.869593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.869593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:34.869593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:34.869593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:34.869593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.869593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:34.869593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:34.869593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:34.869593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:34.869593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:34.869593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:34.870062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:34.870062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:34.870062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.870062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:34.870062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.870062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.870062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:34.870062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.870062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:34.871159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.871159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:34.871159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:34.871159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:34.871159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.871159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:34.871159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:34.871159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:50:34.871159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:34.871159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:34.871159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.871159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:34.871586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:34.871586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:34.871586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.871586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:34.871586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:34.871586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:34.871586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:34.871586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:34.871586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:34.871586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:34.871586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:34.871586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.871586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:34.871586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.871978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.871978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:34.871978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.871978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:34.872838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.872838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:34.872838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:34.872838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:34.872838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:34.872838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:34.872838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.872838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:34.872838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:34.872838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.872838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:34.872838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:34.872838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.872838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:34.872838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:34.872838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:34.873281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:34.873813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.873813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:34.873813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.873813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.873813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:34.873813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.873813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:34.874240 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:34.874517 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:34.874631 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:34.874755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:34.875178 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:34.875618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.876290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:34.876290 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.876290 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:34.876290 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.876290 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.876290 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:34.876290 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.876290 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:34.877048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.877048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:34.877048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:34.877048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:34.877048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.877048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:34.877048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:34.877048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:34.877048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.877048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:34.877048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:34.877048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:34.877048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:34.877048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:34.877048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:34.877524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:34.877524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:34.877524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.877524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:34.877524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.877524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.877524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:34.877524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.877524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:34.877901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.877901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:34.877901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:34.877901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:34.877901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.877901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:34.877901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:34.877901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:34.877901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:34.877901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.877901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:34.878238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:34.878238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:34.878238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.878238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:34.878238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:34.878238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:34.878238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:34.878238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:34.878238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:34.878238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:34.878238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:34.878238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.878238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:34.878238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.878635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.878635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:34.878635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.878635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.879032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:34.879553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.880089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.880089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:34.880089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.880089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:34.973113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:34.974199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:34.974484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:34.974842 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:34.975777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:34.976217 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:34.976506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.977546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:34.977546 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.977546 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:34.977546 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.977546 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.977546 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:34.977546 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.977546 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:34.979580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.979580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:34.979580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:34.979580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:34.979580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.979580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:34.979580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:34.979580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.979580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:34.979580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:34.979580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:34.979580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.980224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:34.980224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:34.980224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:34.980224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:34.980224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:34.980224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:34.980224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:34.980224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:34.980224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.980224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:34.980224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.980224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.980224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:34.980835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.980835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:34.981768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.981768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:34.981768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:34.981768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:34.981768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:34.981768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:34.981768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.981768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:34.981768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:34.981768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.981768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:34.981768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:34.981768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.981768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:34.981768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:34.981768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:34.982762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:34.983610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:34.983610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:34.983610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:39.796288 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:39.796924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:39.796924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:39.798548 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:39.843070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:39.843541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.844479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:39.844479 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.844479 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:39.844479 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.844479 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.844479 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:39.844479 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.844479 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:39.845577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.048 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.845577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:39.845577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:39.845577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:39.845577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.845577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:39.845577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:39.845577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.845577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:39.845577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:39.845577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:39.845577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.846215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:39.846215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:39.846215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:39.846215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:39.846215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:39.846215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:39.846215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:39.846215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:39.846215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.846215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:39.846215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.846215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.846215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:39.846938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.846938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:39.846938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.846938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:39.846938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:39.846938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:39.846938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:39.846938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:39.846938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.846938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:39.846938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:39.846938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.846938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:39.846938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:39.846938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:39.847716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.848732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:39.848732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.848732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.848732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:39.848732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.848732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:39.860131 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:39.860591 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:39.860780 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:39.861788 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:39.862136 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:39.862393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.863294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:39.863294 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.863294 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:39.863294 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.863294 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.863294 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:39.863294 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.863294 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:39.865031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.865031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:39.865031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:39.865031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:39.865031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.865031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:39.865031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:39.865031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.865031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:39.865031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:39.865031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:39.865031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.865889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:39.865889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:39.865889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:39.865889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:39.865889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:39.865889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:39.865889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:39.865889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:39.865889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.865889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:39.865889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.865889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.865889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:39.866564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.866564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:39.866692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.866692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:39.866692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:39.866692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:39.866692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:39.866692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:39.866692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.866692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:39.866692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:39.866692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.866692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:39.866692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:39.866692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.866692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:39.866692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:39.866692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.868515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:39.868515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.868515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:39.868515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:39.868515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:39.868515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:39.868515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:50:39.868515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:39.869063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.869360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:39.869360 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.869360 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:39.869360 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.869360 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.869360 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:39.869360 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.869360 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:39.870569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.870569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:39.870569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:39.870569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:39.870569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.870569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:39.870569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:39.870569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:39.870569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.870569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:39.870569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:39.870569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:39.870569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:39.870569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:39.870569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:39.871103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:39.871103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:39.871103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.871103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:39.871103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.871103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.871103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:39.871103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.871103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:39.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:39.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:39.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:39.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:39.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:39.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:50:39.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:39.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:39.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:39.872383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:39.872383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:39.872383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.872383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:39.872383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:39.872383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:39.872383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:39.872383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:39.872383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:39.872383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:39.872383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:39.872383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.872383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:39.872383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.872782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.872782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:39.872782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.872782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:39.873623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.873623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:39.873623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:39.873623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:39.873623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:39.873623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:39.873623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.873623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:39.873623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:39.873623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.873623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:39.873623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:39.873623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.873623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:39.873623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:39.873623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:39.874121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:39.874642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.874642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:39.874642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.874642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.874642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:39.874642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.874642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:39.874642 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:39.874964 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:39.875125 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:39.875266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:39.876127 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:39.876514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.877166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:39.877166 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.877166 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:39.877166 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.877166 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.877166 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:39.877166 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.877166 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:39.878019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.878019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:39.878019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:39.878019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:39.878019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.878019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:39.878019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:39.878019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:39.878019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.878019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:39.878019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:39.878019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:39.878019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:39.878019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:39.878019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:39.878462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:39.878462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:39.878462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.878462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:39.878462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.878462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.878462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:39.878462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.878462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:39.878907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.878907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:39.878907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:39.878907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:39.878907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.878907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:39.878907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:39.878907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:39.878907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:39.878907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.878907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:39.879291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:39.879291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:39.879291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.879291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:39.879291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:39.879291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:39.879291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:39.879291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:39.879291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:39.879291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:39.879291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:39.879291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.879291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:39.879291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.879710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.879710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:39.879710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.879710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.879934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:39.880428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.880907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.880907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:39.880907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.880907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:39.973960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:39.974567 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:39.974749 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:39.975023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:39.975786 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:39.976229 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:39.976541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.977449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:39.977449 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.977449 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:39.977449 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.977449 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.977449 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:39.977449 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.977449 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:39.979131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.979131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:39.979131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:39.979131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:39.979131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.979131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:39.979131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:39.979131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.979131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:39.979131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:39.979131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:39.979131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.979798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:39.979798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:39.979798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:39.979798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:39.979798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:39.979798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:39.979798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:39.979798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:39.979798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.979798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:39.979798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.979798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.979798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:39.980389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.980389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:39.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:39.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:39.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:39.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:39.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:39.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:39.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:39.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:39.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:39.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:39.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:39.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:39.981525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:39.982638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:39.982638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:39.982638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:44.796991 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:44.797759 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:44.797759 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:44.798761 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:44.834289 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:44.834567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.835665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:44.835665 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.835665 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:44.835665 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.835665 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.835665 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:44.835665 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.835665 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:44.837213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.837213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:44.837213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:44.837213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:44.837213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.837213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:44.837213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:44.837213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.837213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:44.837213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:44.837213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:44.837213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.837702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:44.837702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:44.837702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:44.837702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:44.837702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:44.837702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:44.837702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:44.837702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:44.837702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.837702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:44.837702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.837702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.837702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:44.838115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.838115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:44.839568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.839568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:44.839568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:44.839568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:44.839568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:44.839568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:44.839568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.839568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:44.839568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:44.839568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.839568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:44.839568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:44.839568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.839568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:44.839568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:44.839568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.840234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.840856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:44.840856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.840856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:44.860896 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:44.861454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:44.861657 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:44.862876 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:44.863236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:44.863394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.864092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:44.864092 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.864092 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:44.864092 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.864092 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.864092 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:44.864092 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.864092 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:44.865792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.865792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:44.865792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:44.865792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:44.865792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.865792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:44.865792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:44.865792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.865792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:44.865792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:44.865792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:44.865792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.866575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:44.866575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:44.866575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:44.866575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:44.866575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:44.866575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:44.866575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:44.866575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:44.866575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.866575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:44.866575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.866575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.866575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:44.867332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.867332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:44.867674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.867674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:44.867674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:44.867674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:44.867674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:44.867674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:44.867674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.867674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:44.867674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:44.867674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.867674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:44.867674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:44.867674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.867674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:44.867674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:44.867674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.868653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:44.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:44.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:44.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:44.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:44.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:50:44.869589 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:44.870078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.870305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:44.870305 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.870305 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:44.870305 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.870305 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.870305 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:44.870305 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.870305 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:44.871116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.871116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:44.871116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:44.871116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:44.871116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.871116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:44.871116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:44.871116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:44.871116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.871116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:44.871116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:44.871116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:44.871116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:44.871116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:44.871116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:44.872072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:44.872072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:44.872072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.872072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:44.872072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.872072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.872072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:44.872072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.872072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:44.872604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.872604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:44.872604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:44.872604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:44.872604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.872604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:44.872604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:44.872604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:50:44.872604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:44.872604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:44.872604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.872604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:44.873255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:44.873255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:44.873255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.873255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:44.873255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:44.873255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:44.873255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:44.873255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:44.873255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:44.873255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:44.873255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:44.873255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.873255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:44.873255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.874030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.874030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:44.874030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.874030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:44.874030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.874030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:44.874030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:44.874030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:44.874030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:44.874030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:44.874030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.874030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:44.874030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:44.874030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:44.874791 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:44.876106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:44.876106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:44.876106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:44.876106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:44.876106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:44.876106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.876106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:44.876106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.876106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.876106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:44.876106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.876106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:44.876106 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:44.876106 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:44.876850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:44.876850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:44.876850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:44.876850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.877112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:44.877112 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.877112 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:44.877112 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.877112 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.877112 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:44.877112 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.877112 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:44.878156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.878156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:44.878156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:44.878156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:44.878156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.878156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:44.878156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:44.878156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:44.878156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.878156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:44.878156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:44.878156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:44.878156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:44.878156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:44.878156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:44.878665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:44.878665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:44.878665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.878665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:44.878665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.878665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.878665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:44.878665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.878665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:44.879462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.879462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:44.879462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:44.879462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:44.879462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.879462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:44.879462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:44.879462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:44.879462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:44.879462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.879462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:44.879820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:44.879820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:44.879820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.879820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:44.879820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:44.879820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:44.879820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:44.879820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:44.879820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:44.879820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:44.879820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:44.879820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.879820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:44.879820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.880219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.880219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:44.880219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.880219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.880904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:44.881439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.881996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.881996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:44.881996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.881996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:44.974622 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:44.975229 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:44.975511 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:44.975798 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:44.976682 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:44.977095 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:44.977344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.978317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:44.978317 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.978317 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:44.978317 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.978317 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.978317 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:44.978317 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.978317 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:44.980154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.980154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:44.980154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:44.980154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:44.980154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.980154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:44.980154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:44.980154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.980154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:44.980154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:44.980154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:44.980154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.980819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:44.980819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:44.980819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:44.980819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:44.980819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:44.980819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:44.980819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:44.980819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:44.980819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.980819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:44.980819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.980819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.980819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:44.981492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.981492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:44.981492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.981492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:44.981492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:44.981492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:44.981492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:44.981492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:44.981492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.981492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:44.981492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:44.981492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.981492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:44.981492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:44.981492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:44.982272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:44.983400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:44.983400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:44.983400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:44.983400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:44.983400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:44.983400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:49.797402 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:49.798257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:49.798257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:49.799677 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:49.836465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:49.836894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.837788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:49.837788 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.837788 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:49.837788 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.837788 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.837788 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:49.837788 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.837788 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:49.838836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.838836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:49.838836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:49.838836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:49.838836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.838836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:49.838836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:49.838836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.838836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:49.838836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:49.838836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:49.838836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.839480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:49.839480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:49.839480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:49.839480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:49.839480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:49.839480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:49.839480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:49.839480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:49.839480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.839480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:49.839480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.839480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.839480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:49.840127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.840127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:49.840127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.840127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:49.840127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:49.840127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:49.840127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:49.840127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:49.840127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.840127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:49.840127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:49.840127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.840127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:49.840127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:49.840127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:49.840951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.841942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:49.841942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.841942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.841942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:49.841942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.841942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:49.861515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:49.861818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:49.861907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:49.862958 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:49.863193 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:49.863358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.863994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:49.863994 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.863994 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:49.863994 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.863994 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.863994 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:49.863994 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.863994 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:49.864968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.864968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:49.864968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:49.864968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:49.864968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.864968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:49.864968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:49.864968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.864968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:49.864968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:49.864968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:49.864968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.865561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:49.865561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:49.865561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:49.865561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:49.865561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:49.865561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:49.865561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:49.865561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:49.865561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.865561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:49.865561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.865561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.865561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:49.866088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.866088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:49.866088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.866088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:49.866088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:49.866088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:49.866088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:49.866088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:49.866088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.866088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:49.866088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:49.866088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.866088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:49.866088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:49.866088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:49.866764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.867568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:49.867568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.867568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.867568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:49.867568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.867568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:49.868593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:49.868892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:49.869018 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:49.869141 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:50:49.869889 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:49.870185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.870929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:49.870929 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.870929 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:49.870929 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.870929 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.870929 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:49.870929 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.870929 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:49.871684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.871684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:49.871684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:49.871684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:49.871684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.871684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:49.871684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:49.871684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:49.871684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.871684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:49.871684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:49.871684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:49.871684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:49.871684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:49.871684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:49.872180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:49.872180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:49.872180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.872180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:49.872180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.872180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.872180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:49.872180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.872180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:49.872648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.872648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:49.872648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:49.872648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:49.872648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.872648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:49.872648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:49.872648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:50:49.872648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:49.872648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:49.872648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.872648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:49.873285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:49.873285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:49.873285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.873285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:49.873285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:49.873285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:49.873285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:49.873285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:49.873285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:49.873285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:49.873285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:49.873285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.873285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:49.873285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.873711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.873711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:49.873711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.873711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:49.874011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.874011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:49.874011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:49.874011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:49.874011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:49.874011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:49.874011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.874011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:49.874011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:49.874011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.874011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:49.874011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:49.874011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.874011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:49.874011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:49.874011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:49.874534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:49.875028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.875028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:49.875028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.875028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.875028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:49.875028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.875028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:49.875575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:49.875932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:49.876016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:49.876146 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:49.876500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:49.876763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.877276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:49.877276 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.877276 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:49.877276 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.877276 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.877276 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:49.877276 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.877276 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:49.878044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.878044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:49.878044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:49.878044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:49.878044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.878044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:49.878044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:49.878044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:49.878044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.878044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:49.878044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:49.878044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:49.878044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:49.878044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:49.878044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:49.878458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:49.878458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:49.878458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.878458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:49.878458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.878458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.878458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:49.878458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.878458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:49.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:49.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:49.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:49.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:49.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:49.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:49.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:49.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:49.879299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:49.879299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:49.879299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.879299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:49.879299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:49.879299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:49.879299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:49.879299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:49.879299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:49.879299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:49.879299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:49.879299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.879299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:49.879299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.879717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.879717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:49.879717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.879717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.880467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:49.880975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.881488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.881488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:49.881488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.881488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:49.975274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:49.975771 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:49.975914 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:49.976039 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:49.976665 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:49.976948 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:49.977103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.977806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:49.977806 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.977806 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:49.977806 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.977806 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.977806 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:49.977806 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.977806 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:49.979176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.979176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:49.979176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:49.979176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:49.979176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.979176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:49.979176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:49.979176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.979176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:49.979176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:49.979176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:49.979176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.979879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:49.979879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:49.979879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:49.979879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:49.979879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:49.979879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:49.979879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:49.979879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:49.979879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.979879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:49.979879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.979879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.979879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:49.980458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.980458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:49.980849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.980849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:49.980849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:49.980849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:49.980849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:49.980849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:49.980849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.980849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:49.980849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:49.980849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.980849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:49.980849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:49.980849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.980849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:49.980849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:49.980849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:49.981811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:49.982624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:49.982624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:49.982624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:54.798114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:54.799181 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:54.799181 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:54.800126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:54.801755 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=434 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:50:54.835355 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:54.835570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.836200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:54.836200 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.836200 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:54.836200 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.836200 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.836200 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:54.836200 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.836200 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:54.837143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.837143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:54.837143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:54.837143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:54.837143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.837143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:54.837143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:54.837143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.837143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:54.837143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:54.837143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:54.837143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.837908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:54.837908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:54.837908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:54.837908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:54.837908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:54.837908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:54.837908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:54.837908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:54.837908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.837908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:54.837908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.837908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.837908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:54.838803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.838803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:54.838803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.838803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:54.838803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:54.838803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:54.838803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:54.838803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:54.838803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.838803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:54.838803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:54.838803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.838803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:54.838803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:54.838803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:54.839674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.840809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:54.840809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.840809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.840809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:54.840809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.840809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:54.862193 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:54.862590 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:54.862687 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:54.863389 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:54.863687 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:54.863927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.864637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:54.864637 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.864637 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:54.864637 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.864637 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.864637 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:54.864637 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.864637 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:54.865502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.865502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:54.865502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:54.865502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:54.865502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.865502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:54.865502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:54.865502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.865502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:54.865502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:54.865502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:54.865502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.866107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:54.866107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:54.866107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:54.866107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:54.866107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:54.866107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:54.866107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:54.866107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:54.866107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.866107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:54.866107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.866107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.866107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:54.866744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.866744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:54.866744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.866744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:54.866744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:54.866744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:54.866744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:54.866744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:54.866744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.866744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:54.866744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:54.866744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.866744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:54.866744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:54.866744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:54.867494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.868339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:54.868339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.868339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.868339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:54.868339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.868339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:54.869051 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:54.869329 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:54.869463 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:54.869573 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:50:54.870000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:54.870316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.871003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:54.871003 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.871003 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:54.871003 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.871003 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.871003 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:54.871003 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.871003 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:54.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:54.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:54.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:54.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:54.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:54.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:54.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:54.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:54.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:54.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:54.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:54.871900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:54.872400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:54.872400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:54.872400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.872400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:54.872400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.872400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.872400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:54.872400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.872400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:54.872794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.872794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:54.872794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:54.872794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:54.872794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.872794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:54.872794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:54.872794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:50:54.872794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:54.872794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:54.872794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.872794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:54.873161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:54.873161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:54.873161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.873161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:54.873161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:54.873161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:54.873161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:54.873161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:54.873161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:54.873161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:54.873161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:54.873161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.873161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:54.873161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.873538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.873538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:54.873538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.873538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:54.873786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.873786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:54.873786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:54.873786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:54.873786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:54.873786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:54.873786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.873786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:54.873786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:54.873786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.873786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:54.873786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:54.873786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.873786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:54.873786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:54.873786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:54.874254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:54.874773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.874773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:54.874773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.874773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.874773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:54.874773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.874773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:54.876177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:54.876534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:54.876623 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:54.876759 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:54.877181 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:54.877598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.878243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:54.878243 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.878243 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:54.878243 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.878243 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.878243 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:54.878243 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.878243 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:54.879011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.879011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:54.879011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:54.879011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:54.879011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.879011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:54.879011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:54.879011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:54.879011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.879011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:54.879011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:54.879011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:54.879011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:54.879011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:54.879011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:54.879460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:54.879460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:54.879460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.879460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:54.879460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.879460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.879460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:54.879460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.879460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:54.879870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.879870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:54.879870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:54.879870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:54.879870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.879870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:54.879870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:54.879870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:54.879870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:54.879870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.879870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:54.880217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:54.880217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:54.880217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.880217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:54.880217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:54.880217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:54.880217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:54.880217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:54.880217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:54.880217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:54.880217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:54.880217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.880217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:54.880217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.880597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.880597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:54.880597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.880597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.881035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:54.881550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.882063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.882063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:54.882063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.882063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:54.975836 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:54.976207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:54.976392 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:54.976690 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:54.977128 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:54.977521 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:54.977740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.978510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:54.978510 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.978510 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:54.978510 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.978510 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.978510 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:54.978510 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.978510 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:54.980110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.980110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:54.980110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:54.980110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:54.980110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.980110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:54.980110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:54.980110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.980110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:54.980110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:54.980110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:54.980110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.980510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:54.980510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:54.980510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:54.980510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:54.980510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:54.980510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:54.980510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:54.980510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:54.980510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.980510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:54.980510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.980510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.980510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:54.980843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.980843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:54.981740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.981740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:54.981740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:54.981740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:54.981740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:54.981740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:54.981740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.981740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:54.981740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:54.981740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.981740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:54.981740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:54.981740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.981740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:54.981740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:54.981740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:54.982232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:54.982750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:54.982750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:54.982750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:59.799028 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:59.799818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:59.800094 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:59.801410 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:59.834505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:59.834778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.835511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:59.835511 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.835511 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:59.835511 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.835511 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.835511 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:59.835511 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.835511 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:59.836195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.836195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:59.836195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:59.836195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:59.836195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.836195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:59.836195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:59.836195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.836195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:59.836195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:59.836195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:59.836195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.836596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:59.836596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:59.836596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:59.836596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:59.836596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:59.836596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:59.836596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:59.836596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:59.836596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.836596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:59.836596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.836596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.836596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:59.836955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.836955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:59.837085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.837085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:59.837085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:59.837085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:59.837085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:59.837085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:59.837085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.837085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:59.837085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:59.837085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.837085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:59.837085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:59.837085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.837085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:59.837085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:59.837085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.837547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.838108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:59.838108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.838108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:59.862843 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:59.863260 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:59.863488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:59.864249 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:59.864578 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:59.864792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.865524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:59.865524 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.865524 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:59.865524 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.865524 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.865524 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:59.865524 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.865524 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:59.866868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.866868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:59.866868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:59.866868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:59.866868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.866868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:59.866868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:59.866868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.866868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:59.866868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:59.866868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:59.866868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.867267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:59.867267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:59.867267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:59.867267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:59.867267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:59.867267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:59.867267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:59.867267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:59.867267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.867267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:59.867267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.867267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.867267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:59.867671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.867671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:59.868637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.868637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:59.868637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:59.868637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:59.868637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:59.868637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:59.868637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.868637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:59.868637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:59.868637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.868637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:59.868637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:59.868637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.868637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:59.868637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:59.868637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.869062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.869592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:59.869592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.869592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:59.869592 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:59.869976 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:59.870140 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:59.870316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:50:59.870761 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:59.871007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.871703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:59.871703 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.871703 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:59.871703 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.871703 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.871703 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:59.871703 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.871703 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:59.872877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.872877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:59.872877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:59.872877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:59.872877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.872877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:59.872877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:59.872877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:59.872877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.872877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:59.872877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:59.872877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:59.872877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:59.872877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:59.872877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:59.873633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:59.873633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:59.873633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.873633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:59.873633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.873633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.873633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:59.873633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.873633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:59.874182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.874182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:59.874182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:59.874182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:59.874182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.874182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:59.874182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:59.874182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:50:59.874182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:59.874182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:59.874182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.874182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:59.874800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:59.874800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:59.874800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.874800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:59.874800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:59.874800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:59.874800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:59.874800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:59.874800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:59.874800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:59.874800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:59.874800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.874800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:59.874800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.875639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.875639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:59.875639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.875639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:59.875895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.875895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:59.875895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:59.875895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:59.875895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:59.875895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:59.875895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.875895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:59.875895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:59.875895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.875895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:59.875895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:59.875895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.875895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:59.875895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:59.875895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:59.876810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:59.877250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.877250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:59.877250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.877250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.877250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:59.877250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.877250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:59.877250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:59.877250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:59.877250 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:59.877580 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:59.877751 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:59.878097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.878751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:59.878751 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.878751 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:59.878751 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.878751 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.878751 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:59.878751 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.878751 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:59.879483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.879483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:50:59.879483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:59.879483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:59.879483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.879483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:59.879483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:59.879483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:59.879483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.879483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:50:59.879483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:59.879483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:50:59.879483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:59.879483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:50:59.879483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:50:59.879926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:59.879926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:50:59.879926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.879926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:50:59.879926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.879926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.879926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:50:59.879926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.879926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:50:59.880314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.880314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:59.880314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:59.880314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:59.880314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.880314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:59.880314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:59.880314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:59.880314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:59.880314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.880314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:59.880620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:59.880620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:59.880620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.880620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:59.880620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:59.880620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:59.880620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:59.880620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:59.880620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:59.880620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:59.880620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:59.880620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.880620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:59.880620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.881120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.881120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:59.881120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.881120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.881340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:59.881817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.882360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.882360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:59.882360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.882360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:50:59.976680 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:50:59.977172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:50:59.977308 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:50:59.977624 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:50:59.978184 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:59.978581 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:50:59.978786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.979597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:50:59.979597 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.979597 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:50:59.979597 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.979597 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.979597 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:50:59.979597 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.979597 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:50:59.981081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.981081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:50:59.981081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:59.981081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:50:59.981081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.981081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:59.981081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:59.981081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.981081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:59.981081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:59.981081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:59.981081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.981582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:50:59.981582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:59.981582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:50:59.981582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:59.981582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:50:59.981582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:50:59.981582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:59.981582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:50:59.981582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.981582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:50:59.981582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.981582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.981582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:50:59.982074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.982074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:50:59.982620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.982620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:50:59.982620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:50:59.982620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:50:59.982620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:50:59.982620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:50:59.982620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.982620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:50:59.982620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:50:59.982620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.982620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:50:59.982620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:50:59.982620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.982620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:50:59.982620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:50:59.982620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:50:59.983206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:50:59.983891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:50:59.983891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:50:59.983891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:04.799833 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:04.801744 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:04.801850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:04.802647 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:04.831785 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:04.832162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.833304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:04.833304 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.833304 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:04.833304 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.833304 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.833304 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:04.833304 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.833304 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:04.834554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.031 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.834554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:04.834554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:04.834554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:04.834554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.834554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:04.834554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:04.834554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.834554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:04.834554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:04.834554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:04.834554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.835224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:04.835224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:04.835224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:04.835224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:04.835224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:04.835224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:04.835224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:04.835224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:04.835224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.835224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:04.835224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.835224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.835224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:04.835842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.835842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:04.835842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.835842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:04.835842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:04.835842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:04.835842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:04.835842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:04.835842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.835842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:04.835842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:04.835842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.835842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:04.835842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:04.835842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:04.836729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.837575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:04.837575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.837575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.837575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:04.837575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.837575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:04.863532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:04.863951 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:04.864263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:04.865059 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:04.866730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:04.866730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.866730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:04.866730 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.866730 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:04.866730 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.866730 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.866730 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:04.866730 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.866730 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:04.868047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.868047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:04.868047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:04.868047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:04.868047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.868047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:04.868047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:04.868047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.868047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:04.868047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:04.868047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:04.868047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.868761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:04.868761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:04.868761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:04.868761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:04.868761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:04.868761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:04.868761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:04.868761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:04.868761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.868761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:04.868761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.868761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.868761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:04.869504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.869504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:04.869827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.869827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:04.869827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:04.869827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:04.869827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:04.869827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:04.869827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.869827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:04.869827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:04.869827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.869827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:04.869827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:04.869827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.869827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:04.869827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:04.869827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.870590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.871133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:04.871133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.871133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:04.871133 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:04.871133 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:04.871133 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:04.871133 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:51:04.871695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:04.871976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.872829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:04.872829 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.872829 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:04.872829 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.872829 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.872829 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:04.872829 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.872829 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:04.873599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.873599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:04.873599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:04.873599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:04.873599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.873599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:04.873599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:04.873599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:04.873599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.873599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:04.873599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:04.873599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:04.873599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:04.873599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:04.873599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:04.874034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:04.874034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:04.874034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.874034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:04.874034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.874034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.874034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:04.874034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.874034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:04.874475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.874475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:04.874475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:04.874475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:04.874475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.874475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:04.874475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:04.874475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:51:04.874475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:04.874475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:04.874475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.874475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:04.875132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:04.875132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:04.875132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.875132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:04.875132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:04.875132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:04.875132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:04.875132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:04.875132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:04.875132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:04.875132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:04.875132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.875132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:04.875132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.875869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.875869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:04.875869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.875869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:04.875869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.875869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:04.875869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:04.875869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:04.875869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:04.875869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:04.875869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.875869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:04.875869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:04.875869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:04.876205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:04.876680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:04.876680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:04.876680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:04.876680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:04.876680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:04.876680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.876680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:04.876680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.876680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.876680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:04.876680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.876680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:04.877358 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:04.877513 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:04.877609 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:04.877733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:04.878351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:04.878864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.879747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:04.879747 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.879747 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:04.879747 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.879747 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.879747 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:04.879747 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.879747 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:04.880491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.880491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:04.880491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:04.880491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:04.880491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.880491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:04.880491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:04.880491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:04.880491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.880491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:04.880491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:04.880491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:04.880491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:04.880491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:04.880491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:04.881323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:04.881323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:04.881323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.881323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:04.881323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.881323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.881323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:04.881323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.881323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:04.881323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.881323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:04.881323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:04.881323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:04.881323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.882180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:04.882180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:04.882180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:04.882180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:04.882180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.882180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:04.882180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:04.882180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:04.882180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.882180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:04.882180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:04.882180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:04.882180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:04.882568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:04.882568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:04.882568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:04.882568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:04.882568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.882568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:04.882568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.882568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.882568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:04.882568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.882568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:04.882568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:04.882862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.883346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:04.977388 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:04.978556 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:04.978556 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:04.978556 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:04.979207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:04.979739 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:04.980101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.981026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:04.981026 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.981026 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:04.981026 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.981026 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.981026 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:04.981026 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.981026 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:04.982557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.982557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:04.982557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:04.982557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:04.982557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.982557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:04.982557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:04.982557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.982557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:04.982557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:04.982557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:04.982557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.983182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:04.983182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:04.983182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:04.983182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:04.983182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:04.983182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:04.983182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:04.983182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:04.983182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.983182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:04.983182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.983182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.983182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:04.983872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.983872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:04.984276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.984276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:04.984276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:04.984276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:04.984276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:04.984276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:04.984276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.984276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:04.984276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:04.984276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.984276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:04.984276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:04.984276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.984276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:04.984276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:04.984276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:04.985037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:04.985896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:04.985896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:04.985896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:09.808068 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:09.808797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:09.809287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:09.810381 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:09.842226 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:09.842835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.844078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:09.844078 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.844078 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:09.844078 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.844078 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.844078 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:09.844078 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.844078 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:09.844962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.844962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:09.844962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:09.844962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:09.844962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.844962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:09.844962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:09.844962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.844962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:09.844962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:09.844962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:09.844962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.845243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:09.845243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:09.845243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:09.845243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:09.845243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:09.845243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:09.845243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:09.845243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:09.845243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.845243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:09.845243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.845243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.845243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:09.845557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.845557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:09.845744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.845744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:09.845744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:09.845744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:09.845744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:09.845744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:09.845744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.845744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:09.845744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:09.845744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.845744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:09.845744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:09.845744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.845744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:09.845744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:09.845744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.846737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.847573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:09.847573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.847573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:09.863931 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:09.864351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:09.864577 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:09.866311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:09.866311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:09.866311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.867281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:09.867281 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.867281 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:09.867281 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.867281 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.867281 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:09.867281 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.867281 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:09.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:09.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:09.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:09.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:09.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:09.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:09.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:09.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:09.868751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.869417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:09.869417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:09.869417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:09.869417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:09.869417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:09.869417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:09.869417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:09.869417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:09.869417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.869417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:09.869417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.869417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.869417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:09.869983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.869983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:09.870409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.870409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:09.870409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:09.870409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:09.870409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:09.870409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:09.870409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.870409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:09.870409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:09.870409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.870409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:09.870409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:09.870409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.870409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:09.870409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:09.870409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.871281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.872224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:09.872224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.872224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:09.872224 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:09.872224 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:09.872224 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:09.872224 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:51:09.872224 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:09.872703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.873228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:09.873228 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.873228 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:09.873228 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.873228 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.873228 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:09.873228 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.873228 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:09.873871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.873871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:09.873871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:09.873871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:09.873871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.873871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:09.873871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:09.873871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:09.873871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.873871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:09.873871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:09.873871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:09.873871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:09.873871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:09.873871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:09.874690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:09.874690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:09.874690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.874690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:09.874690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.874690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.874690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:09.874690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.874690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:09.874690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.874690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:09.874690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:09.874690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:09.874690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.875752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:09.875752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:09.875752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:51:09.875752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:09.875752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:09.875752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.875752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:09.875752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:09.875752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:09.875752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.875752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:09.875752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:09.875752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:09.876216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:09.876216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:09.876216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:09.876216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:09.876216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:09.876216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.876216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:09.876216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.876216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.876216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:09.876216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.876216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:09.876487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.876487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:09.876487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:09.876487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:09.876487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:09.876487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:09.876487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.876487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:09.876487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:09.876487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.876487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:09.876487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:09.876487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.876487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:09.876487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:09.876487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:09.876831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:09.877218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.877218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:09.877218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.877218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.877218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:09.877218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.877218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:09.877529 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:09.877726 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:09.877834 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:09.877954 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:09.878333 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:09.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.879278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:09.879278 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.879278 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:09.879278 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.879278 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.879278 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:09.879278 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.879278 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:09.880054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.880054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:09.880054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:09.880054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:09.880054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.880054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:09.880054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:09.880054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:09.880054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.880054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:09.880054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:09.880054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:09.880054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:09.880054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:09.880054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:09.880359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:09.880359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:09.880359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.880359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:09.880359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.880359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.880359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:09.880359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.880359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:09.880934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.880934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:09.880934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:09.880934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:09.880934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.880934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:09.880934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:09.880934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:09.880934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:09.880934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.880934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:09.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:09.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:09.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:09.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:09.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:09.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:09.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:09.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:09.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:09.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:09.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:09.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.881516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.881516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:09.881516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.881516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.882271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:09.882646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.883002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.883002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:09.883002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.883002 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:09.978169 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:09.978954 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:09.979217 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:09.979584 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:09.980590 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:09.980895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:09.980976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.981784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:09.981784 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.981784 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:09.981784 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.981784 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.981784 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:09.981784 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.981784 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:09.983734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.983734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:09.983734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:09.983734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:09.983734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.983734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:09.983734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:09.983734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.983734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:09.983734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:09.983734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:09.983734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.984467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:09.984467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:09.984467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:09.984467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:09.984467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:09.984467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:09.984467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:09.984467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:09.984467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.984467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:09.984467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.984467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.984467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:09.985155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.985155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:09.985155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.985155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:09.985155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:09.985155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:09.985155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:09.985155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:09.985155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.985155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:09.985155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:09.985155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.985155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:09.985155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:09.985155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:09.985894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:09.986755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:09.986755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:09.986755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:09.986755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:09.986755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:09.986755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:14.808919 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:14.810156 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:14.810337 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:14.811640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:14.847488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:14.847849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.848620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:14.848620 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.848620 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:14.848620 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.848620 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.848620 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:14.848620 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.848620 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:14.849547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.849547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:14.849547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:14.849547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:14.849547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.849547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:14.849547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:14.849547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.849547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:14.849547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:14.849547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:14.849547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.850429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:14.850429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:14.850429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:14.850429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:14.850429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:14.850429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:14.850429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:14.850429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:14.850429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.850429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:14.850429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.850429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.850429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:14.851116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.851116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:14.851116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.851116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:14.851116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:14.851116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:14.851116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:14.851116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:14.851116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.851116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:14.851116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:14.851116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.851116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:14.851116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:14.851116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:14.851951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.852930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:14.852930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.852930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.852930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:14.852930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.852930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:14.864822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:14.865263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:14.865476 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:14.866230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:14.866558 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:14.866757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.867449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:14.867449 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.867449 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:14.867449 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.867449 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.867449 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:14.867449 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.867449 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:14.868806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.868806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:14.868806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:14.868806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:14.868806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.868806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:14.868806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:14.868806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.868806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:14.868806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:14.868806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:14.868806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.869400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:14.869400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:14.869400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:14.869400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:14.869400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:14.869400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:14.869400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:14.869400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:14.869400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.869400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:14.869400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.869400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.869400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:14.869951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.869951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:14.870468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.870468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:14.870468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:14.870468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:14.870468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:14.870468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:14.870468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.870468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:14.870468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:14.870468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.870468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:14.870468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:14.870468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.870468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:14.870468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:14.870468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.871180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.872120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:14.872120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.872120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:14.872120 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:14.872120 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:14.872120 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:14.872120 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:51:14.872120 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:14.872628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.873026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:14.873026 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.873026 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:14.873026 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.873026 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.873026 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:14.873026 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.873026 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:14.873716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.873716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:14.873716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:14.873716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:14.873716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.873716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:14.873716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:14.873716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:14.873716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.873716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:14.873716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:14.873716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:14.873716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:14.873716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:14.873716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:14.874609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:14.874609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:14.874609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.874609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:14.874609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.874609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.874609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:14.874609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.874609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:14.874609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.874609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:14.874609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:14.874609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:14.874609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.875357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:14.875357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:14.875357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:51:14.875357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:14.875357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:14.875357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.875357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:14.875357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:14.875357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:14.875357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.875357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:14.875357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:14.875357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:14.876148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:14.876148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:14.876148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:14.876148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:14.876148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:14.876148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.876148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:14.876148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.876148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.876148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:14.876148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.876148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:14.876805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.876805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:14.876805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:14.876805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:14.876805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:14.876805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:14.876805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.876805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:14.876805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:14.876805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.876805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:14.876805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:14.876805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.876805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:14.876805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:14.876805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:14.877662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:14.879109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.879109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:14.879109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.879109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.879109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:14.879109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.879109 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:14.879109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:14.879109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:14.879109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:14.879410 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:14.879410 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:14.879571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.880166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:14.880166 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.880166 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:14.880166 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.880166 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.880166 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:14.880166 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.880166 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:14.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:14.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:14.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:14.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:14.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:14.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:14.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:14.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:14.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:14.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:14.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:14.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:14.881855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:14.881855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:14.881855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.881855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:14.881855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.881855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.881855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:14.881855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.881855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:14.882993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.882993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:14.882993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:14.882993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:14.882993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.882993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:14.882993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:14.882993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:14.882993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:14.882993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.882993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:14.883315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:14.883315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:14.883315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.883315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:14.883315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:14.883315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:14.883315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:14.883315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:14.883315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:14.883315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:14.883315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:14.883315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.883315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:14.883315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.883674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.883674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:14.883674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.883674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.884793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:14.885243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.885705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.885705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:14.885705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.885705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:14.979044 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:14.979606 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:14.979797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:14.980062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:14.980577 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:14.980964 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:14.981243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.982057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:14.982057 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.982057 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:14.982057 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.982057 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.982057 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:14.982057 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.982057 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:14.983471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.983471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:14.983471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:14.983471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:14.983471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.983471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:14.983471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:14.983471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.983471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:14.983471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:14.983471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:14.983471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.984100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:14.984100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:14.984100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:14.984100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:14.984100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:14.984100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:14.984100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:14.984100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:14.984100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.984100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:14.984100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.984100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.984100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:14.984695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.984695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:14.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:14.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:14.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:14.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:14.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:14.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:14.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:14.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:14.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:14.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:14.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:14.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:14.985562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:14.986066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:14.986066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:14.986066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:19.810270 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:19.811116 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:19.811116 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:19.812350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:19.850967 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:19.851342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.852358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:19.852358 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:19.852358 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:19.852358 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:19.852358 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:19.852358 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:19.852358 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.852358 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:19.853107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.853107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:19.853107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:19.853107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:19.853107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.853107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:19.853107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:19.853107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.853107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:19.853107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:19.853107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:19.853107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:19.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:19.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:19.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:19.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:19.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:19.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:19.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:19.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:19.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:19.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:19.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:19.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:19.854479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.854479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:19.854479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.854479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:19.854479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:19.854479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:19.854479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:19.854479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:19.854479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.854479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:19.854479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:19.854479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.854479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:19.854479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:19.854479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:19.855224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:19.856169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:19.856169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:19.856169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:19.856169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:19.856169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.856169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:19.865614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:19.865893 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:19.865966 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:19.866641 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:19.866971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:19.867204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.867970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:19.867970 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:19.867970 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:19.867970 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:19.867970 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:19.867970 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:19.867970 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.867970 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:19.869353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.869353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:19.869353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:19.869353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:19.869353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.869353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:19.869353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:19.869353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.869353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:19.869353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:19.869353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:19.869353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.869934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:19.869934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:19.869934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:19.869934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:19.869934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:19.869934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:19.869934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:19.869934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:19.869934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:19.869934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:19.869934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:19.869934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:19.869934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:19.870494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.870494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:19.870961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.870961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:19.870961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:19.870961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:19.870961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:19.870961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:19.870961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.870961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:19.870961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:19.870961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.870961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:19.870961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:19.870961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.870961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:19.870961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:19.870961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:19.871720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:19.872569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:19.872569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.872569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:19.872569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:19.872569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:19.872569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:19.872569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:51:19.872964 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:19.873262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.874024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:19.874024 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:19.874024 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:19.874024 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:19.874024 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:19.874024 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:19.874024 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.874024 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:19.874885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.874885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:19.874885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:19.874885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:19.874885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.874885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:19.874885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:19.874885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:19.874885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.874885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:19.874885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:19.874885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:19.874885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:19.874885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:19.874885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:19.875921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:19.875921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:19.875921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:19.875921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:19.875921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:19.875921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:19.875921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:19.875921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.875921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:19.875921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.875921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:19.875921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:19.875921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:19.875921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.876714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:19.876714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:19.876714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:51:19.876714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:19.876714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:19.876714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.876714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:19.876714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:19.876714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:19.876714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.876714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:19.876714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:19.876714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:19.877361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:19.877361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:19.877361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:19.877361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:19.877361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:19.877361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:19.877361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:19.877361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:19.877361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:19.877361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:19.877361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.877361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:19.877963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.877963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:19.877963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:19.877963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:19.877963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:19.877963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:19.877963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.877963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:19.877963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:19.877963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.877963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:19.877963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:19.877963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.877963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:19.877963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:19.877963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:19.878750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:19.879640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:19.879640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:19.879640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:19.879640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:19.879640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:19.879640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.879640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:19.879640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:19.879640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:19.879640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:19.880159 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:19.880159 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:19.880632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.881335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:19.881335 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:19.881335 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:19.881335 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:19.881335 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:19.881335 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:19.881335 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.881335 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:19.882089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.882089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:19.882089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:19.882089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:19.882089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.882089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:19.882089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:19.882089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:19.882089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.882089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:19.882089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:19.882089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:19.882089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:19.882089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:19.882089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:19.882539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:19.882539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:19.882539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:19.882539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:19.882539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:19.882539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:19.882539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:19.882539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.882539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:19.883017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.883017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:19.883017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:19.883017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:19.883017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.883017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:19.883017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:19.883017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:19.883017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:19.883017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.883017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:19.883511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:19.883511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:19.883511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.883511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:19.883511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:19.883511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:19.883511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:19.883511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:19.883511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:19.883511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:19.883511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:19.883511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:19.883511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:19.883511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:19.884064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:19.884064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:19.884064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.884064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:19.884064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.884064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:19.884064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:19.884064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:19.884064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:19.884064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:19.884064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.884064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:19.884064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:19.884064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:19.884578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:19.885108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:19.885108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:19.885108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:19.885108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:19.885108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:19.885108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:19.885108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:19.885108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:19.885108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:19.885108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:19.885108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:19.979754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:19.980198 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:19.980323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:19.980506 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:20.023472 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:20.023912 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:20.024159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:20.025034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:20.025034 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:20.025034 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:20.025034 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:20.025034 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:20.025034 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:20.025034 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:20.025034 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:20.026517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.045 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:20.026517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:20.026517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:20.026517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:20.026517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:20.026517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:20.026517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:20.026517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:20.026517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:20.026517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:20.026517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:20.026517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:20.027236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:20.027236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:20.027236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:20.027236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:20.027236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:20.027236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:20.027236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:20.027236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:20.027236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:20.027236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:20.027236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:20.027236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:20.027236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:20.027968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:20.027968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:20.027968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:20.027968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:20.027968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:20.027968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:20.027968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:20.027968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:20.027968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:20.027968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:20.027968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:20.027968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:20.027968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:20.027968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:20.027968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:20.028790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:20.029922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:20.029922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:20.029922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:20.029922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:20.029922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:20.029922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:24.811197 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:24.812111 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:24.812111 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:24.813105 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:24.847239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:24.847644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.848334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:24.848334 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.848334 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:24.848334 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.848334 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.848334 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:24.848334 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.848334 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:24.848985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.848985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:24.848985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:24.848985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:24.848985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.848985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:24.848985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:24.848985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.848985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:24.848985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:24.848985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:24.848985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.849753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:24.849753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:24.849753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:24.849753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:24.849753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:24.849753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:24.849753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:24.849753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:24.849753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.849753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:24.849753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.849753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.849753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:24.850514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.850514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:24.850514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.850514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:24.850514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:24.850514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:24.850514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:24.850514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:24.850514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.850514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:24.850514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:24.850514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.850514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:24.850514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:24.850514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:24.851335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.852464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:24.852464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.852464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.852464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:24.852464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.852464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:24.866176 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:24.866652 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:24.866884 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:24.867580 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:24.867763 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:24.867891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.868512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:24.868512 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.868512 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:24.868512 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.868512 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.868512 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:24.868512 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.868512 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:24.870031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.870031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:24.870031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:24.870031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:24.870031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.870031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:24.870031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:24.870031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.870031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:24.870031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:24.870031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:24.870031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.870979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:24.870979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:24.870979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:24.870979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:24.870979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:24.870979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:24.870979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:24.870979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:24.870979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.870979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:24.870979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.870979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.870979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:24.871902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.871902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:24.872053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.872053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:24.872053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:24.872053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:24.872053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:24.872053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:24.872053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.872053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:24.872053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:24.872053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.872053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:24.872053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:24.872053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.872053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:24.872053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:24.872053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.872793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.873534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:24.873534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.873534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:24.873534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:24.873534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:24.873534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:24.873534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:51:24.873534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:24.873897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.874933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:24.874933 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.874933 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:24.874933 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.874933 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.874933 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:24.874933 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.874933 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:24.876064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.876064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:24.876064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:24.876064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:24.876064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.876064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:24.876064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:24.876064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:24.876064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.876064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:24.876064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:24.876064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:24.876064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:24.876064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:24.876064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:24.876758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:24.876758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:24.876758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.876758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:24.876758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.876758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.876758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:24.876758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.876758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:24.877230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.877230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:24.877230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:24.877230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:24.877230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.877230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:24.877230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:24.877230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:51:24.877230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:24.877230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:24.877230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.877230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:24.877689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:24.877689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:24.877689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.877689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:24.877689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:24.877689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:24.877689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:24.877689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:24.877689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:24.877689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:24.877689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:24.877689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.877689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:24.877689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.878072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.878072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:24.878072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.878072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:24.878667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.878667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:24.878667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:24.878667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:24.878667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:24.878667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:24.878667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.878667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:24.878667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:24.878667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.878667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:24.878667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:24.878667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.878667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:24.878667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:24.878667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:24.879111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:24.879649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.879649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:24.879649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.879649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.879649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:24.879649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.879649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:24.879649 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:24.879915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:24.879963 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:24.880087 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:24.880540 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:24.880866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.881486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:24.881486 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.881486 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:24.881486 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.881486 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.881486 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:24.881486 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.881486 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:24.882233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.882233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:24.882233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:24.882233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:24.882233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.882233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:24.882233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:24.882233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:24.882233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.882233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:24.882233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:24.882233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:24.882233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:24.882233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:24.882233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:24.882645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:24.882645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:24.882645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.882645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:24.882645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.882645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.882645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:24.882645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.882645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:24.883171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.883171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:24.883171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:24.883171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:24.883171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.883171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:24.883171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:24.883171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:24.883171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:24.883171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.883171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:24.883528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:24.883528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:24.883528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.883528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:24.883528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:24.883528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:24.883528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:24.883528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:24.883528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:24.883528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:24.883528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:24.883528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.883528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:24.883528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.883943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.883943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:24.883943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.883943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.884345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:24.884840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.885338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.885338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:24.885338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.885338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:24.980263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:24.980828 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:24.981010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:24.981305 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:24.981756 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:24.982011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:24.982162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.982830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:24.982830 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.982830 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:24.982830 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.982830 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.982830 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:24.982830 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.982830 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:24.984123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.984123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:24.984123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:24.984123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:24.984123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.984123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:24.984123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:24.984123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.984123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:24.984123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:24.984123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:24.984123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.984434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:24.984434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:24.984434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:24.984434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:24.984434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:24.984434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:24.984434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:24.984434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:24.984434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.984434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:24.984434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.984434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.984434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:24.984754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.984754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:24.985826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.985826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:24.985826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:24.985826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:24.985826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:24.985826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:24.985826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.985826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:24.985826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:24.985826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.985826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:24.985826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:24.985826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.985826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:24.985826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:24.985826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:24.986708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:24.987683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:24.987683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:24.987683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:29.811914 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:29.812791 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:29.812791 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:29.813953 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:29.846022 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:29.846236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.846820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:29.846820 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.846820 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:29.846820 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.846820 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.846820 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:29.846820 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.846820 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:29.847592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.847592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:29.847592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:29.847592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:29.847592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.847592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:29.847592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:29.847592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.847592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:29.847592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:29.847592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:29.847592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.848773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:29.848773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:29.848773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:29.848773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:29.848773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:29.848773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:29.848773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:29.848773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:29.848773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.848773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:29.848773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.848773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.848773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:29.849662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.849662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:29.849662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.849662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:29.849662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:29.849662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:29.849662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:29.849662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:29.849662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.849662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:29.849662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:29.849662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.849662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:29.849662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:29.849662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:29.850482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.851464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:29.851464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.851464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.851464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:29.851464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.851464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:29.867667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:29.868057 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:29.868234 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:29.868921 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:29.869099 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:29.869200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.869723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:29.869723 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.869723 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:29.869723 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.869723 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.869723 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:29.869723 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.869723 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:29.871099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.871099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:29.871099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:29.871099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:29.871099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.871099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:29.871099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:29.871099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.871099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:29.871099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:29.871099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:29.871099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.871770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:29.871770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:29.871770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:29.871770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:29.871770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:29.871770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:29.871770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:29.871770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:29.871770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.871770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:29.871770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.871770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.871770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:29.872345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.872345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:29.872704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.872704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:29.872704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:29.872704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:29.872704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:29.872704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:29.872704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.872704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:29.872704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:29.872704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.872704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:29.872704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:29.872704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.872704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:29.872704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:29.872704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.873463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.874292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:29.874292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.874292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:29.874292 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:29.874292 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:29.874292 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:29.874292 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:51:29.874292 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:29.874787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.874787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:29.874787 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.874787 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:29.874787 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.874787 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.874787 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:29.874787 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.874787 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:29.875795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.875795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:29.875795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:29.875795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:29.875795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.875795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:29.875795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:29.875795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:29.875795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.875795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:29.875795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:29.875795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:29.875795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:29.875795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:29.875795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:29.876304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:29.876304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:29.876304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.876304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:29.876304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.876304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.876304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:29.876304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.876304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:29.876628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.876628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:29.876628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:29.876628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:29.876628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.876628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:29.876628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:29.876628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:51:29.876628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:29.876628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:29.876628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.876628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:29.876984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:29.876984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:29.876984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.876984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:29.876984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:29.876984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:29.876984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:29.876984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:29.876984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:29.876984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:29.876984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:29.876984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.876984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:29.876984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.877345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.877345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:29.877345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.877345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:29.877680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.877680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:29.877680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:29.877680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:29.877680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:29.877680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:29.877680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.877680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:29.877680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:29.877680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.877680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:29.877680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:29.877680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.877680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:29.877680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:29.877680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:29.878327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:29.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:29.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:29.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.878977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:29.879894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:29.880126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:29.880237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:29.880376 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:29.880979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:29.881552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.883045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:29.883045 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.883045 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:29.883045 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.883045 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.883045 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:29.883045 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.883045 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:29.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:29.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:29.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:29.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:29.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:29.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:29.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:29.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:29.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:29.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:29.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:29.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:29.884170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:29.884170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:29.884170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.884170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:29.884170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.884170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.884170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:29.884170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.884170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:29.884761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.884761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:29.884761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:29.884761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:29.884761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.884761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:29.884761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:29.884761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:29.884761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:29.884761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.884761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:29.885015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:29.885015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:29.885015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.885015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:29.885015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:29.885015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:29.885015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:29.885015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:29.885015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:29.885015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:29.885015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:29.885015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.885015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:29.885015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.885298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.885298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:29.885298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.885298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.885856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:29.886223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.886676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.886676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:29.886676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.886676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:29.980934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:29.981537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:29.982000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:29.982000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:29.982433 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:29.982687 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:29.982866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.983556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:29.983556 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.983556 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:29.983556 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.983556 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.983556 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:29.983556 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.983556 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:29.984944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.984944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:29.984944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:29.984944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:29.984944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.984944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:29.984944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:29.984944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.984944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:29.984944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:29.984944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:29.984944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.985616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:29.985616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:29.985616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:29.985616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:29.985616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:29.985616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:29.985616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:29.985616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:29.985616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.985616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:29.985616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.985616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.985616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:29.986155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.986155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:29.986804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.986804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:29.986804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:29.986804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:29.986804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:29.986804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:29.986804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.986804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:29.986804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:29.986804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.986804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:29.986804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:29.986804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.986804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:29.986804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:29.986804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:29.987691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:29.988189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:29.988189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:29.988189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:34.812651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:34.813761 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:34.813761 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:34.814900 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:34.850026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:34.850554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.851516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:34.851516 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.851516 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:34.851516 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.851516 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.851516 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:34.851516 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.851516 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:34.852272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.852272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:34.852272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:34.852272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:34.852272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.852272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:34.852272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:34.852272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.852272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:34.852272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:34.852272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:34.852272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.852937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:34.852937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:34.852937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:34.852937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:34.852937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:34.852937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:34.852937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:34.852937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:34.852937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.852937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:34.852937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.852937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.852937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:34.853616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.853616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:34.853616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.853616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:34.853616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:34.853616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:34.853616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:34.853616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:34.853616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.853616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:34.853616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:34.853616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.853616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:34.853616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:34.853616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:34.854433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.855389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:34.855389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.855389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.855389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:34.855389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.855389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:34.868829 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:34.869055 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:34.869173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:34.870061 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:34.870567 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:34.870942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.872008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:34.872008 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.872008 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:34.872008 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.872008 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.872008 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:34.872008 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.872008 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:34.873512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.873512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:34.873512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:34.873512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:34.873512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.873512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:34.873512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:34.873512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.873512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:34.873512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:34.873512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:34.873512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.874156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:34.874156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:34.874156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:34.874156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:34.874156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:34.874156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:34.874156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:34.874156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:34.874156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.874156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:34.874156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.874156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.874156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:34.874687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.874687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:34.875391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.875391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:34.875391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:34.875391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:34.875391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:34.875391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:34.875391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.875391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:34.875391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:34.875391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.875391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:34.875391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:34.875391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.875391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:34.875391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:34.875391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.876491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.877426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:34.877426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.877426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:34.877426 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:34.877426 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:34.877426 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:34.877426 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:51:34.877426 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:34.877905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.877905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:34.877905 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.877905 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:34.877905 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.877905 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.877905 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:34.877905 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.877905 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:34.879583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.879583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:34.879583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:34.879583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:34.879583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.879583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:34.879583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:34.879583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:34.879583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.879583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:34.879583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:34.879583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:34.879583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:34.879583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:34.879583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:34.880171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:34.880171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:34.880171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.880171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:34.880171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.880171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.880171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:34.880171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.880171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:34.880171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.880171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:34.880171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:34.880171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:34.880171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.880644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:34.880644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:34.880644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:51:34.880644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:34.880644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:34.880644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.880644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:34.880644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:34.880644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:34.880644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.880644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:34.880644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:34.880644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:34.881014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:34.881014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:34.881014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:34.881014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:34.881014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:34.881014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.881014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:34.881014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.881014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.881014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:34.881014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.881014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:34.881333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.881333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:34.881333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:34.881333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:34.881333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:34.881333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:34.881333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.881333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:34.881333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:34.881333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.881333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:34.881333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:34.881333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.881333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:34.881333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:34.881333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:34.881807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:34.882676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.882676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:34.882676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.882676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.882676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:34.882676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.882676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:34.882676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:34.882922 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:34.882922 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:34.883040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:34.883357 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:34.883608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.884086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:34.884086 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.884086 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:34.884086 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.884086 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.884086 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:34.884086 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.884086 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:34.884836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.884836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:34.884836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:34.884836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:34.884836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.884836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:34.884836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:34.884836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:34.884836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.884836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:34.884836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:34.884836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:34.884836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:34.884836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:34.884836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:34.885237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:34.885237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:34.885237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.885237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:34.885237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.885237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.885237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:34.885237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.885237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:34.885692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.885692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:34.885692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:34.885692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:34.885692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.885692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:34.885692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:34.885692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:34.885692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:34.885692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.885692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:34.886078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:34.886078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:34.886078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.886078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:34.886078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:34.886078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:34.886078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:34.886078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:34.886078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:34.886078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:34.886078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:34.886078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.886078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:34.886078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.886473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.886473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:34.886473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.886473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.886882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:34.887453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.887961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.887961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:34.887961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.887961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:34.981803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:34.982343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:34.982599 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:34.982905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:34.983652 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:34.984079 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:34.984316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.985182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:34.985182 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.985182 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:34.985182 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.985182 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.985182 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:34.985182 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.985182 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:34.986916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.986916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:34.986916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:34.986916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:34.986916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.986916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:34.986916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:34.986916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.986916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:34.986916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:34.986916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:34.986916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.987507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:34.987507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:34.987507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:34.987507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:34.987507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:34.987507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:34.987507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:34.987507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:34.987507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.987507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:34.987507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.987507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.987507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:34.988053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.988053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:34.988696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.988696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:34.988696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:34.988696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:34.988696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:34.988696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:34.988696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.988696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:34.988696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:34.988696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.988696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:34.988696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:34.988696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.988696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:34.988696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:34.988696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:34.989557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:34.990447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:34.990447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:34.990447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:39.813437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:39.814241 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:39.814241 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:39.815460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:39.851055 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:39.851496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.852507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:39.852507 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.852507 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:39.852507 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.852507 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.852507 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:39.852507 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.852507 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:39.853277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.853277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:39.853277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:39.853277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:39.853277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.853277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:39.853277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:39.853277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.853277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:39.853277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:39.853277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:39.853277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.853539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:39.853539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:39.853539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:39.853539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:39.853539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:39.853539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:39.853539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:39.853539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:39.853539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.853539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:39.853539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.853539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.853539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:39.853797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.853797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:39.854015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.854015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:39.854015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:39.854015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:39.854015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:39.854015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:39.854015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.854015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:39.854015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:39.854015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.854015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:39.854015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:39.854015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.854015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:39.854015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:39.854015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.854328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.854690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:39.854690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.854690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:39.869281 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:39.869669 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:39.869789 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:39.870679 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:39.871692 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:39.871692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.871807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:39.871807 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.871807 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:39.871807 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.871807 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.871807 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:39.871807 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.871807 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:39.872816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.872816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:39.872816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:39.872816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:39.872816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.872816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:39.872816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:39.872816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.872816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:39.872816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:39.872816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:39.872816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.873416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:39.873416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:39.873416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:39.873416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:39.873416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:39.873416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:39.873416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:39.873416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:39.873416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.873416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:39.873416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.873416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.873416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:39.873988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.873988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:39.874224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.874224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:39.874224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:39.874224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:39.874224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:39.874224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:39.874224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.874224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:39.874224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:39.874224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.874224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:39.874224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:39.874224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.874224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:39.874224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:39.874224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.875003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.875594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:39.875594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.875594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:39.876118 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:39.876415 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:39.876558 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:39.876707 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:51:39.877023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:39.877204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.877707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:39.877707 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.877707 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:39.877707 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.877707 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.877707 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:39.877707 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.877707 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:39.878554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.878554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:39.878554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:39.878554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:39.878554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.878554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:39.878554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:39.878554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:39.878554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.878554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:39.878554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:39.878554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:39.878554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:39.878554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:39.878554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:39.878947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:39.878947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:39.878947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.878947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:39.878947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.878947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.878947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:39.878947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.878947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:39.879685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.879685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:39.879685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:39.879685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:39.879685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.879685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:39.879685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:39.879685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:51:39.879685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:39.879685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:39.879685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.879685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:39.880060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:39.880060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:39.880060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.880060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:39.880060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:39.880060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:39.880060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:39.880060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:39.880060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:39.880060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:39.880060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:39.880060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.880060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:39.880060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.880451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.880451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:39.880451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.880451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:39.880945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.880945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:39.880945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:39.880945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:39.880945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:39.880945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:39.880945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.880945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:39.880945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:39.880945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.880945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:39.880945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:39.880945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.880945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:39.880945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:39.880945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:39.881394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:39.881895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.881895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:39.881895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.881895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.881895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:39.881895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.881895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:39.882989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:39.883278 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:39.883430 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:39.883588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:39.883896 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:39.884114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.884651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:39.884651 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.884651 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:39.884651 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.884651 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.884651 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:39.884651 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.884651 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:39.885470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.885470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:39.885470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:39.885470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:39.885470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.885470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:39.885470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:39.885470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:39.885470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.885470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:39.885470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:39.885470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:39.885470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:39.885470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:39.885470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:39.885898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:39.885898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:39.885898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.885898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:39.885898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.885898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.885898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:39.885898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.885898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:39.886552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.886552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:39.886552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:39.886552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:39.886552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.886552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:39.886552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:39.886552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:39.886552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:39.886552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.886552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:39.886877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:39.886877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:39.886877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.886877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:39.886877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:39.886877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:39.886877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:39.886877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:39.886877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:39.886877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:39.886877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:39.886877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.886877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:39.886877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.887246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.887246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:39.887246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.887246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.887808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:39.888279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.888820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.888820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:39.888820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.888820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:39.982313 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:39.983052 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:39.983160 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:39.983477 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:39.984047 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:39.984473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:39.984706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.985530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:39.985530 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.985530 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:39.985530 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.985530 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.985530 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:39.985530 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.985530 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:39.987054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.987054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:39.987054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:39.987054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:39.987054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.987054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:39.987054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:39.987054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.987054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:39.987054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:39.987054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:39.987054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.987674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:39.987674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:39.987674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:39.987674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:39.987674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:39.987674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:39.987674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:39.987674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:39.987674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.987674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:39.987674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.987674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.987674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:39.988285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.988285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:39.988765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.988765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:39.988765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:39.988765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:39.988765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:39.988765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:39.988765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.988765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:39.988765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:39.988765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.988765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:39.988765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:39.988765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.988765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:39.988765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:39.988765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:39.989541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:39.990516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:39.990516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:39.990516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:44.814300 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:44.815454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:44.815749 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:44.817853 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:44.853060 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:44.853378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.854234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:44.854234 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.854234 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:44.854234 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.854234 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.854234 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:44.854234 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.854234 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:44.855092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.855092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:44.855092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:44.855092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:44.855092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.855092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:44.855092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:44.855092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.855092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:44.855092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:44.855092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:44.855092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.855857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:44.855857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:44.855857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:44.855857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:44.855857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:44.855857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:44.855857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:44.855857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:44.855857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.855857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:44.855857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.855857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.855857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:44.856600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.856600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:44.856600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.856600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:44.856600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:44.856600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:44.856600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:44.856600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:44.856600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.856600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:44.856600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:44.856600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.856600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:44.856600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:44.856600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:44.857482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.858611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:44.858611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.858611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.858611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:44.858611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.858611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:44.869975 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:44.870496 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:44.870696 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:44.871613 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:44.871893 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:44.872064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.872836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:44.872836 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.872836 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:44.872836 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.872836 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.872836 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:44.872836 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.872836 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:44.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:44.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:44.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:44.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:44.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:44.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:44.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:44.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:44.874229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.875051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:44.875051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:44.875051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:44.875051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:44.875051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:44.875051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:44.875051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:44.875051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:44.875051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.875051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:44.875051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.875051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.875051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:44.875719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.875719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:44.875852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.875852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:44.875852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:44.875852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:44.875852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:44.875852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:44.875852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.875852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:44.875852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:44.875852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.875852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:44.875852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:44.875852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.875852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:44.875852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:44.875852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.876646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.877928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:44.877928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.877928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:44.877928 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:44.877928 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:44.877928 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:44.877928 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:51:44.877928 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:44.878351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.878904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:44.878904 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.878904 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:44.878904 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.878904 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.878904 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:44.878904 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.878904 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:44.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:44.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:44.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:44.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:44.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:44.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:44.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:44.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:44.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:44.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:44.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:44.879699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:44.880224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:44.880224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:44.880224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.880224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:44.880224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.880224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.880224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:44.880224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.880224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:44.880534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.880534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:44.880534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:44.880534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:44.880534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.880534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:44.880534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:44.880534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:51:44.880534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:44.880534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:44.880534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.880534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:44.880918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:44.880918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:44.880918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.880918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:44.880918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:44.880918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:44.880918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:44.880918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:44.880918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:44.880918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:44.880918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:44.880918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.880918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:44.880918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.881291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.881291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:44.881291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.881291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:44.881430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.881430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:44.881430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:44.881430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:44.881430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:44.881430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:44.881430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.881430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:44.881430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:44.881430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.881430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:44.881430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:44.881430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.881430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:44.881430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:44.881430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:44.881886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:44.882415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.882415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:44.882415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.882415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.882415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:44.882415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.882415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:44.883479 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:44.883807 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:44.883920 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:44.884040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:44.884612 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:44.884955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.885764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:44.885764 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.885764 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:44.885764 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.885764 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.885764 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:44.885764 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.885764 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:44.886522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.886522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:44.886522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:44.886522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:44.886522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.886522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:44.886522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:44.886522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:44.886522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.886522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:44.886522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:44.886522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:44.886522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:44.886522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:44.886522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:44.887050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:44.887050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:44.887050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.887050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:44.887050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.887050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.887050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:44.887050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.887050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:44.887340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.887340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:44.887340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:44.887340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:44.887340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.887340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:44.887340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:44.887340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:44.887340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:44.887340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.887340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:44.887717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:44.887717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:44.887717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.887717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:44.887717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:44.887717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:44.887717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:44.887717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:44.887717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:44.887717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:44.887717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:44.887717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.887717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:44.887717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.888091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.888091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:44.888091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.888091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.888384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:44.888921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.889444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.889444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:44.889444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.889444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:44.983286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:44.984280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:44.984428 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:44.984640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:44.985338 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:44.985685 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:44.985856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.986648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:44.986648 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.986648 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:44.986648 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.986648 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.986648 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:44.986648 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.986648 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:44.987714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.987714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:44.987714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:44.987714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:44.987714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.987714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:44.987714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:44.987714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.987714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:44.987714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:44.987714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:44.987714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.988059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:44.988059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:44.988059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:44.988059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:44.988059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:44.988059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:44.988059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:44.988059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:44.988059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.988059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:44.988059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.988059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.988059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:44.988424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.988424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:44.988758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.988758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:44.988758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:44.988758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:44.988758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:44.988758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:44.988758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.988758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:44.988758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:44.988758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.988758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:44.988758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:44.988758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.988758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:44.988758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:44.988758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:44.989197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:44.989708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:44.989708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:44.989708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:49.815136 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:49.816326 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:49.816326 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:49.817063 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:49.857761 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:49.858253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.859337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:49.859337 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:49.859337 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:49.859337 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:49.859337 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:49.859337 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:49.859337 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.859337 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:49.860923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.860923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:49.860923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:49.860923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:49.860923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.860923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:49.860923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:49.860923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.860923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:49.860923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:49.860923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:49.860923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.861675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:49.861675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:49.861675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:49.861675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:49.861675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:49.861675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:49.861675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:49.861675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:49.861675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:49.861675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:49.861675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:49.861675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:49.861675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:49.863076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.863076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:49.863076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.863076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:49.863076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:49.863076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:49.863076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:49.863076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:49.863076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.863076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:49.863076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:49.863076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.863076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:49.863076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:49.863076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:49.863935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:49.866067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:49.866067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:49.866067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:49.866067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:49.866067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.866067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:49.870522 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:49.870995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:49.870995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:49.871756 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:49.872218 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:49.872432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.872947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:49.872947 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:49.872947 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:49.872947 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:49.872947 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:49.872947 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:49.872947 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.872947 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:49.873808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.873808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:49.873808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:49.873808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:49.873808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.873808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:49.873808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:49.873808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.873808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:49.873808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:49.873808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:49.873808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.874234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:49.874234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:49.874234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:49.874234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:49.874234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:49.874234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:49.874234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:49.874234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:49.874234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:49.874234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:49.874234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:49.874234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:49.874234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:49.874562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.874562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:49.874808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.874808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:49.874808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:49.874808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:49.874808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:49.874808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:49.874808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.874808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:49.874808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:49.874808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.874808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:49.874808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:49.874808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.874808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:49.874808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:49.874808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:49.875216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:49.875716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:49.875716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.875716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:49.877020 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:49.877279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:49.877412 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:49.877537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:51:49.878071 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:49.878269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.878813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:49.878813 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:49.878813 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:49.878813 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:49.878813 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:49.878813 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:49.878813 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.878813 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:49.879595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.879595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:49.879595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:49.879595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:49.879595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.879595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:49.879595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:49.879595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:49.879595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.879595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:49.879595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:49.879595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:49.879595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:49.879595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:49.879595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:49.880086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:49.880086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:49.880086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:49.880086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:49.880086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:49.880086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:49.880086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:49.880086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.880086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:49.880454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.880454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:49.880454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:49.880454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:49.880454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.880454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:49.880454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:49.880454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:51:49.880454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:49.880454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:49.880454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.880454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:49.880822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:49.880822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:49.880822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.880822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:49.880822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:49.880822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:49.880822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:49.880822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:49.880822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:49.880822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:49.880822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:49.880822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:49.880822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:49.880822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:49.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:49.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:49.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.881203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:49.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:49.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:49.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:49.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:49.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:49.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:49.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:49.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:49.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:49.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:49.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:49.881459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:49.881906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:49.882416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:49.882416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:49.882416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:49.882416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:49.882416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:49.882416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.882416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:49.884145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:49.884647 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:49.884857 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:49.885072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:49.885453 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:49.885684 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.886283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:49.886283 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:49.886283 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:49.886283 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:49.886283 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:49.886283 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:49.886283 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.886283 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:49.887670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.887670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:49.887670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:49.887670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:49.887670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.887670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:49.887670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:49.887670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:49.887670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.887670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:49.887670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:49.887670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:49.887670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:49.887670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:49.887670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:49.888110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:49.888110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:49.888110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:49.888110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:49.888110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:49.888110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:49.888110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:49.888110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.888110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:49.888841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.888841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:49.888841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:49.888841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:49.888841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.888841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:49.888841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:49.888841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:49.888841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:49.888841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.888841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:49.889277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:49.889277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:49.889277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.889277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:49.889277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:49.889277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:49.889277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:49.889277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:49.889277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:49.889277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:49.889277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:49.889277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:49.889277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:49.889277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:49.889673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:49.889673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:49.889673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.889673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:49.889912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:49.890434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:49.890955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:49.890955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:49.890955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:49.890955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:49.985166 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:50.049420 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:50.049617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:50.049960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:50.050887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:50.051294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:50.051568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:50.052697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:50.052697 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:50.052697 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:50.052697 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:50.052697 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:50.052697 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:50.052697 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:50.052697 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:50.054703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:50.054703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:50.054703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:50.054703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:50.054703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:50.054703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:50.054703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:50.054703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:50.054703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:50.054703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:50.054703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:50.054703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:50.055394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:50.055394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:50.055394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:50.055394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:50.055394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:50.055394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:50.055394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:50.055394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:50.055394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:50.055394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:50.055394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:50.055394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:50.055394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:50.055976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:50.055976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:50.057052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:50.057052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:50.057052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:50.057052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:50.057052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:50.057052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:50.057052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:50.057052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:50.057052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:50.057052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:50.057052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:50.057052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:50.057052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:50.057052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:50.057052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:50.057052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:50.057610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:50.058199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:50.058199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:50.058199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:54.815800 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:54.816525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:54.816525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:54.817554 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:54.819131 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:51:54.849626 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:54.850304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.850837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:54.850837 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:54.850837 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:54.850837 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:54.850837 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:54.850837 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:54.850837 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.850837 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:54.851682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.851682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:54.851682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:54.851682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:54.851682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.851682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:54.851682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:54.851682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.851682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:54.851682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:54.851682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:54.851682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.852355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:54.852355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:54.852355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:54.852355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:54.852355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:54.852355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:54.852355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:54.852355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:54.852355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:54.852355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:54.852355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:54.852355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:54.852355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:54.853034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.853034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:54.853034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.853034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:54.853034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:54.853034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:54.853034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:54.853034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:54.853034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.853034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:54.853034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:54.853034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.853034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:54.853034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:54.853034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:54.853894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:54.854776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:54.854776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:54.854776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:54.854776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:54.854776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.854776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:54.871270 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:54.872596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:54.872596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:54.873179 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:54.873564 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:54.874506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.874843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:54.874843 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:54.874843 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:54.874843 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:54.874843 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:54.874843 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:54.874843 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.874843 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:54.876383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.876383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:54.876383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:54.876383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:54.876383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.876383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:54.876383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:54.876383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.876383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:54.876383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:54.876383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:54.876383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.876894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:54.876894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:54.876894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:54.876894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:54.876894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:54.876894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:54.876894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:54.876894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:54.876894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:54.876894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:54.876894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:54.876894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:54.876894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:54.877476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.877476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:54.877476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.877476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:54.877476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:54.877476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:54.877476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:54.877476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:54.877476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.877476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:54.877476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:54.877476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.877476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:54.877476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:54.877476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:54.877859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:54.878352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:54.878352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:54.878352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:54.878352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:54.878352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.878352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:54.878352 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:54.878352 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:54.878352 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:54.878352 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:51:54.878987 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:54.879324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.880215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:54.880215 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:54.880215 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:54.880215 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:54.880215 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:54.880215 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:54.880215 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.880215 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:54.881015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.881015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:54.881015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:54.881015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:54.881015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.881015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:54.881015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:54.881015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:54.881015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.881015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:54.881015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:54.881015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:54.881015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:54.881015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:54.881015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:54.881513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:54.881513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:54.881513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:54.881513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:54.881513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:54.881513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:54.881513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:54.881513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.881513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:54.881966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.881966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:54.881966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:54.881966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:54.881966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.881966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:54.881966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:54.881966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:51:54.881966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:54.881966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:54.881966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.881966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:54.882337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:54.882337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:54.882337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.882337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:54.882337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:54.882337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:54.882337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:54.882337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:54.882337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:54.882337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:54.882337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:54.882337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:54.882337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:54.882337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:54.882795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:54.882795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:54.882795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.882795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:54.882914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.882914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:54.882914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:54.882914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:54.882914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:54.882914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:54.882914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.882914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:54.882914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:54.882914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.882914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:54.882914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:54.882914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.882914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:54.882914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:54.882914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:54.884116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:54.884638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:54.884638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:54.884638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:54.884638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:54.884638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:54.884638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.884638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:54.884638 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:54.884854 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:54.884854 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:54.885029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:54.885329 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:54.885638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.886104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:54.886104 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:54.886104 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:54.886104 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:54.886104 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:54.886104 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:54.886104 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.886104 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:54.886906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.886906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:54.886906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:54.886906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:54.886906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.886906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:54.886906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:54.886906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:54.886906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.886906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:54.886906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:54.886906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:54.886906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:54.886906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:54.886906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:54.887402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:54.887402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:54.887402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:54.887402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:54.887402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:54.887402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:54.887402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:54.887402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.887402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:54.887850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.887850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:54.887850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:54.887850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:54.887850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.887850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:54.887850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:54.887850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:54.887850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:54.887850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.887850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:54.888175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:54.888175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:54.888175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.888175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:54.888175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:54.888175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:54.888175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:54.888175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:54.888175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:54.888175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:54.888175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:54.888175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:54.888175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:54.888175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:54.888664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:54.888664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:54.888664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.888664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:54.888939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:54.889492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:54.890065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:54.890065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:54.890065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:54.890065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:55.049074 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:55.049530 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:55.049620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:55.049938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:55.050850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:55.051241 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:55.051501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:55.053228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:55.053228 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:55.053228 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:55.053228 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:55.053228 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:55.053228 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:55.053228 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:55.053228 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:55.055016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:55.055016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:55.055016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:55.055016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:55.055016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:55.055016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:55.055016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:55.055016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:55.055016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:55.055016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:55.055016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:55.055016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:55.055980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:55.055980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:55.055980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:55.055980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:55.055980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:55.055980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:55.055980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:55.055980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:55.055980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:55.055980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:55.055980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:55.055980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:55.055980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:55.056497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:55.056497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:55.056497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:55.056497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:55.056497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:55.056497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:55.056497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:55.056497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:55.056497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:55.056497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:55.056497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:55.056497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:55.056497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:55.056497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:55.056497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:55.056889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:55.057387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:55.057387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:55.057387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:55.057387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:55.057387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:55.057387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:59.816450 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:59.817102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:59.817317 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:59.818786 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:59.846319 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:59.846620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.847232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:59.847232 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:59.847232 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:59.847232 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:59.847232 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:59.847232 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:59.847232 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.847232 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:59.848143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.030 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.848143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:59.848143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:59.848143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:59.848143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.848143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:59.848143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:59.848143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.848143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:59.848143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:59.848143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:59.848143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.848808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:59.848808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:59.848808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:59.848808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:59.848808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:59.848808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:59.848808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:59.848808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:59.848808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:59.848808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:59.848808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:59.848808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:59.848808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:59.849155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.849155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:59.849155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.849155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:59.849155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:59.849155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:59.849155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:59.849155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:59.849155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.849155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:59.849155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:59.849155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.849155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:59.849155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:59.849155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:59.849630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:59.850190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:59.850190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:59.850190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:59.850190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:59.850190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.850190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:59.872109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:59.872628 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:59.872834 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:59.873908 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:59.874260 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:59.874541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.875490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:59.875490 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:59.875490 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:59.875490 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:59.875490 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:59.875490 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:59.875490 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.875490 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:59.876881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.876881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:59.876881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:59.876881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:59.876881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.876881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:59.876881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:59.876881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.876881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:59.876881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:59.876881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:59.876881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.877207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:59.877207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:59.877207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:59.877207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:59.877207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:59.877207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:59.877207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:59.877207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:59.877207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:59.877207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:59.877207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:59.877207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:59.877207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:59.877534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.877534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:59.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:59.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:59.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:59.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:59.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:59.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:59.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:59.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:59.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:59.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:59.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:59.878659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:59.879154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:59.879643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:59.879643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.879643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:59.879643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:59.879643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:59.879643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:59.879643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:51:59.880006 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:59.880288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.881020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:59.881020 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:59.881020 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:59.881020 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:59.881020 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:59.881020 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:59.881020 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.881020 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:59.881794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.881794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:59.881794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:59.881794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:59.881794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.881794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:59.881794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:59.881794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:59.881794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.881794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:59.881794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:59.881794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:59.881794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:59.881794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:59.881794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:59.882226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:59.882226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:59.882226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:59.882226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:59.882226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:59.882226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:59.882226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:59.882226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.882226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:59.882612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.882612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:59.882612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:59.882612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:59.882612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.882612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:59.882612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:59.882612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:51:59.882612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:59.882612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:59.882612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.882612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:59.882942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:59.882942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:59.882942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.882942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:59.882942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:59.882942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:59.882942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:59.882942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:59.882942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:59.882942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:59.882942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:59.882942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:59.882942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:59.882942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:59.883276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:59.883276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:59.883276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.883276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:59.883692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.883692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:59.883692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:59.883692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:59.883692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:59.883692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:59.883692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.883692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:59.883692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:59.883692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.883692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:59.883692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:59.883692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.883692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:59.883692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:59.883692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:59.884080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:59.884537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:59.884537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:59.884537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:59.884537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:59.884537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:59.884537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.884537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:51:59.884934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:51:59.885253 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:51:59.885383 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:51:59.885512 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:51:59.885863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:51:59.886083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.886635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:51:59.886635 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:59.886635 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:51:59.886635 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:51:59.886635 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:59.886635 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:51:59.886635 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.886635 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:51:59.887361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.887361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:51:59.887361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:59.887361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:59.887361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.887361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:59.887361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:59.887361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:59.887361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.887361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:51:59.887361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:59.887361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:51:59.887361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:59.887361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:51:59.887361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:51:59.887756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:59.887756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:51:59.887756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:59.887756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:51:59.887756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:51:59.887756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:59.887756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:51:59.887756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.887756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:51:59.888221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.888221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:51:59.888221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:59.888221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:51:59.888221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.888221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:59.888221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:59.888221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:59.888221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:59.888221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.888221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:59.888569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:59.888569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:59.888569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.888569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:51:59.888569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:59.888569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:51:59.888569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:59.888569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:51:59.888569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:51:59.888569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:59.888569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:51:59.888569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:59.888569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:51:59.888569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:51:59.888836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:59.888836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:51:59.888836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.888836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:51:59.889251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:51:59.889817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:51:59.890346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:51:59.890346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:51:59.890346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:51:59.890346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:00.049773 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:00.050235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:00.050457 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:00.050788 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:00.051337 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:00.051744 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:00.051965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:00.052785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:00.052785 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:00.052785 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:00.052785 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:00.052785 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:00.052785 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:00.052785 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:00.052785 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:00.054193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:00.054193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:00.054193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:00.054193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:00.054193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:00.054193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:00.054193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:00.054193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:00.054193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:00.054193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:00.054193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:00.054193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:00.054581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:00.054581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:00.054581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:00.054581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:00.054581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:00.054581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:00.054581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:00.054581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:00.054581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:00.054581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:00.054581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:00.054581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:00.054581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:00.054944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:00.054944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:00.055775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:00.055775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:00.055775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:00.055775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:00.055775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:00.055775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:00.055775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:00.055775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:00.055775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:00.055775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:00.055775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:00.055775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:00.055775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:00.055775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:00.055775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:00.055775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:00.056224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:00.056713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:00.056713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:00.056713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:04.817210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:04.818422 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:04.818422 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:04.819464 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:04.852616 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:04.852963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.853763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:04.853763 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:04.853763 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:04.853763 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:04.853763 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:04.853763 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:04.853763 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.853763 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:04.854549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.854549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:04.854549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:04.854549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:04.854549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.854549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:04.854549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:04.854549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.854549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:04.854549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:04.854549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:04.854549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.855402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:04.855402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:04.855402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:04.855402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:04.855402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:04.855402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:04.855402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:04.855402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:04.855402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:04.855402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:04.855402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:04.855402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:04.855402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:04.856134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.856134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:04.856134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.856134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:04.856134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:04.856134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:04.856134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:04.856134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:04.856134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.856134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:04.856134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:04.856134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.856134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:04.856134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:04.856134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:04.857287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:04.858492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:04.858492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:04.858492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:04.858492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:04.858492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.858492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:04.873304 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:04.873651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:04.873768 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:04.874529 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:04.874788 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:04.875029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.875676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:04.875676 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:04.875676 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:04.875676 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:04.875676 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:04.875676 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:04.875676 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.875676 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:04.876361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.876361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:04.876361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:04.876361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:04.876361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.876361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:04.876361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:04.876361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.876361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:04.876361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:04.876361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:04.876361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.876871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:04.876871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:04.876871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:04.876871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:04.876871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:04.876871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:04.876871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:04.876871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:04.876871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:04.876871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:04.876871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:04.876871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:04.876871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:04.877356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.877356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:04.877356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.877356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:04.877356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:04.877356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:04.877356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:04.877356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:04.877356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.877356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:04.877356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:04.877356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.877356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:04.877356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:04.877356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:04.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:04.878726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:04.878726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:04.878726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:04.878726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:04.878726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.878726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:04.879587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:04.879848 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:04.879921 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:04.879989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:52:04.880401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:04.880542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.881076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:04.881076 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:04.881076 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:04.881076 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:04.881076 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:04.881076 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:04.881076 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.881076 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:04.882297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.882297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:04.882297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:04.882297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:04.882297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.882297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:04.882297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:04.882297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:04.882297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.882297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:04.882297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:04.882297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:04.882297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:04.882297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:04.882297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:04.883028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:04.883028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:04.883028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:04.883028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:04.883028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:04.883028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:04.883028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:04.883028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.883028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:04.883899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.883899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:04.883899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:04.883899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:04.883899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.883899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:04.883899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:04.883899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:52:04.883899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:04.883899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:04.883899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.883899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:04.884492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:04.884492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:04.884492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.884492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:04.884492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:04.884492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:04.884492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:04.884492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:04.884492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:04.884492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:04.884492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:04.884492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:04.884492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:04.884492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:04.884903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:04.884903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:04.884903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.884903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:04.885738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.885738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:04.885738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:04.885738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:04.885738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:04.885738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:04.885738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.885738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:04.885738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:04.885738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.885738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:04.885738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:04.885738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.885738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:04.885738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:04.885738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:04.886081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:04.886487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:04.886487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:04.886487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:04.886487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:04.886487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:04.886487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.886487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:04.886740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:04.887164 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:04.887348 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:04.887585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:04.887933 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:04.888170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.888702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:04.888702 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:04.888702 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:04.888702 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:04.888702 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:04.888702 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:04.888702 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.888702 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:04.889728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.889728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:04.889728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:04.889728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:04.889728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.889728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:04.889728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:04.889728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:04.889728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.889728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:04.889728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:04.889728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:04.889728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:04.889728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:04.889728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:04.890019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:04.890019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:04.890019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:04.890019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:04.890019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:04.890019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:04.890019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:04.890019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.890019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:04.890725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.890725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:04.890725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:04.890725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:04.890725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.890725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:04.890725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:04.890725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:04.890725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:04.890725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.890725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:04.891004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:04.891004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:04.891004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.891004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:04.891004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:04.891004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:04.891004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:04.891004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:04.891004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:04.891004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:04.891004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:04.891004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:04.891004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:04.891004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:04.891271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:04.891271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:04.891271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.891271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:04.892236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:04.892620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:04.892990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:04.892990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:04.892990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:04.892990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:05.050437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:05.051180 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:05.051517 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:05.051899 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:05.052546 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:05.053018 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:05.053412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:05.054398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:05.054398 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:05.054398 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:05.054398 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:05.054398 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:05.054398 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:05.054398 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:05.054398 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:05.056020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:05.056020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:05.056020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:05.056020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:05.056020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:05.056020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:05.056020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:05.056020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:05.056020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:05.056020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:05.056020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:05.056020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:05.056626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:05.056626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:05.056626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:05.056626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:05.056626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:05.056626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:05.056626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:05.056626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:05.056626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:05.056626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:05.056626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:05.056626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:05.056626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:05.057150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:05.057150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:05.057150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:05.057150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:05.057150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:05.057150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:05.057150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:05.057150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:05.057150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:05.057150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:05.057150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:05.057150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:05.057150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:05.057150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:05.057150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:05.057944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:05.058784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:05.058784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:05.058784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:05.058784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:05.058784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:05.058784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:09.818100 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:09.819011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:09.819192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:09.820806 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:09.859715 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:09.859990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.860695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:09.860695 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:09.860695 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:09.860695 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:09.860695 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:09.860695 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:09.860695 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.860695 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:09.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:09.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:09.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:09.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:09.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:09.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:09.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:09.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:09.861742 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.862472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:09.862472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:09.862472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:09.862472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:09.862472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:09.862472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:09.862472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:09.862472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:09.862472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:09.862472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:09.862472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:09.862472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:09.862472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:09.863176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.863176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:09.863176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.863176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:09.863176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:09.863176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:09.863176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:09.863176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:09.863176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.863176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:09.863176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:09.863176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.863176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:09.863176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:09.863176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:09.863987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:09.864597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:09.864597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:09.864597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:09.864597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:09.864597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.864597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:09.873956 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:09.874312 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:09.874457 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:09.875190 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:09.875612 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:09.875839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.876747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:09.876747 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:09.876747 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:09.876747 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:09.876747 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:09.876747 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:09.876747 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.876747 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:09.878113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.878113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:09.878113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:09.878113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:09.878113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.878113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:09.878113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:09.878113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.878113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:09.878113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:09.878113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:09.878113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.878832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:09.878832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:09.878832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:09.878832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:09.878832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:09.878832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:09.878832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:09.878832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:09.878832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:09.878832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:09.878832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:09.878832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:09.878832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:09.879555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.879555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:09.880405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.880405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:09.880405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:09.880405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:09.880405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:09.880405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:09.880405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.880405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:09.880405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:09.880405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.880405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:09.880405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:09.880405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.880405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:09.880405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:09.880405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:09.881139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:09.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:09.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:09.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:09.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:09.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:09.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:52:09.882725 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:09.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:09.883858 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:09.883858 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:09.883858 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:09.883858 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:09.883858 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:09.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.883858 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:09.884630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.884630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:09.884630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:09.884630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:09.884630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.884630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:09.884630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:09.884630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:09.884630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.884630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:09.884630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:09.884630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:09.884630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:09.884630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:09.884630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:09.885125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:09.885125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:09.885125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:09.885125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:09.885125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:09.885125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:09.885125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:09.885125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.885125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:09.885451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.885451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:09.885451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:09.885451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:09.885451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.885451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:09.885451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:09.885451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:52:09.885451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:09.885451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:09.885451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.885451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:09.885825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:09.885825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:09.885825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.885825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:09.885825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:09.885825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:09.885825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:09.885825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:09.885825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:09.885825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:09.885825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:09.885825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:09.885825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:09.885825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:09.886314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:09.886314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:09.886314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.886314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:09.886453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.886453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:09.886453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:09.886453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:09.886453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:09.886453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:09.886453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.886453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:09.886453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:09.886453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.886453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:09.886453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:09.886453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.886453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:09.886453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:09.886453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:09.886916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:09.887495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:09.887495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:09.887495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:09.887495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:09.887495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:09.887495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.887495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:09.887495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:09.887752 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:09.887800 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:09.887946 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:09.888460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:09.888813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.889548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:09.889548 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:09.889548 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:09.889548 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:09.889548 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:09.889548 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:09.889548 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.889548 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:09.890260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.890260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:09.890260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:09.890260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:09.890260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.890260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:09.890260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:09.890260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:09.890260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.890260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:09.890260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:09.890260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:09.890260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:09.890260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:09.890260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:09.890771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:09.890771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:09.890771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:09.890771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:09.890771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:09.890771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:09.890771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:09.890771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.890771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:09.891118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.891118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:09.891118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:09.891118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:09.891118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.891118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:09.891118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:09.891118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:09.891118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:09.891118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.891118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:09.891510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:09.891510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:09.891510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.891510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:09.891510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:09.891510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:09.891510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:09.891510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:09.891510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:09.891510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:09.891510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:09.891510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:09.891510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:09.891510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:09.891907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:09.891907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:09.891907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.891907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:09.892176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:09.892708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:09.893229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:09.893229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:09.893229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:09.893229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:10.051482 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:10.052214 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:10.052450 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:10.052727 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:10.053527 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:10.053932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:10.054173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:10.055210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:10.055210 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:10.055210 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:10.055210 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:10.055210 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:10.055210 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:10.055210 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:10.055210 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:10.056730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:10.056730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:10.056730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:10.056730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:10.056730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:10.056730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:10.056730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:10.056730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:10.056730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:10.056730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:10.056730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:10.056730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:10.057422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:10.057422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:10.057422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:10.057422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:10.057422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:10.057422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:10.057422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:10.057422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:10.057422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:10.057422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:10.057422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:10.057422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:10.057422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:10.058042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:10.058042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:10.058300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:10.058300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:10.058300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:10.058300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:10.058300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:10.058300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:10.058300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:10.058300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:10.058300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:10.058300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:10.058300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:10.058300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:10.058300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:10.058300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:10.058300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:10.058300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:10.059052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:10.059918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:10.059918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:10.059918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:14.818818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:14.819676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:14.819676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:14.820204 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:14.849283 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:14.849838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.850864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:14.850864 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:14.850864 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:14.850864 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:14.850864 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:14.850864 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:14.850864 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.850864 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:14.851661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.031 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.851661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:14.851661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:14.851661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:14.851661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.851661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:14.851661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:14.851661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.851661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:14.851661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:14.851661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:14.851661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.852214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:14.852214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:14.852214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:14.852214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:14.852214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:14.852214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:14.852214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:14.852214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:14.852214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:14.852214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:14.852214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:14.852214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:14.852214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:14.852815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.852815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:14.852815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.852815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:14.852815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:14.852815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:14.852815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:14.852815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:14.852815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.852815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:14.852815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:14.852815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.852815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:14.852815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:14.852815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:14.853511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:14.854307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:14.854307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:14.854307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:14.854307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:14.854307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.854307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:14.874574 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:14.875002 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:14.875072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:14.876031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:14.876356 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:14.876631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.877625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:14.877625 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:14.877625 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:14.877625 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:14.877625 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:14.877625 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:14.877625 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.877625 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:14.878732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.878732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:14.878732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:14.878732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:14.878732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.878732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:14.878732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:14.878732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.878732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:14.878732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:14.878732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:14.878732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.879294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:14.879294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:14.879294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:14.879294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:14.879294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:14.879294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:14.879294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:14.879294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:14.879294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:14.879294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:14.879294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:14.879294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:14.879294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:14.879966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.879966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:14.879966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.879966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:14.879966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:14.879966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:14.879966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:14.879966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:14.879966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.879966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:14.879966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:14.879966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.879966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:14.879966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:14.879966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:14.880655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:14.881490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:14.881490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:14.881490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:14.881490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:14.881490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.881490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:14.881490 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:14.881796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:14.881796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:14.881900 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:52:14.882559 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:14.882898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.884552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:14.884552 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:14.884552 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:14.884552 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:14.884552 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:14.884552 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:14.884552 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.884552 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:14.885321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.885321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:14.885321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:14.885321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:14.885321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.885321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:14.885321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:14.885321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:14.885321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.885321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:14.885321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:14.885321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:14.885321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:14.885321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:14.885321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:14.885770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:14.885770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:14.885770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:14.885770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:14.885770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:14.885770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:14.885770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:14.885770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.885770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:14.886193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.886193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:14.886193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:14.886193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:14.886193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.886193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:14.886193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:14.886193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:52:14.886193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:14.886193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:14.886193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.886193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:14.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:14.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:14.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:14.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:14.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:14.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:14.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:14.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:14.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:14.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:14.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:14.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:14.886686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:14.887065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:14.887065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:14.887065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.887065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:14.887296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.887296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:14.887296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:14.887296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:14.887296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:14.887296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:14.887296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.887296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:14.887296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:14.887296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.887296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:14.887296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:14.887296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.887296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:14.887296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:14.887296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:14.887778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:14.888265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:14.888265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:14.888265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:14.888265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:14.888265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:14.888265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.888265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:14.888265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:14.888265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:14.888265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:14.888571 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:14.888648 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:14.888891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.889413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:14.889413 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:14.889413 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:14.889413 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:14.889413 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:14.889413 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:14.889413 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.889413 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:14.890311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.890311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:14.890311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:14.890311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:14.890311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.890311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:14.890311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:14.890311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:14.890311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.890311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:14.890311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:14.890311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:14.890311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:14.890311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:14.890311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:14.890734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:14.890734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:14.890734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:14.890734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:14.890734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:14.890734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:14.890734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:14.890734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.890734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:14.891190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.891190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:14.891190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:14.891190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:14.891190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.891190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:14.891190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:14.891190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:14.891190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:14.891190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.891190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:14.891558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:14.891558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:14.891558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.891558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:14.891558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:14.891558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:14.891558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:14.891558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:14.891558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:14.891558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:14.891558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:14.891558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:14.891558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:14.891558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:14.891929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:14.891929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:14.891929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.891929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:14.892361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:14.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:14.893353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:14.893353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:14.893353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:14.893353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:15.052185 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:15.052723 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:15.052911 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:15.053206 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:15.053937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:15.054323 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:15.054593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:15.055594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:15.055594 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:15.055594 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:15.055594 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:15.055594 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:15.055594 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:15.055594 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:15.055594 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:15.057732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:15.057732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:15.057732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:15.057732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:15.057732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:15.057732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:15.057732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:15.057732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:15.057732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:15.057732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:15.057732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:15.057732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:15.058318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:15.058318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:15.058318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:15.058318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:15.058318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:15.058318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:15.058318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:15.058318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:15.058318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:15.058318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:15.058318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:15.058318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:15.058318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:15.058937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:15.058937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:15.059570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:15.059570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:15.059570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:15.059570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:15.059570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:15.059570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:15.059570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:15.059570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:15.059570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:15.059570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:15.059570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:15.059570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:15.059570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:15.059570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:15.059570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:15.059570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:15.060319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:15.060893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:15.060893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:15.060893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:19.819665 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:19.820531 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:19.820531 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:19.821682 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:19.862066 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:19.862383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.863241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:19.863241 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:19.863241 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:19.863241 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:19.863241 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:19.863241 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:19.863241 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.863241 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:19.864420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.864420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:19.864420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:19.864420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:19.864420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.864420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:19.864420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:19.864420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.864420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:19.864420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:19.864420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:19.864420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.865114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:19.865114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:19.865114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:19.865114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:19.865114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:19.865114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:19.865114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:19.865114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:19.865114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:19.865114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:19.865114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:19.865114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:19.865114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:19.865553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.865553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:19.865553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.865553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:19.865553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:19.865553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:19.865553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:19.865553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:19.865553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.865553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:19.865553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:19.865553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.865553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:19.865553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:19.865553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:19.866038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:19.866631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:19.866631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:19.866631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:19.866631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:19.866631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.866631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:19.875287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:19.875705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:19.875894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:19.876911 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:19.877235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:19.877519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.878474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:19.878474 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:19.878474 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:19.878474 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:19.878474 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:19.878474 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:19.878474 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.878474 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:19.880045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.880045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:19.880045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:19.880045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:19.880045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.880045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:19.880045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:19.880045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.880045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:19.880045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:19.880045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:19.880045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.880334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:19.880334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:19.880334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:19.880334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:19.880334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:19.880334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:19.880334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:19.880334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:19.880334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:19.880334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:19.880334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:19.880334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:19.880334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:19.880600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.880600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:19.881825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.881825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:19.881825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:19.881825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:19.881825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:19.881825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:19.881825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.881825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:19.881825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:19.881825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.881825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:19.881825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:19.881825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.881825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:19.881825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:19.881825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:19.882251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:19.882625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:19.882625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.882625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:19.882625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:19.882625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:19.882917 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:19.883144 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:52:19.883525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:19.883728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.884233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:19.884233 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:19.884233 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:19.884233 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:19.884233 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:19.884233 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:19.884233 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.884233 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:19.884969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.884969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:19.884969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:19.884969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:19.884969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.884969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:19.884969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:19.884969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:19.884969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.884969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:19.884969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:19.884969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:19.884969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:19.884969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:19.884969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:19.885473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:19.885473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:19.885473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:19.885473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:19.885473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:19.885473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:19.885473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:19.885473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.885473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:19.885761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.885761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:19.885761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:19.885761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:19.885761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.885761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:19.885761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:19.885761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:52:19.885761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:19.885761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:19.885761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.885761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:19.886131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:19.886131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:19.886131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.886131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:19.886131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:19.886131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:19.886131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:19.886131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:19.886131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:19.886131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:19.886131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:19.886131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:19.886131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:19.886131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:19.886538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:19.886538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:19.886538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.886538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:19.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:19.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:19.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:19.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:19.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:19.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:19.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:19.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:19.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:19.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:19.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:19.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:19.887282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:19.887777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:19.887777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:19.887777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:19.887777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:19.887777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:19.887777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.887777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:19.888293 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:19.888618 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:19.888731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:19.888864 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:19.889171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:19.889421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.889886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:19.889886 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:19.889886 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:19.889886 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:19.889886 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:19.889886 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:19.889886 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.889886 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:19.890647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.890647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:19.890647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:19.890647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:19.890647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.890647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:19.890647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:19.890647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:19.890647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.890647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:19.890647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:19.890647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:19.890647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:19.890647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:19.890647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:19.891123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:19.891123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:19.891123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:19.891123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:19.891123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:19.891123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:19.891123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:19.891123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.891123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:19.891542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.891542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:19.891542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:19.891542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:19.891542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.891542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:19.891542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:19.891542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:19.891542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:19.891542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.891542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:19.891871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:19.891871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:19.891871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.891871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:19.891871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:19.891871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:19.891871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:19.891871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:19.891871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:19.891871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:19.891871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:19.891871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:19.891871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:19.891871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:19.892287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:19.892287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:19.892287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.892287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:19.892580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:19.893095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:19.893645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:19.893645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:19.893645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:19.893645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:20.053018 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:20.053693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:20.053882 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:20.054182 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:20.054967 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:20.055392 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:20.055638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:20.056568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:20.056568 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:20.056568 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:20.056568 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:20.056568 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:20.056568 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:20.056568 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:20.056568 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:20.057979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:20.057979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:20.057979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:20.057979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:20.057979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:20.057979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:20.057979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:20.057979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:20.057979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:20.057979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:20.057979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:20.057979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:20.058974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:20.058974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:20.058974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:20.058974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:20.058974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:20.058974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:20.058974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:20.058974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:20.058974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:20.058974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:20.058974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:20.058974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:20.058974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:20.059736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:20.059736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:20.059736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:20.059736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:20.059736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:20.059736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:20.059736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:20.059736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:20.059736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:20.059736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:20.059736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:20.059736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:20.059736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:20.059736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:20.059736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:20.060550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:20.061495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:20.061495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:20.061495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:20.061495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:20.061495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:20.061495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:24.820521 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:24.821891 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:24.821891 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:24.822924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:24.862484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:24.863062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.864250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:24.864250 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:24.864250 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:24.864250 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:24.864250 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:24.864250 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:24.864250 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.864250 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:24.865253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.865253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:24.865253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:24.865253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:24.865253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.865253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:24.865253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:24.865253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.865253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:24.865253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:24.865253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:24.865253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.866099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:24.866099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:24.866099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:24.866099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:24.866099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:24.866099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:24.866099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:24.866099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:24.866099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:24.866099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:24.866099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:24.866099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:24.866099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:24.866801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.866801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:24.866801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.866801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:24.866801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:24.866801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:24.866801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:24.866801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:24.866801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.866801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:24.866801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:24.866801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.866801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:24.866801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:24.866801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:24.867882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:24.869584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:24.869584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:24.869584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:24.869584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:24.869584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.869584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:24.875926 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:24.876243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:24.876393 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:24.877318 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:24.877713 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:24.877992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.878793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:24.878793 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:24.878793 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:24.878793 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:24.878793 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:24.878793 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:24.878793 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.878793 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:24.880230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.880230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:24.880230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:24.880230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:24.880230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.880230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:24.880230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:24.880230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.880230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:24.880230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:24.880230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:24.880230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.881077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:24.881077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:24.881077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:24.881077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:24.881077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:24.881077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:24.881077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:24.881077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:24.881077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:24.881077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:24.881077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:24.881077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:24.881077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:24.881939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.881939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:24.881939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.881939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:24.881939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:24.881939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:24.881939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:24.881939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:24.881939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.881939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:24.881939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:24.881939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.881939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:24.881939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:24.881939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:24.882981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:24.885246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:24.885246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:24.885246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:24.885246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:24.885246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.885246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:24.885246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:24.885246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:24.885246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:24.885246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:52:24.885816 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:24.885816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.885816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:24.885816 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:24.885816 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:24.885816 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:24.885816 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:24.885816 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:24.885816 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.885816 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:24.887074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.887074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:24.887074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:24.887074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:24.887074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.887074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:24.887074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:24.887074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:24.887074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.887074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:24.887074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:24.887074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:24.887074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:24.887074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:24.887074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:24.887559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:24.887559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:24.887559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:24.887559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:24.887559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:24.887559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:24.887559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:24.887559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.887559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:24.887894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.887894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:24.887894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:24.887894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:24.887894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.887894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:24.887894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:24.887894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:52:24.887894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:24.887894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:24.887894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.887894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:24.888286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:24.888286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:24.888286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.888286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:24.888286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:24.888286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:24.888286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:24.888286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:24.888286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:24.888286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:24.888286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:24.888286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:24.888286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:24.888286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:24.888546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:24.888546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:24.888546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.888546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:24.888950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.888950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:24.888950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:24.888950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:24.888950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:24.888950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:24.888950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.888950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:24.888950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:24.888950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.888950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:24.888950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:24.888950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.888950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:24.888950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:24.888950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:24.889273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:24.889627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:24.889627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:24.889627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:24.889627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:24.889627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:24.889627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.889627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:24.889627 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:24.889627 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:24.889627 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:24.890034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:24.890034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:24.890643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.890843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:24.890843 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:24.890843 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:24.890843 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:24.890843 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:24.890843 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:24.890843 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.890843 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:24.891667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.891667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:24.891667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:24.891667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:24.891667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.891667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:24.891667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:24.891667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:24.891667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.891667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:24.891667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:24.891667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:24.891667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:24.891667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:24.891667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:24.892245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:24.892245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:24.892245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:24.892245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:24.892245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:24.892245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:24.892245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:24.892245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.892245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:24.892589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.892589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:24.892589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:24.892589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:24.892589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.892589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:24.892589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:24.892589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:24.892589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:24.892589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.892589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:24.893020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:24.893020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:24.893020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.893020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:24.893020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:24.893020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:24.893020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:24.893020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:24.893020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:24.893020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:24.893020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:24.893020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:24.893020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:24.893020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:24.893632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:24.893632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:24.893632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.893632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:24.893762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:24.894583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:24.894912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:24.894912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:24.894912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:24.894912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:25.054140 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:25.054892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:25.055273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:25.055604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:25.056493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:25.056936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:25.057147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:25.058221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:25.058221 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:25.058221 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:25.058221 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:25.058221 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:25.058221 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:25.058221 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:25.058221 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:25.059868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:25.059868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:25.059868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:25.059868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:25.059868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:25.059868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:25.059868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:25.059868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:25.059868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:25.059868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:25.059868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:25.059868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:25.060461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:25.060461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:25.060461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:25.060461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:25.060461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:25.060461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:25.060461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:25.060461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:25.060461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:25.060461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:25.060461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:25.060461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:25.060461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:25.060824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:25.060824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:25.061528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:25.061528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:25.061528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:25.061528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:25.061528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:25.061528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:25.061528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:25.061528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:25.061528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:25.061528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:25.061528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:25.061528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:25.061528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:25.061528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:25.061528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:25.061528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:25.062095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:25.062657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:25.062657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:25.062657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:29.821389 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:29.822465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:29.822465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:29.823870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:29.862908 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:29.863133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.863875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:29.863875 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:29.863875 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:29.863875 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:29.863875 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:29.863875 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:29.863875 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.863875 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:29.865172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.865172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:29.865172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:29.865172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:29.865172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.865172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:29.865172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:29.865172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.865172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:29.865172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:29.865172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:29.865172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.865879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:29.865879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:29.865879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:29.865879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:29.865879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:29.865879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:29.865879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:29.865879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:29.865879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:29.865879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:29.865879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:29.865879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:29.865879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:29.866624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.866624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:29.866624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.866624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:29.866624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:29.866624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:29.866624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:29.866624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:29.866624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.866624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:29.866624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:29.866624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.866624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:29.866624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:29.866624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:29.867520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:29.868561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:29.868561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:29.868561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:29.868561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:29.868561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.868561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:29.876898 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:29.877316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:29.877449 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:29.877946 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:29.878113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:29.878281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.878863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:29.878863 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:29.878863 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:29.878863 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:29.878863 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:29.878863 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:29.878863 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.878863 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:29.879723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.879723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:29.879723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:29.879723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:29.879723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.879723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:29.879723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:29.879723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.879723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:29.879723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:29.879723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:29.879723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.880106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:29.880106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:29.880106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:29.880106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:29.880106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:29.880106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:29.880106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:29.880106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:29.880106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:29.880106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:29.880106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:29.880106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:29.880106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:29.880472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.880472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:29.880788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.880788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:29.880788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:29.880788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:29.880788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:29.880788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:29.880788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.880788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:29.880788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:29.880788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.880788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:29.880788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:29.880788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.880788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:29.880788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:29.880788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:29.881504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:29.882353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:29.882353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.882353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:29.884714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:29.885173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:29.885390 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:29.885584 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:52:29.885822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:29.885977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.886397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:29.886397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:29.886397 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:29.886397 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:29.886397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:29.886397 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:29.886397 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.886397 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:29.887117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.887117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:29.887117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:29.887117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:29.887117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.887117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:29.887117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:29.887117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:29.887117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.887117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:29.887117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:29.887117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:29.887117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:29.887117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:29.887117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:29.887939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:29.887939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:29.887939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:29.887939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:29.887939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:29.887939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:29.887939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:29.887939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.887939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:29.888459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.888459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:29.888459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:29.888459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:29.888459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.888459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:29.888459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:29.888459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:52:29.888459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:29.888459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:29.888459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.888459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:29.889059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:29.889059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:29.889059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.889059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:29.889059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:29.889059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:29.889059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:29.889059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:29.889059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:29.889059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:29.889059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:29.889059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:29.889059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:29.889059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:29.889754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:29.889754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:29.889754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.889754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:29.889754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.889754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:29.889754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:29.889754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:29.889754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:29.889754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:29.889754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.889754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:29.889754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:29.889754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:29.890277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:29.890848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:29.890848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:29.890848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:29.890848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:29.890848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:29.890848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:29.890848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:29.890848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:29.890848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:29.890848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:29.890848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.890848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:29.890848 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:29.890848 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:29.891273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:29.891273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:29.891273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:29.891273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.891273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:29.891273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:29.891273 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:29.891273 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:29.891273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:29.891273 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:29.891273 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.891273 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:29.892073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.892073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:29.892073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:29.892073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:29.892073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.892073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:29.892073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:29.892073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:29.892073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.892073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:29.892073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:29.892073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:29.892073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:29.892073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:29.892073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:29.892518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:29.892518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:29.892518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:29.892518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:29.892518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:29.892518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:29.892518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:29.892518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.892518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:29.892961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.892961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:29.892961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:29.892961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:29.892961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.892961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:29.892961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:29.892961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:29.892961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:29.892961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.892961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:29.893334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:29.893334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:29.893334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.893334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:29.893334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:29.893334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:29.893334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:29.893334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:29.893334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:29.893334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:29.893334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:29.893334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:29.893334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:29.893334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:29.893756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:29.893756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:29.893756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.893756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:29.894018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:29.894554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:29.895048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:29.895048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:29.895048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:29.895048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:30.054768 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:30.055384 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:30.055653 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:30.055938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:30.056668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:30.056939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:30.057125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:30.057963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:30.057963 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:30.057963 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:30.057963 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:30.057963 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:30.057963 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:30.057963 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:30.057963 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:30.059550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:30.059550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:30.059550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:30.059550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:30.059550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:30.059550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:30.059550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:30.059550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:30.059550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:30.059550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:30.059550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:30.059550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:30.060154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:30.060154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:30.060154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:30.060154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:30.060154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:30.060154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:30.060154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:30.060154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:30.060154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:30.060154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:30.060154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:30.060154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:30.060154 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:30.060755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:30.060755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:30.061302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:30.061302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:30.061302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:30.061302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:30.061302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:30.061302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:30.061302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:30.061302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:30.061302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:30.061302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:30.061302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:30.061302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:30.061302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:30.061302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:30.061302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:30.061302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:30.062247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:30.063117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:30.063117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:30.063117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:34.822100 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:34.822988 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:34.822988 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:34.824133 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:34.859417 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:34.859825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.860708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:34.860708 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:34.860708 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:34.860708 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:34.860708 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:34.860708 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:34.860708 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.860708 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:34.861794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.861794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:34.861794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:34.861794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:34.861794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.861794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:34.861794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:34.861794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.861794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:34.861794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:34.861794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:34.861794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.862463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:34.862463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:34.862463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:34.862463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:34.862463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:34.862463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:34.862463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:34.862463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:34.862463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:34.862463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:34.862463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:34.862463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:34.862463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:34.863222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.863222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:34.863222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.863222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:34.863222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:34.863222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:34.863222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:34.863222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:34.863222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.863222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:34.863222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:34.863222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.863222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:34.863222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:34.863222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:34.864261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:34.865196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:34.865196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:34.865196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:34.865196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:34.865196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.865196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:34.877529 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:34.877926 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:34.877995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:34.878703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:34.878988 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:34.879333 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.879983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:34.879983 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:34.879983 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:34.879983 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:34.879983 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:34.879983 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:34.879983 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.879983 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:34.881351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.881351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:34.881351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:34.881351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:34.881351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.881351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:34.881351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:34.881351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.881351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:34.881351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:34.881351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:34.881351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:34.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:34.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:34.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:34.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:34.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:34.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:34.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:34.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:34.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:34.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:34.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:34.882034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:34.882641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.882641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:34.883079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.883079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:34.883079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:34.883079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:34.883079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:34.883079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:34.883079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.883079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:34.883079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:34.883079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.883079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:34.883079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:34.883079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.883079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:34.883079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:34.883079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:34.884688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:34.885586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:34.885586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.885586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:34.885586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:34.885586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:34.885842 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:34.885907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:52:34.886507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:34.886864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.887518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:34.887518 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:34.887518 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:34.887518 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:34.887518 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:34.887518 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:34.887518 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.887518 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:34.888222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.888222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:34.888222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:34.888222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:34.888222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.888222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:34.888222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:34.888222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:34.888222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.888222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:34.888222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:34.888222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:34.888222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:34.888222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:34.888222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:34.888656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:34.888656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:34.888656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:34.888656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:34.888656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:34.888656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:34.888656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:34.888656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.888656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:34.889041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.889041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:34.889041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:34.889041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:34.889041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.889041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:34.889041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:34.889041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:52:34.889041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:34.889041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:34.889041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.889041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:34.889409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:34.889409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:34.889409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.889409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:34.889409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:34.889409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:34.889409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:34.889409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:34.889409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:34.889409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:34.889409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:34.889409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:34.889409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:34.889409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:34.889751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:34.889751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:34.889751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.889751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:34.890015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.890015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:34.890015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:34.890015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:34.890015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:34.890015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:34.890015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.890015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:34.890015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:34.890015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.890015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:34.890015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:34.890015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.890015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:34.890015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:34.890015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:34.890454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:34.890907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:34.890907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:34.890907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:34.890907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:34.890907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:34.890907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.890907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:34.890907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:34.890907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:34.890907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:34.891177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:34.891177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:34.891484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.892121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:34.892121 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:34.892121 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:34.892121 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:34.892121 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:34.892121 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:34.892121 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.892121 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:34.892858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.892858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:34.892858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:34.892858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:34.892858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.892858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:34.892858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:34.892858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:34.892858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.892858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:34.892858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:34.892858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:34.892858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:34.892858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:34.892858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:34.893259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:34.893259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:34.893259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:34.893259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:34.893259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:34.893259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:34.893259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:34.893259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.893259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:34.893711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.893711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:34.893711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:34.893711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:34.893711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.893711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:34.893711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:34.893711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:34.893711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:34.893711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.893711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:34.894009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:34.894009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:34.894009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.894009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:34.894009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:34.894009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:34.894009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:34.894009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:34.894009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:34.894009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:34.894009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:34.894009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:34.894009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:34.894009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:34.894391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:34.894391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:34.894391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.894391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:34.894733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:34.895185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:34.895702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:34.895702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:34.895702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:34.895702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:35.055635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:35.056265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:35.056603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:35.057112 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:35.057498 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:35.057781 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:35.057917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:35.058728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:35.058728 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:35.058728 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:35.058728 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:35.058728 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:35.058728 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:35.058728 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:35.058728 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:35.060472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:35.060472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:35.060472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:35.060472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:35.060472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:35.060472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:35.060472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:35.060472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:35.060472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:35.060472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:35.060472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:35.060472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:35.061335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:35.061335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:35.061335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:35.061335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:35.061335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:35.061335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:35.061335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:35.061335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:35.061335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:35.061335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:35.061335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:35.061335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:35.061335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:35.061997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:35.061997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:35.062231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:35.062231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:35.062231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:35.062231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:35.062231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:35.062231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:35.062231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:35.062231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:35.062231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:35.062231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:35.062231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:35.062231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:35.062231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:35.062231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:35.062231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:35.062231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:35.063010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:35.064041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:35.064041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:35.064041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:39.822935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:39.823731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:39.823731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:39.825061 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:39.862978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:39.863562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.864482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:39.864482 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:39.864482 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:39.864482 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:39.864482 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:39.864482 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:39.864482 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.864482 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:39.865563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.865563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:39.865563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:39.865563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:39.865563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.865563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:39.865563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:39.865563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.865563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:39.865563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:39.865563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:39.865563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.866280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:39.866280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:39.866280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:39.866280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:39.866280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:39.866280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:39.866280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:39.866280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:39.866280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:39.866280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:39.866280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:39.866280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:39.866280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:39.867006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.867006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:39.867006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.867006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:39.867006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:39.867006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:39.867006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:39.867006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:39.867006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.867006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:39.867006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:39.867006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.867006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:39.867006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:39.867006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:39.867813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:39.868839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:39.868839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:39.868839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:39.868839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:39.868839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.868839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:39.878237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:39.878751 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:39.878944 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:39.879717 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:39.879988 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:39.880277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.881115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:39.881115 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:39.881115 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:39.881115 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:39.881115 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:39.881115 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:39.881115 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.881115 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:39.882085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.882085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:39.882085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:39.882085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:39.882085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.882085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:39.882085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:39.882085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.882085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:39.882085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:39.882085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:39.882085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.882842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:39.882842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:39.882842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:39.882842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:39.882842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:39.882842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:39.882842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:39.882842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:39.882842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:39.882842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:39.882842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:39.882842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:39.882842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:39.883459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.883459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:39.883459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.883459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:39.883459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:39.883459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:39.883459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:39.883459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:39.883459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.883459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:39.883459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:39.883459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.883459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:39.883459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:39.883459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:39.884180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:39.885079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:39.885079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:39.885079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:39.885079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:39.885079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.885079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:39.885652 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:39.885951 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:39.886072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:39.886179 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:52:39.886732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:39.887113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.887897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:39.887897 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:39.887897 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:39.887897 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:39.887897 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:39.887897 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:39.887897 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.887897 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:39.888674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.888674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:39.888674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:39.888674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:39.888674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.888674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:39.888674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:39.888674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:39.888674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.888674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:39.888674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:39.888674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:39.888674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:39.888674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:39.888674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:39.889175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:39.889175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:39.889175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:39.889175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:39.889175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:39.889175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:39.889175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:39.889175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.889175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:39.889550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.889550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:39.889550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:39.889550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:39.889550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.889550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:39.889550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:39.889550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:52:39.889550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:39.889550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:39.889550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.889550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:39.889934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:39.889934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:39.889934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.889934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:39.889934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:39.889934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:39.889934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:39.889934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:39.889934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:39.889934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:39.889934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:39.889934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:39.889934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:39.889934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:39.890323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:39.890323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:39.890323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.890323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:39.890586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.890586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:39.890586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:39.890586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:39.890586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:39.890586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:39.890586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.890586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:39.890586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:39.890586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.890586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:39.890586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:39.890586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.890586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:39.890586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:39.890586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:39.891072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:39.891616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:39.891616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:39.891616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:39.891616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:39.891616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:39.891616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.891616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:39.891616 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:39.891616 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:39.891616 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:39.891956 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:39.891956 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:39.892035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.892628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:39.892628 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:39.892628 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:39.892628 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:39.892628 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:39.892628 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:39.892628 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.892628 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:39.893389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.893389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:39.893389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:39.893389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:39.893389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.893389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:39.893389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:39.893389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:39.893389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.893389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:39.893389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:39.893389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:39.893389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:39.893389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:39.893389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:39.893914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:39.893914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:39.893914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:39.893914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:39.893914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:39.893914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:39.893914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:39.893914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.893914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:39.894237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.894237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:39.894237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:39.894237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:39.894237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.894237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:39.894237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:39.894237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:39.894237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:39.894237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.894237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:39.894603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:39.894603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:39.894603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.894603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:39.894603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:39.894603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:39.894603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:39.894603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:39.894603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:39.894603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:39.894603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:39.894603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:39.894603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:39.894603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:39.895057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:39.895057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:39.895057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.895057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:39.895332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:39.895851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:39.896356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:39.896356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:39.896356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:39.896356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:40.056253 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:40.056797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:40.056918 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:40.057130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:40.057654 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:40.058031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:40.058275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:40.059145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:40.059145 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:40.059145 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:40.059145 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:40.059145 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:40.059145 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:40.059145 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:40.059145 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:40.060160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:40.060160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:40.060160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:40.060160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:40.060160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:40.060160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:40.060160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:40.060160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:40.060160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:40.060160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:40.060160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:40.060160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:40.060768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:40.060768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:40.060768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:40.060768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:40.060768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:40.060768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:40.060768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:40.060768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:40.060768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:40.060768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:40.060768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:40.060768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:40.060768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:40.061294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:40.061294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:40.061294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:40.061294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:40.061294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:40.061294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:40.061294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:40.061294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:40.061294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:40.061294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:40.061294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:40.061294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:40.061294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:40.061294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:40.061294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:40.061966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:40.062726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:40.062726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:40.062726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:40.062726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:40.062726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:40.062726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:44.823765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:44.825084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:44.825084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:44.826037 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:44.869082 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:44.869505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.871703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:44.871703 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:44.871703 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:44.871703 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:44.871703 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:44.871703 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:44.871703 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.871703 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:44.872399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.046 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.872399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:44.872399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:44.872399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:44.872399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.872399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:44.872399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:44.872399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.872399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:44.872399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:44.872399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:44.872399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.873004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:44.873004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:44.873004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:44.873004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:44.873004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:44.873004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:44.873004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:44.873004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:44.873004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:44.873004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:44.873004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:44.873004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:44.873004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:44.873727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.873727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:44.873727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.873727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:44.873727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:44.873727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:44.873727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:44.873727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:44.873727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.873727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:44.873727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:44.873727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.873727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:44.873727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:44.873727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:44.874532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:44.875920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:44.875920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:44.875920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:44.875920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:44.875920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.875920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:44.878732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:44.879108 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:44.879257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:44.880320 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:44.880661 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:44.880839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.881449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:44.881449 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:44.881449 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:44.881449 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:44.881449 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:44.881449 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:44.881449 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.881449 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:44.882420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.882420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:44.882420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:44.882420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:44.882420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.882420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:44.882420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:44.882420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.882420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:44.882420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:44.882420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:44.882420 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.882781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:44.882781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:44.882781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:44.882781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:44.882781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:44.882781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:44.882781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:44.882781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:44.882781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:44.882781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:44.882781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:44.882781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:44.882781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:44.883140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.883140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:44.883501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.883501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:44.883501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:44.883501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:44.883501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:44.883501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:44.883501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.883501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:44.883501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:44.883501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.883501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:44.883501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:44.883501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.883501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:44.883501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:44.883501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:44.883938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:44.884458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:44.884458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.884458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:44.886100 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:44.886518 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:44.886819 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:44.887004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:52:44.887418 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:44.887773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.888439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:44.888439 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:44.888439 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:44.888439 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:44.888439 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:44.888439 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:44.888439 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.888439 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:44.889447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.889447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:44.889447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:44.889447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:44.889447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.889447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:44.889447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:44.889447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:44.889447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.889447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:44.889447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:44.889447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:44.889447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:44.889447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:44.889447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:44.889936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:44.889936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:44.889936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:44.889936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:44.889936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:44.889936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:44.889936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:44.889936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.889936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:44.890486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.890486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:44.890486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:44.890486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:44.890486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.890486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:44.890486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:44.890486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:52:44.890486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:44.890486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:44.890486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.890486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:44.890860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:44.890860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:44.890860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.890860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:44.890860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:44.890860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:44.890860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:44.890860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:44.890860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:44.890860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:44.890860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:44.890860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:44.890860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:44.890860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:44.891225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:44.891225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:44.891225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.891225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:44.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:44.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:44.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:44.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:44.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:44.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:44.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:44.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:44.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:44.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:44.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:44.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:44.892208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:44.892736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:44.892736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:44.892736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:44.892736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:44.892736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:44.892736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.892736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:44.892736 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:44.892736 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:44.892736 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:44.893042 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:44.893468 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:44.893983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.894867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:44.894867 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:44.894867 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:44.894867 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:44.894867 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:44.894867 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:44.894867 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.894867 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:44.895734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.895734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:44.895734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:44.895734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:44.895734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.895734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:44.895734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:44.895734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:44.895734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.895734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:44.895734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:44.895734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:44.895734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:44.895734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:44.895734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:44.896127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:44.896127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:44.896127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:44.896127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:44.896127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:44.896127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:44.896127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:44.896127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.896127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:44.896725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.896725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:44.896725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:44.896725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:44.896725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.896725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:44.896725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:44.896725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:44.896725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:44.896725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.896725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:44.897060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:44.897060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:44.897060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.897060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:44.897060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:44.897060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:44.897060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:44.897060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:44.897060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:44.897060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:44.897060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:44.897060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:44.897060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:44.897060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:44.897437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:44.897437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:44.897437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.897437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:44.897862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:44.898417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:44.898950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:44.898950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:44.898950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:44.898950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:45.056949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:45.057883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:45.057883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:45.058217 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:45.058774 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:45.058997 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:45.059113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:45.059779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:45.059779 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:45.059779 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:45.059779 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:45.059779 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:45.059779 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:45.059779 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:45.059779 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:45.061462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:45.061462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:45.061462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:45.061462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:45.061462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:45.061462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:45.061462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:45.061462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:45.061462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:45.061462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:45.061462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:45.061462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:45.062042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:45.062042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:45.062042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:45.062042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:45.062042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:45.062042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:45.062042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:45.062042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:45.062042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:45.062042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:45.062042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:45.062042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:45.062042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:45.062609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:45.062609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:45.063053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:45.063053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:45.063053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:45.063053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:45.063053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:45.063053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:45.063053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:45.063053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:45.063053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:45.063053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:45.063053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:45.063053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:45.063053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:45.063053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:45.063053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:45.063053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:45.063794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:45.064602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:45.064602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:45.064602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:49.824841 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:49.825621 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:49.825836 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:49.827089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:49.870133 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:49.870538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.871614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:49.871614 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:49.871614 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:49.871614 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:49.871614 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:49.871614 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:49.871614 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.871614 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:49.872846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.045 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.872846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:49.872846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:49.872846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:49.872846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.872846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:49.872846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:49.872846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.872846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:49.872846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:49.872846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:49.872846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.873497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:49.873497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:49.873497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:49.873497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:49.873497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:49.873497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:49.873497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:49.873497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:49.873497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:49.873497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:49.873497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:49.873497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:49.873497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:49.874165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.874165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:49.874165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.874165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:49.874165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:49.874165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:49.874165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:49.874165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:49.874165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.874165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:49.874165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:49.874165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.874165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:49.874165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:49.874165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:49.875020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:49.877180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:49.877180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:49.877180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:49.877180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:49.877180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.877180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:49.879273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:49.879621 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:49.879704 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:49.880481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:49.880835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:49.881102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.881908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:49.881908 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:49.881908 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:49.881908 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:49.881908 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:49.881908 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:49.881908 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.881908 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:49.882844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.882844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:49.882844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:49.882844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:49.882844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.882844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:49.882844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:49.882844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.882844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:49.882844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:49.882844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:49.882844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.883184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:49.883184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:49.883184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:49.883184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:49.883184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:49.883184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:49.883184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:49.883184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:49.883184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:49.883184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:49.883184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:49.883184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:49.883184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:49.883524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.883524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:49.883866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.883866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:49.883866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:49.883866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:49.883866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:49.883866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:49.883866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.883866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:49.883866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:49.883866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.883866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:49.883866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:49.883866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.883866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:49.883866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:49.883866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:49.884304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:49.884775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:49.884775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.884775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:49.886687 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:49.886987 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:49.887097 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:49.887199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:52:49.887688 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:49.887996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.888776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:49.888776 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:49.888776 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:49.888776 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:49.888776 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:49.888776 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:49.888776 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.888776 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:49.889534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.889534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:49.889534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:49.889534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:49.889534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.889534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:49.889534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:49.889534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:49.889534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.889534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:49.889534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:49.889534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:49.889534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:49.889534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:49.889534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:49.889964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:49.889964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:49.889964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:49.889964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:49.889964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:49.889964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:49.889964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:49.889964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.889964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:49.890498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.890498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:49.890498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:49.890498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:49.890498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.890498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:49.890498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:49.890498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:52:49.890498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:49.890498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:49.890498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.890498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:49.891310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:49.891310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:49.891310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.891310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:49.891310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:49.891310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:49.891310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:49.891310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:49.891310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:49.891310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:49.891310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:49.891310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:49.891310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:49.891310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:49.891999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:49.891999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:49.891999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.891999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:49.891999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.891999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:49.891999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:49.891999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:49.891999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:49.891999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:49.891999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.891999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:49.891999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:49.891999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:49.892350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:49.893660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:49.893660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:49.893660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:49.893660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:49.893660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:49.893660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:49.893660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:49.893660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:49.893660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:49.893660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:49.893660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.893660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:49.893660 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:49.893660 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:49.894455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:49.894455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:49.894455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:49.894455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.894887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:49.894887 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:49.894887 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:49.894887 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:49.894887 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:49.894887 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:49.894887 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.894887 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:49.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:49.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:49.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:49.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:49.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:49.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:49.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:49.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:49.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:49.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:49.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:49.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:49.896000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:49.896000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:49.896000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:49.896000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:49.896000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:49.896000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:49.896000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:49.896000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.896000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:49.896556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.896556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:49.896556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:49.896556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:49.896556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.896556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:49.896556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:49.896556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:49.896556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:49.896556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.896556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:49.897598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:49.897598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:49.897598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.897598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:49.897598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:49.897598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:49.897598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:49.897598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:49.897598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:49.897598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:49.897598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:49.897598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:49.897598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:49.897598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:49.898424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:49.898424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:49.898424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.898424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:49.898424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.898424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:49.898424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:49.898424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:49.898424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:49.898424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:49.898424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.898424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:49.898424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:49.898424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:49.899141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:49.900131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:49.900131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:49.900131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:49.900131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:49.900131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:49.900131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:49.900131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:49.900131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:49.900131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:49.900131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:49.900131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:50.057668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:50.058211 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:50.058423 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:50.058717 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:50.059305 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:50.059818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:50.060035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:50.061123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:50.061123 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:50.061123 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:50.061123 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:50.061123 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:50.061123 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:50.061123 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:50.061123 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:50.062631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:50.062631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:50.062631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:50.062631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:50.062631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:50.062631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:50.062631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:50.062631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:50.062631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:50.062631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:50.062631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:50.062631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:50.063201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:50.063201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:50.063201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:50.063201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:50.063201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:50.063201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:50.063201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:50.063201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:50.063201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:50.063201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:50.063201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:50.063201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:50.063201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:50.064229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:50.064229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:50.064327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:50.064327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:50.064327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:50.064327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:50.064327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:50.064327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:50.064327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:50.064327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:50.064327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:50.064327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:50.064327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:50.064327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:50.064327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:50.064327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:50.064327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:50.064327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:50.065137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:50.066235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:50.066235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:50.066235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:54.825673 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:54.826723 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:54.826723 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:54.828277 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:54.830204 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:52:54.866995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:54.867262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.867873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:54.867873 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:54.867873 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:54.867873 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:54.867873 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:54.867873 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:54.867873 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.867873 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:54.868589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.868589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:54.868589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:54.868589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:54.868589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.868589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:54.868589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:54.868589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.868589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:54.868589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:54.868589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:54.868589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.868978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:54.868978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:54.868978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:54.868978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:54.868978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:54.868978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:54.868978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:54.868978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:54.868978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:54.868978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:54.868978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:54.868978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:54.868978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:54.869351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.869351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:54.869351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.869351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:54.869351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:54.869351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:54.869351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:54.869351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:54.869351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.869351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:54.869351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:54.869351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.869351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:54.869351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:54.869351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:54.869853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:54.870457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:54.870457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:54.870457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:54.870457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:54.870457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.870457 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:54.879896 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:54.880007 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:54.880065 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:54.880884 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:54.881070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:54.881417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.882194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:54.882194 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:54.882194 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:54.882194 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:54.882194 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:54.882194 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:54.882194 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.882194 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:54.883589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.883589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:54.883589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:54.883589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:54.883589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.883589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:54.883589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:54.883589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.883589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:54.883589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:54.883589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:54.883589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.884295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:54.884295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:54.884295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:54.884295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:54.884295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:54.884295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:54.884295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:54.884295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:54.884295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:54.884295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:54.884295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:54.884295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:54.884295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:54.884891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.884891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:54.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:54.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:54.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:54.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:54.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:54.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:54.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:54.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:54.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:54.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:54.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:54.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:54.885759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:54.886274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:54.886274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.886274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:54.887037 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:54.887342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:54.887562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:54.887754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:52:54.888064 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:54.888259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.888738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:54.888738 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:54.888738 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:54.888738 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:54.888738 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:54.888738 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:54.888738 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.888738 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:54.889446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.889446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:54.889446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:54.889446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:54.889446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.889446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:54.889446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:54.889446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:54.889446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.889446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:54.889446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:54.889446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:54.889446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:54.889446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:54.889446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:54.889887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:54.889887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:54.889887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:54.889887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:54.889887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:54.889887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:54.889887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:54.889887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.889887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:54.890312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.890312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:54.890312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:54.890312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:54.890312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.890312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:54.890312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:54.890312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:52:54.890312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:54.890312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:54.890312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.890312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:54.890676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:54.890676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:54.890676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.890676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:54.890676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:54.890676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:54.890676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:54.890676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:54.890676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:54.890676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:54.890676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:54.890676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:54.890676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:54.890676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:54.891047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:54.891047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:54.891047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.891047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:54.891291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.891291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:54.891291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:54.891291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:54.891291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:54.891291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:54.891291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.891291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:54.891291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:54.891291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.891291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:54.891291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:54.891291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.891291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:54.891291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:54.891291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:54.891799 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:54.892337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:54.892337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:54.892337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:54.892337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:54.892337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:54.892337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.892337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:54.893164 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:54.893385 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:54.893499 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:54.893616 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:54.893904 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:54.894164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.894670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:54.894670 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:54.894670 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:54.894670 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:54.894670 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:54.894670 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:54.894670 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.894670 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:54.895348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.895348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:54.895348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:54.895348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:54.895348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.895348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:54.895348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:54.895348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:54.895348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.895348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:54.895348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:54.895348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:54.895348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:54.895348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:54.895348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:54.895764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:54.895764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:54.895764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:54.895764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:54.895764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:54.895764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:54.895764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:54.895764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.895764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:54.896195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.896195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:54.896195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:54.896195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:54.896195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.896195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:54.896195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:54.896195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:54.896195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:54.896195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.896195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:54.896549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:54.896549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:54.896549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.896549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:54.896549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:54.896549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:54.896549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:54.896549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:54.896549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:54.896549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:54.896549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:54.896549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:54.896549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:54.896549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:54.896933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:54.896933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:54.896933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.896933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:54.897222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:54.897784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:54.898290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:54.898290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:54.898290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:54.898290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:55.058582 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:55.059172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:55.059387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:55.059744 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:55.060272 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:55.060699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:55.060930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:55.061825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:55.061825 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:55.061825 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:55.061825 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:55.061825 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:55.061825 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:55.061825 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:55.061825 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:55.063287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:55.063287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:55.063287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:55.063287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:55.063287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:55.063287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:55.063287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:55.063287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:55.063287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:55.063287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:55.063287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:55.063287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:55.063954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:55.063954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:55.063954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:55.063954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:55.063954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:55.063954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:55.063954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:55.063954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:55.063954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:55.063954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:55.063954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:55.063954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:55.063954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:55.064563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:55.064563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:55.064871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:55.064871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:55.064871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:55.064871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:55.064871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:55.064871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:55.064871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:55.064871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:55.064871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:55.064871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:55.064871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:55.064871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:55.064871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:55.064871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:55.064871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:55.064871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:55.065608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:55.066452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:55.066452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:55.066452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:59.826310 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:59.827111 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:59.827111 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:59.827793 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:59.854495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:59.854720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.855386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:59.855386 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:59.855386 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:59.855386 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:59.855386 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:59.855386 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:59.855386 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.855386 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:59.856129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.028 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.856129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:59.856129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:59.856129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:59.856129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.856129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:59.856129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:59.856129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.856129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:59.856129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:59.856129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:59.856129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.856763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:59.856763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:59.856763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:59.856763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:59.856763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:59.856763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:59.856763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:59.856763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:59.856763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:59.856763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:59.856763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:59.856763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:59.856763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:59.857312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.857312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:59.857312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.857312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:59.857312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:59.857312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:59.857312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:59.857312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:59.857312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.857312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:59.857312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:59.857312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.857312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:59.857312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:59.857312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:59.858017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:59.858886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:59.858886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:59.858886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:59.858886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:59.858886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.858886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:59.880331 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:59.880849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:59.881037 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:59.881878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:59.882101 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:59.882231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.882892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:59.882892 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:59.882892 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:59.882892 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:59.882892 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:59.882892 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:59.882892 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.882892 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:59.884324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.884324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:59.884324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:59.884324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:59.884324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.884324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:59.884324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:59.884324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.884324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:59.884324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:59.884324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:59.884324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:59.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:59.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:59.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:59.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:59.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:59.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:59.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:59.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:59.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:59.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:59.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:59.885184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:59.886033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.886033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:59.886033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.886033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:59.886033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:59.886033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:59.886033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:59.886033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:59.886033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.886033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:59.886033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:59.886033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.886033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:59.886033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:59.886033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:59.886952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:59.888236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:59.888236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:59.888236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:59.888236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:59.888236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.888236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:59.888236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:59.888236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:59.888236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:59.888236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:52:59.888913 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:59.888913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.889056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:59.889056 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:59.889056 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:59.889056 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:59.889056 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:59.889056 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:59.889056 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.889056 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:59.890090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.890090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:59.890090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:59.890090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:59.890090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.890090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:59.890090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:59.890090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:59.890090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.890090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:59.890090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:59.890090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:59.890090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:59.890090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:59.890090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:59.890825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:59.890825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:59.890825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:59.890825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:59.890825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:59.890825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:59.890825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:59.890825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.890825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:59.891316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.891316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:59.891316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:59.891316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:59.891316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.891316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:59.891316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:59.891316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:52:59.891316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:59.891316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:59.891316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.891316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:59.891941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:59.891941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:59.891941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.891941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:59.891941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:59.891941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:59.891941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:59.891941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:59.891941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:59.891941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:59.891941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:59.891941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:59.891941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:59.891941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:59.892486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:59.892486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:59.892486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.892486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:59.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:59.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:59.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:59.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:59.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:59.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:59.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:59.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:59.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:59.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:59.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:59.892849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:59.893445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:59.894089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:59.894089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:59.894089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:59.894089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:59.894089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:59.894089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.894089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:52:59.894089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:52:59.894089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:52:59.894089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:52:59.894493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:52:59.894493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:52:59.894703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.895252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:52:59.895252 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:59.895252 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:52:59.895252 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:52:59.895252 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:59.895252 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:52:59.895252 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.895252 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:52:59.895977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.895977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:52:59.895977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:59.895977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:59.895977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.895977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:59.895977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:59.895977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:59.895977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.895977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:52:59.895977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:59.895977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:52:59.895977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:59.895977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:52:59.895977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:52:59.896541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:59.896541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:52:59.896541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:59.896541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:52:59.896541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:52:59.896541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:59.896541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:52:59.896541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.896541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:52:59.896977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.896977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:52:59.896977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:59.896977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:52:59.896977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.896977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:59.896977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:59.896977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:59.896977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:59.896977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.896977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:59.897441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:59.897441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:59.897441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.897441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:52:59.897441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:59.897441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:52:59.897441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:59.897441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:52:59.897441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:52:59.897441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:59.897441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:52:59.897441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:59.897441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:52:59.897441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:52:59.897938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:59.897938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:52:59.897938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.897938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:52:59.898101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:52:59.898740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:52:59.899285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:52:59.899285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:52:59.899285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:52:59.899285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:00.059078 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:00.059623 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:00.059855 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:00.060149 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:00.060720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:00.061135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:00.061390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:00.062388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:00.062388 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:00.062388 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:00.062388 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:00.062388 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:00.062388 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:00.062388 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:00.062388 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:00.064067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:00.064067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:00.064067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:00.064067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:00.064067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:00.064067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:00.064067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:00.064067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:00.064067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:00.064067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:00.064067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:00.064067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:00.064820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:00.064820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:00.064820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:00.064820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:00.064820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:00.064820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:00.064820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:00.064820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:00.064820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:00.064820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:00.064820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:00.064820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:00.064820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:00.065406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:00.065406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:00.065559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:00.065559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:00.065559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:00.065559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:00.065559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:00.065559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:00.065559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:00.065559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:00.065559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:00.065559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:00.065559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:00.065559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:00.065559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:00.065559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:00.065559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:00.065559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:00.066480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:00.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:00.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:00.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:04.826974 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:04.827905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:04.827905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:04.829286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:04.860335 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:04.860934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.861842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:04.861842 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:04.861842 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:04.861842 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:04.861842 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:04.861842 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:04.861842 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.861842 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:04.862615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.862615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:04.862615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:04.862615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:04.862615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.862615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:04.862615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:04.862615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.862615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:04.862615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:04.862615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:04.862615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.863048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:04.863048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:04.863048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:04.863048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:04.863048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:04.863048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:04.863048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:04.863048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:04.863048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:04.863048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:04.863048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:04.863048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:04.863048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:04.863545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.863545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:04.863545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.863545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:04.863545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:04.863545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:04.863545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:04.863545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:04.863545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.863545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:04.863545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:04.863545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.863545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:04.863545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:04.863545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:04.864029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:04.864702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:04.864702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:04.864702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:04.864702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:04.864702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.864702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:04.880861 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:04.881169 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:04.881295 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:04.882020 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:04.882360 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:04.882639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.883437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:04.883437 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:04.883437 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:04.883437 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:04.883437 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:04.883437 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:04.883437 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.883437 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:04.884898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.884898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:04.884898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:04.884898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:04.884898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.884898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:04.884898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:04.884898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.884898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:04.884898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:04.884898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:04.884898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.885494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:04.885494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:04.885494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:04.885494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:04.885494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:04.885494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:04.885494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:04.885494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:04.885494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:04.885494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:04.885494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:04.885494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:04.885494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:04.886263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.886263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:04.886662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.886662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:04.886662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:04.886662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:04.886662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:04.886662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:04.886662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.886662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:04.886662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:04.886662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.886662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:04.886662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:04.886662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.886662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:04.886662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:04.886662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:04.887433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:04.888239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:04.888239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.888239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:04.888239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:04.888239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:04.888239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:04.888615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:53:04.888832 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:04.889111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.889870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:04.889870 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:04.889870 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:04.889870 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:04.889870 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:04.889870 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:04.889870 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.889870 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:04.890905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.890905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:04.890905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:04.890905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:04.890905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.890905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:04.890905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:04.890905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:04.890905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.890905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:04.890905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:04.890905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:04.890905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:04.890905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:04.890905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:04.891734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:04.891734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:04.891734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:04.891734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:04.891734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:04.891734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:04.891734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:04.891734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.891734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:04.891734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.891734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:04.891734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:04.891734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:04.891734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.892521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:04.892521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:04.892521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:53:04.892521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:04.892521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:04.892521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.892521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:04.892521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:04.892521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:04.892521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.892521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:04.892521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:04.892521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:04.893172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:04.893172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:04.893172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:04.893172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:04.893172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:04.893172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:04.893172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:04.893172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:04.893172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:04.893172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:04.893172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.893172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:04.893821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.893821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:04.893821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:04.893821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:04.893821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:04.893821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:04.893821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.893821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:04.893821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:04.893821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.893821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:04.893821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:04.893821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.893821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:04.893821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:04.893821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:04.894680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:04.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:04.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:04.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:04.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:04.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:04.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:04.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:04.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:04.895620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:04.896236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:04.896236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:04.896236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.896236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:04.896236 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:04.896236 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:04.896236 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:04.896236 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:04.896236 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:04.896236 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.896236 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:04.896236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:04.897015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:04.897734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:04.897734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:04.897734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:04.897734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:04.897734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.897734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:04.897734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.897734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:04.897734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:04.897734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:04.897734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.897734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:04.897734 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:04.898019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:04.898019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:04.898019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.898019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:04.898019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:04.898019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:04.898019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.898019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:04.898019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:04.898019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:04.898019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:04.898019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:04.898019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:04.898263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:04.898263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:04.898263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:04.898263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:04.898263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:04.898263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:04.898263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:04.898263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.898263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:04.898263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.898263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:04.898263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.898527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:04.898901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:05.059918 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:05.060314 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:05.060553 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:05.060872 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:05.061517 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:05.062023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:05.062266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:05.063447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:05.063447 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:05.063447 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:05.063447 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:05.063447 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:05.063447 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:05.063447 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:05.063447 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:05.063977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:05.063977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:05.063977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:05.063977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:05.063977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:05.063977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:05.063977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:05.063977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:05.063977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:05.063977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:05.063977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:05.063977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:05.064617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:05.064617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:05.064617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:05.064617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:05.064617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:05.064617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:05.064617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:05.064617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:05.064617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:05.064617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:05.064617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:05.064617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:05.064617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:05.065193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:05.065193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:05.065294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:05.065294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:05.065294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:05.065294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:05.065294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:05.065294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:05.065294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:05.065294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:05.065294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:05.065294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:05.065294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:05.065294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:05.065294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:05.065294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:05.065294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:05.065294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:05.065989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:05.066924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:05.066924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:05.066924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:09.827686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:09.828629 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:09.828629 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:09.829659 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:09.863397 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:09.863599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.864184 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:09.864184 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:09.864184 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:09.864184 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:09.864184 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:09.864184 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:09.864184 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.864184 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:09.865683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.865683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:09.865683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:09.865683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:09.865683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.865683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:09.865683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:09.865683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.865683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:09.865683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:09.865683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:09.865683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.866351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:09.866351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:09.866351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:09.866351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:09.866351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:09.866351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:09.866351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:09.866351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:09.866351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:09.866351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:09.866351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:09.866351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:09.866351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:09.867071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.867071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:09.867222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.867222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:09.867222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:09.867222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:09.867222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:09.867222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:09.867222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.867222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:09.867222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:09.867222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.867222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:09.867222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:09.867222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.867222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:09.867222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:09.867222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:09.868067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:09.869356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:09.869356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.869356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:09.881286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:09.881573 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:09.881671 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:09.882313 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:09.882691 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:09.882958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.883796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:09.883796 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:09.883796 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:09.883796 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:09.883796 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:09.883796 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:09.883796 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.883796 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:09.885118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.885118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:09.885118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:09.885118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:09.885118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.885118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:09.885118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:09.885118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.885118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:09.885118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:09.885118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:09.885118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.885818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:09.885818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:09.885818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:09.885818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:09.885818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:09.885818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:09.885818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:09.885818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:09.885818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:09.885818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:09.885818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:09.885818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:09.885818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:09.886489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.886489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:09.886820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.886820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:09.886820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:09.886820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:09.886820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:09.886820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:09.886820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.886820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:09.886820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:09.886820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.886820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:09.886820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:09.886820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.886820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:09.886820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:09.886820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:09.888450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:09.890541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:09.890541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.890541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:09.890541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:09.890541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:09.890541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:09.890541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:53:09.890541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:09.891535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:09.892505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.892505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:09.892505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:09.892505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:09.892505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:09.892505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:09.892505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:09.892505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:09.892505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:09.892505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:09.892505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:09.892505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:09.892505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:09.892505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:09.892505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.892505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:09.893519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.893519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:09.893519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:09.893519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:09.893519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.893519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:09.893519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:09.893519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:53:09.893519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:09.893519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:09.893519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.893519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:09.893980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:09.893980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:09.893980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.893980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:09.893980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:09.893980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:09.893980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:09.893980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:09.893980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:09.893980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:09.893980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:09.893980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:09.893980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:09.893980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:09.894342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:09.894342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:09.894342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.894342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:09.894342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.894342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:09.894342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:09.894342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:09.894342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:09.894342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:09.894342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.894342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:09.894342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:09.894342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:09.894822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:09.895445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:09.895445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:09.895445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:09.895445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:09.895445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:09.895445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:09.895445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:09.895445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:09.895445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:09.895445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:09.895445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.895445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:09.895445 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:09.895445 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:09.895853 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:09.895853 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:09.895853 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:09.895853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.895853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:09.895853 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:09.895853 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:09.895853 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:09.895853 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:09.895853 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:09.895853 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.895853 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:09.896824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.896824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:09.896824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:09.896824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:09.896824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.896824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:09.896824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:09.896824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:09.896824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.896824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:09.896824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:09.896824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:09.896824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:09.896824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:09.896824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:09.897259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:09.897259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:09.897259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:09.897259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:09.897259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:09.897259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:09.897259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:09.897259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.897259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:09.897922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.897922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:09.897922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:09.897922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:09.897922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.897922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:09.897922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:09.897922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:09.897922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:09.897922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.897922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:09.898292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:09.898292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:09.898292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.898292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:09.898292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:09.898292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:09.898292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:09.898292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:09.898292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:09.898292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:09.898292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:09.898292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:09.898292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:09.898292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:09.898732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:09.898732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:09.898732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.898732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:09.898931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:09.899472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:09.900008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:09.900008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:09.900008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:09.900008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:10.060623 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:10.061001 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:10.061198 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:10.061498 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:10.061937 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:10.062291 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:10.062548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:10.063255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:10.063255 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:10.063255 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:10.063255 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:10.063255 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:10.063255 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:10.063255 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:10.063255 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:10.064662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:10.064662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:10.064662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:10.064662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:10.064662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:10.064662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:10.064662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:10.064662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:10.064662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:10.064662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:10.064662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:10.064662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:10.065258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:10.065258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:10.065258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:10.065258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:10.065258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:10.065258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:10.065258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:10.065258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:10.065258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:10.065258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:10.065258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:10.065258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:10.065258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:10.065860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:10.065860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:10.066232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:10.066232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:10.066232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:10.066232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:10.066232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:10.066232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:10.066232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:10.066232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:10.066232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:10.066232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:10.066232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:10.066232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:10.066232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:10.066232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:10.066232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:10.066232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:10.066986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:10.067877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:10.067877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:10.067877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:14.839287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:14.842041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:14.842153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:14.842852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:14.875405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:14.875811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.876708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:14.876708 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:14.876708 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:14.876708 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:14.876708 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:14.876708 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:14.876708 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.876708 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:14.877849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.877849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:14.877849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:14.877849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:14.877849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.877849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:14.877849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:14.877849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.877849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:14.877849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:14.877849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:14.877849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.878664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:14.878664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:14.878664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:14.878664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:14.878664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:14.878664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:14.878664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:14.878664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:14.878664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:14.878664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:14.878664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:14.878664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:14.878664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:14.879317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.879317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:14.879484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.879484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:14.879484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:14.879484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:14.879484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:14.879484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:14.879484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.879484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:14.879484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:14.879484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.879484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:14.879484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:14.879484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.879484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:14.879484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:14.879484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:14.879975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:14.880660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:14.880660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.880660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:14.881658 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:14.881973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:14.882139 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:14.882924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:14.883146 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:14.883294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.883869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:14.883869 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:14.883869 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:14.883869 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:14.883869 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:14.883869 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:14.883869 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.883869 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:14.884857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.884857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:14.884857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:14.884857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:14.884857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.884857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:14.884857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:14.884857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.884857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:14.884857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:14.884857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:14.884857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.885453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:14.885453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:14.885453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:14.885453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:14.885453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:14.885453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:14.885453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:14.885453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:14.885453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:14.885453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:14.885453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:14.885453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:14.885453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:14.885992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.885992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:14.886345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.886345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:14.886345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:14.886345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:14.886345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:14.886345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:14.886345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.886345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:14.886345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:14.886345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.886345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:14.886345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:14.886345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.886345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:14.886345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:14.886345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:14.887013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:14.887518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:14.887518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.887518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:14.888401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:14.888668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:14.888818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:14.888996 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:53:14.889291 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:14.889499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.890048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:14.890048 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:14.890048 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:14.890048 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:14.890048 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:14.890048 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:14.890048 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.890048 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:14.890968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.890968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:14.890968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:14.890968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:14.890968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.890968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:14.890968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:14.890968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:14.890968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.890968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:14.890968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:14.890968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:14.890968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:14.890968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:14.890968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:14.891720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:14.891720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:14.891720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:14.891720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:14.891720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:14.891720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:14.891720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:14.891720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.891720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:14.892164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.892164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:14.892164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:14.892164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:14.892164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.892164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:14.892164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:14.892164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:53:14.892164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:14.892164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:14.892164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.892164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:14.892701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:14.892701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:14.892701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.892701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:14.892701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:14.892701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:14.892701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:14.892701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:14.892701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:14.892701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:14.892701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:14.892701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:14.892701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:14.892701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:14.893269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:14.893269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:14.893269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.893269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:14.893587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.893587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:14.893587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:14.893587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:14.893587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:14.893587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:14.893587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.893587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:14.893587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:14.893587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.893587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:14.893587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:14.893587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.893587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:14.893587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:14.893587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:14.894139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:14.894849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:14.894849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:14.894849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:14.894849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:14.894849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:14.894849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.894849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:14.894849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:14.894849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:14.894849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:14.895293 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:14.895445 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:14.895661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.896172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:14.896172 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:14.896172 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:14.896172 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:14.896172 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:14.896172 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:14.896172 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.896172 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:14.897065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.897065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:14.897065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:14.897065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:14.897065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.897065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:14.897065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:14.897065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:14.897065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.897065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:14.897065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:14.897065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:14.897065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:14.897065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:14.897065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:14.897694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:14.897694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:14.897694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:14.897694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:14.897694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:14.897694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:14.897694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:14.897694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.897694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:14.898262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.898262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:14.898262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:14.898262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:14.898262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.898262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:14.898262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:14.898262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:14.898262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:14.898262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.898262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:14.898824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:14.898824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:14.898824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.898824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:14.898824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:14.898824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:14.898824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:14.898824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:14.898824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:14.898824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:14.898824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:14.898824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:14.898824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:14.898824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:14.899343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:14.899343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:14.899343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.899343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:14.899819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:14.900361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:14.900999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:14.900999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:14.900999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:14.900999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:15.061137 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:15.062232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:15.062567 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:15.063040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:15.063473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:15.063760 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:15.063879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:15.064520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:15.064520 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:15.064520 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:15.064520 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:15.064520 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:15.064520 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:15.064520 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:15.064520 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:15.065541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:15.065541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:15.065541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:15.065541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:15.065541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:15.065541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:15.065541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:15.065541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:15.065541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:15.065541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:15.065541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:15.065541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:15.066366 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:15.066366 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:15.066366 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:15.066366 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:15.066366 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:15.066366 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:15.066366 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:15.066366 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:15.066366 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:15.066366 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:15.066366 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:15.066366 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:15.066366 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:15.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:15.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:15.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:15.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:15.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:15.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:15.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:15.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:15.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:15.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:15.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:15.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:15.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:15.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:15.067040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:15.067822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:15.068752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:15.068752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:15.068752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:15.068752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:15.068752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:15.068752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:19.842499 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:19.843265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:19.843467 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:19.844350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:19.909114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:19.909114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:19.911572 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:19.927344 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:19.927877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.929009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:19.929009 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:19.929009 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:19.929009 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:19.929009 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:19.929009 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:19.929009 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.929009 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:19.930133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.086 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.930133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:19.930133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:19.930133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:19.930133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.930133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:19.930133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:19.930133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.930133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:19.930133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:19.930133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:19.930133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.930977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:19.930977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:19.930977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:19.930977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:19.930977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:19.930977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:19.930977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:19.930977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:19.930977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:19.930977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:19.930977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:19.930977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:19.930977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:19.931807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.931807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:19.931807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.931807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:19.931807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:19.931807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:19.931807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:19.931807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:19.931807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.931807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:19.931807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:19.931807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.931807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:19.931807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:19.931807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:19.932707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:19.933817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:19.933817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:19.933817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:19.933817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:19.933817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.933817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:19.933817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:19.933817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:19.933817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:19.933817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:19.934553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.934553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:19.934553 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:19.934553 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:19.934553 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:19.934553 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:19.934553 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:19.934553 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.934553 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:19.935634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.935634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:19.935634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:19.935634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:19.935634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.935634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:19.935634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:19.935634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.935634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:19.935634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:19.935634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:19.935634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.936739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:19.936739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:19.936739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:19.936739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:19.936739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:19.936739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:19.936739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:19.936739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:19.936739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:19.936739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:19.936739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:19.936739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:19.936739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:19.937201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.937201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:19.937201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.937201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:19.937201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:19.937201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:19.937201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:19.937201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:19.937201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.937201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:19.937201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:19.937201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.937201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:19.937201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:19.937201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:19.937980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:19.938653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:19.938653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:19.938653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:19.938653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:19.938653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.938653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:19.938653 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:19.938653 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:19.938653 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:53:19.938653 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:19.939273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:19.939898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.939898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:19.939898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:19.939898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:19.939898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:19.939898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:19.939898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:19.939898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:19.939898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:19.939898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:19.939898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:19.939898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:19.939898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:19.939898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:19.939898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.939898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:19.940555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.940555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:19.940555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:19.940555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:19.940555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.940555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:19.940555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:19.940555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:53:19.940555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:19.940555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:19.940555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.940555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:19.941125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:19.941125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:19.941125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.941125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:19.941125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:19.941125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:19.941125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:19.941125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:19.941125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:19.941125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:19.941125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:19.941125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:19.941125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:19.941125 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:19.941757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:19.941757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:19.941757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.941757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:19.941757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.941757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:19.941757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:19.941757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:19.941757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:19.941757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:19.941757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.941757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:19.941757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:19.941757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:19.942339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:19.943145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:19.943145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:19.943145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:19.943145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:19.943145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:19.943145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:19.943145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:19.943145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:19.943145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:19.943145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:19.943145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.943145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:19.943145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:19.943145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:19.944265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:19.944265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:19.944265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.944265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:19.944265 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:19.944265 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:19.944265 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:19.944265 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:19.944265 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:19.944265 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.944265 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:19.944265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:19.944829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:19.945580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:19.945580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:19.945580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:19.945580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:19.945580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.945580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:19.945580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.945580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:19.945580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:19.945580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:19.945580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.945580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:19.945580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:19.946127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:19.946127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:19.946127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.946127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:19.946127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:19.946127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:19.946127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.946127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:19.946127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:19.946127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:19.946127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:19.946127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:19.946127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:19.946959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:19.946959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:19.946959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:19.946959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:19.946959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:19.946959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:19.946959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:19.946959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.946959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:19.946959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.946959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:19.946959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.947396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:19.947951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:20.062163 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:20.063023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:20.063248 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:20.063717 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:20.064329 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:20.064789 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:20.065014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:20.066008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:20.066008 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:20.066008 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:20.066008 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:20.066008 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:20.066008 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:20.066008 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:20.066008 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:20.068113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:20.068113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:20.068113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:20.068113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:20.068113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:20.068113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:20.068113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:20.068113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:20.068113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:20.068113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:20.068113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:20.068113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:20.068901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:20.068901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:20.068901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:20.068901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:20.068901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:20.068901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:20.068901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:20.068901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:20.068901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:20.068901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:20.068901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:20.068901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:20.068901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:20.069617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:20.069617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:20.070269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:20.070269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:20.070269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:20.070269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:20.070269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:20.070269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:20.070269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:20.070269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:20.070269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:20.070269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:20.070269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:20.070269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:20.070269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:20.070269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:20.070269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:20.070269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:20.071262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:20.072393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:20.072393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:20.072393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:24.843470 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:24.844336 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:24.844336 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:24.845507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:24.881760 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:24.882275 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.883131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:24.883131 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:24.883131 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:24.883131 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:24.883131 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:24.883131 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:24.883131 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.883131 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:24.883930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.883930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:24.883930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:24.883930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:24.883930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.883930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:24.883930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:24.883930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.883930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:24.883930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:24.883930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:24.883930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.884584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:24.884584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:24.884584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:24.884584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:24.884584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:24.884584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:24.884584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:24.884584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:24.884584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:24.884584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:24.884584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:24.884584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:24.884584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:24.885197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.885197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:24.885197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.885197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:24.885197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:24.885197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:24.885197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:24.885197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:24.885197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.885197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:24.885197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:24.885197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.885197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:24.885197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:24.885197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:24.886022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:24.887141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:24.887141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:24.887141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:24.887141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:24.887141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.887141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:24.954875 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:24.954875 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:24.954875 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:24.958860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:24.958860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:24.958860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:24.958860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:24.958860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.958860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:24.958860 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:24.958860 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:24.958860 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:24.959987 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:24.959987 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:24.959987 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.959987 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:24.959987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.959987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:24.959987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:24.959987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:24.959987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.959987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:24.959987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:24.959987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.959987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:24.960602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:24.960602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:24.960602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.960602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:24.960602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:24.960602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:24.960602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:24.960602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:24.960602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:24.960602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:24.960602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:24.960602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:24.960602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:24.960602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:24.961179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:24.961179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:24.961179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.961179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:24.961179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.961179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:24.961179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:24.961179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:24.961179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:24.961179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:24.961179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.961179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:24.961179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:24.961179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:24.961776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:24.962557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:24.962557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:24.962557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:24.962557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:24.962557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:24.962557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:24.962557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:24.962557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.962557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:24.962557 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:24.962557 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:24.962557 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:53:24.963070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:24.963070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.963070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:24.963070 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:24.963070 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:24.963070 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:24.963070 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:24.963070 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:24.963070 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.963070 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:24.963901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.963901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:24.963901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:24.963901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:24.963901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.963901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:24.963901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:24.963901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:24.963901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.963901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:24.963901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:24.963901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:24.963901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:24.963901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:24.963901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:24.964914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:24.964914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:24.964914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:24.964914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:24.964914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:24.964914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:24.964914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:24.964914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.964914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:24.964914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.964914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:24.964914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:24.964914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:24.964914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.965718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:24.965718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:24.965718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:53:24.965718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:24.965718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:24.965718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.965718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:24.965718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:24.965718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:24.965718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.965718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:24.965718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:24.965718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:24.966239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:24.966239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:24.966239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:24.966239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:24.966239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:24.966239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:24.966239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:24.966239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:24.966239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:24.966239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:24.966239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.966239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:24.966482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.966482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:24.966482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:24.966482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:24.966482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:24.966482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:24.966482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.966482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:24.966482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:24.966482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.966482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:24.966482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:24.966482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.966482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:24.966482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:24.966482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:24.966790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:24.967132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:24.967132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:24.967132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:24.967132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:24.967132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:24.967132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.967132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:24.967132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:24.967132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:24.967132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:24.967347 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:24.967347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.967347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:24.967347 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:24.967347 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:24.967347 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:24.967347 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:24.967347 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:24.967347 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.967347 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:24.967347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.967347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:24.967347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:24.967347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:24.967624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:24.967935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.967935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:24.967935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.967935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:24.967935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:24.967935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:24.967935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.967935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:24.967935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:24.967935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:24.967935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:24.967935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.968219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:24.968219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:24.968219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:24.968219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.968219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:24.968219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:24.968219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:24.968219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:24.968219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:24.968219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:24.968219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:24.968219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:24.968219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:24.968219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:24.968492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:24.968492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:24.968492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:24.968492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.968492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:24.968492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.968492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:24.968492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:24.968492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:24.968492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:24.968492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:24.968492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.968492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:24.968492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:24.968492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:24.968792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:24.969173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:24.969173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:24.969173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:24.969173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:24.969173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:24.969173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:24.969173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:24.969173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:24.969173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:24.969173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:24.969173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:25.063022 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:25.063598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:25.063782 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:25.064246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:25.064601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:25.064921 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:25.065084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:25.065793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:25.065793 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:25.065793 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:25.065793 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:25.065793 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:25.065793 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:25.065793 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:25.065793 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:25.067129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:25.067129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:25.067129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:25.067129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:25.067129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:25.067129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:25.067129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:25.067129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:25.067129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:25.067129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:25.067129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:25.067129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:25.067707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:25.067707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:25.067707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:25.067707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:25.067707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:25.067707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:25.067707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:25.067707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:25.067707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:25.067707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:25.067707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:25.067707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:25.067707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:25.068261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:25.068261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:25.068978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:25.068978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:25.068978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:25.068978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:25.068978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:25.068978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:25.068978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:25.068978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:25.068978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:25.068978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:25.068978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:25.068978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:25.068978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:25.068978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:25.068978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:25.068978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:25.069772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:25.070613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:25.070613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:25.070613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:29.844082 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:29.845000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:29.845000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:29.846114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:29.880577 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:29.880874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.881511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:29.881511 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:29.881511 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:29.881511 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:29.881511 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:29.881511 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:29.881511 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.881511 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:29.882507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.882507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:29.882507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:29.882507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:29.882507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.882507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:29.882507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:29.882507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.882507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:29.882507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:29.882507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:29.882507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.883153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:29.883153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:29.883153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:29.883153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:29.883153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:29.883153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:29.883153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:29.883153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:29.883153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:29.883153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:29.883153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:29.883153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:29.883153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:29.883784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.883784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:29.883784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.883784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:29.883784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:29.883784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:29.883784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:29.883784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:29.883784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.883784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:29.883784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:29.883784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.883784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:29.883784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:29.883784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:29.884528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:29.885435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:29.885435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:29.885435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:29.885435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:29.885435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.885435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:29.955410 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:29.955874 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:29.956074 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:29.957032 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:29.957415 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:29.957650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.958694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:29.958694 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:29.958694 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:29.958694 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:29.958694 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:29.958694 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:29.958694 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.958694 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:29.960062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.960062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:29.960062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:29.960062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:29.960062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.960062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:29.960062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:29.960062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.960062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:29.960062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:29.960062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:29.960062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.960614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:29.960614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:29.960614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:29.960614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:29.960614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:29.960614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:29.960614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:29.960614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:29.960614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:29.960614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:29.960614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:29.960614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:29.960614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:29.960977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.960977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:29.961851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.961851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:29.961851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:29.961851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:29.961851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:29.961851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:29.961851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.961851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:29.961851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:29.961851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.961851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:29.961851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:29.961851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.961851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:29.961851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:29.961851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:29.962442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:29.962974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:29.962974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.962974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:29.962974 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:29.963320 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:29.963449 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:29.963562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:53:29.964602 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:29.964602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.964795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:29.964795 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:29.964795 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:29.964795 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:29.964795 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:29.964795 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:29.964795 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.964795 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:29.965496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.965496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:29.965496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:29.965496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:29.965496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.965496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:29.965496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:29.965496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:29.965496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.965496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:29.965496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:29.965496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:29.965496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:29.965496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:29.965496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:29.966251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:29.966251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:29.966251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:29.966251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:29.966251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:29.966251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:29.966251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:29.966251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.966251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:29.966710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.966710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:29.966710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:29.966710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:29.966710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.966710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:29.966710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:29.966710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:53:29.966710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:29.966710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:29.966710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.966710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:29.967323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:29.967323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:29.967323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.967323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:29.967323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:29.967323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:29.967323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:29.967323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:29.967323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:29.967323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:29.967323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:29.967323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:29.967323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:29.967323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:29.968070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:29.968070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:29.968070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.968070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:29.968070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:29.968070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.968070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:29.968070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:29.968070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:29.968070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:29.968070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:29.968070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:29.968920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.969852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:29.969852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:29.969852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:29.969852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:29.969852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:29.969852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:29.969852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:29.969852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:29.969852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:29.969852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:29.969852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:29.969852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:29.969852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:29.969852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.969852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:29.969852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:29.970671 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:29.970671 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:29.970671 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:29.970671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.970671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:29.970671 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:29.970671 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:29.970671 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:29.970671 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:29.970671 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:29.970671 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.970671 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:29.971517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.971517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:29.971517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:29.971517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:29.971517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.971517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:29.971517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:29.971517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:29.971517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.971517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:29.971517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:29.971517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:29.971517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:29.971517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:29.971517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:29.972260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:29.972260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:29.972260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:29.972260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:29.972260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:29.972260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:29.972260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:29.972260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.972260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:29.972260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.972260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:29.972260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:29.972260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:29.972260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.972769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:29.972769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:29.972769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:29.972769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:29.972769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.972769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:29.972769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:29.972769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:29.972769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.972769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:29.972769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:29.972769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:29.972769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:29.973317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:29.973317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:29.973317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:29.973317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:29.973317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:29.973317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:29.973317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:29.973317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:29.973317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:29.973317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.973317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:29.973317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:29.973649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:29.974133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:30.064222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:30.064652 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:30.064765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:30.064912 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:30.065770 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:30.066222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:30.066491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:30.067354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:30.067354 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:30.067354 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:30.067354 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:30.067354 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:30.067354 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:30.067354 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:30.067354 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:30.068713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:30.068713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:30.068713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:30.068713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:30.068713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:30.068713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:30.068713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:30.068713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:30.068713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:30.068713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:30.068713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:30.068713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:30.069440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:30.069440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:30.069440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:30.069440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:30.069440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:30.069440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:30.069440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:30.069440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:30.069440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:30.069440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:30.069440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:30.069440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:30.069440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:30.070089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:30.070089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:30.070341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:30.070341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:30.070341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:30.070341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:30.070341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:30.070341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:30.070341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:30.070341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:30.070341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:30.070341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:30.070341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:30.070341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:30.070341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:30.070341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:30.070341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:30.070341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:30.071185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:30.072177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:30.072177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:30.072177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:34.845162 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:34.846040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:34.846117 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:34.847403 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:34.881391 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:34.881783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.882599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:34.882599 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:34.882599 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:34.882599 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:34.882599 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:34.882599 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:34.882599 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.882599 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:34.883354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.883354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:34.883354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:34.883354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:34.883354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.883354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:34.883354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:34.883354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.883354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:34.883354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:34.883354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:34.883354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.884041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:34.884041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:34.884041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:34.884041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:34.884041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:34.884041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:34.884041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:34.884041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:34.884041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:34.884041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:34.884041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:34.884041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:34.884041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:34.884778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.884778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:34.884778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.884778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:34.884778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:34.884778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:34.884778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:34.884778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:34.884778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.884778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:34.884778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:34.884778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.884778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:34.884778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:34.884778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:34.885612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:34.886618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:34.886618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:34.886618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:34.886618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:34.886618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.886618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:34.956602 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:34.957145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:34.957233 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:34.958308 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:34.958708 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:34.958978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.959959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:34.959959 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:34.959959 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:34.959959 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:34.959959 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:34.959959 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:34.959959 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.959959 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:34.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:34.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:34.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:34.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:34.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:34.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:34.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:34.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:34.962133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.962834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:34.962834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:34.962834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:34.962834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:34.962834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:34.962834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:34.962834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:34.962834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:34.962834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:34.962834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:34.962834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:34.962834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:34.962834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:34.963527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.963527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:34.964682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.964682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:34.964682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:34.964682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:34.964682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:34.964682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:34.964682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.964682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:34.964682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:34.964682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.964682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:34.964682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:34.964682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.964682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:34.964682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:34.964682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:34.965565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:34.966544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:34.966544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.966544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:34.966544 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:34.966544 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:34.966544 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:34.966544 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:53:34.966934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:34.967279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.968139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:34.968139 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:34.968139 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:34.968139 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:34.968139 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:34.968139 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:34.968139 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.968139 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:34.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:34.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:34.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:34.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:34.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:34.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:34.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:34.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:34.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:34.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:34.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:34.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:34.970139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:34.970139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:34.970139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:34.970139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:34.970139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:34.970139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:34.970139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:34.970139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.970139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:34.970139 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:34.970773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.970773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:34.970773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:34.970773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:34.970773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.970773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:34.970773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:34.970773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:53:34.970773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:34.970773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:34.970773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.970773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:34.971128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:34.971128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:34.971128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.971128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:34.971128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:34.971128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:34.971128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:34.971128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:34.971128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:34.971128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:34.971128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:34.971128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:34.971128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:34.971128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:34.971530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:34.971530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:34.971530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.971530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:34.972086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.972086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:34.972086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:34.972086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:34.972086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:34.972086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:34.972086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.972086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:34.972086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:34.972086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.972086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:34.972086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:34.972086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.972086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:34.972086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:34.972086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:34.972540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:34.973015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:34.973015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:34.973015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:34.973015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:34.973015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:34.973015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.973015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:34.973015 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:34.973015 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:34.973015 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:34.973329 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:34.973629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.974180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:34.974180 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:34.974180 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:34.974180 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:34.974180 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:34.974180 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:34.974180 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.974180 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:34.975045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.975045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:34.975045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:34.975045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:34.975045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.975045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:34.975045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:34.975045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:34.975045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.975045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:34.975045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:34.975045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:34.975045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:34.975045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:34.975045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:34.975482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:34.975482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:34.975482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:34.975482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:34.975482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:34.975482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:34.975482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:34.975482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.975482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:34.976112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.976112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:34.976112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:34.976112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:34.976112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.976112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:34.976112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:34.976112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:34.976112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:34.976112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.976112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:34.976471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:34.976471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:34.976471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.976471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:34.976471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:34.976471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:34.976471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:34.976471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:34.976471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:34.976471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:34.976471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:34.976471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:34.976471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:34.976471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:34.976836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:34.976836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:34.976836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.976836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:34.977503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:34.977976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:34.978523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:34.978523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:34.978523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:34.978523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:35.065190 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:35.066506 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:35.066506 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:35.066506 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:35.067150 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:35.067695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:35.068049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:35.069044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:35.069044 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:35.069044 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:35.069044 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:35.069044 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:35.069044 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:35.069044 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:35.069044 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:35.070751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:35.070751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:35.070751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:35.070751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:35.070751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:35.070751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:35.070751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:35.070751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:35.070751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:35.070751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:35.070751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:35.070751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:35.071305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:35.071305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:35.071305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:35.071305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:35.071305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:35.071305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:35.071305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:35.071305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:35.071305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:35.071305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:35.071305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:35.071305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:35.071305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:35.071865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:35.071865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:35.072352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:35.072352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:35.072352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:35.072352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:35.072352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:35.072352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:35.072352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:35.072352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:35.072352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:35.072352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:35.072352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:35.072352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:35.072352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:35.072352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:35.072352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:35.072352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:35.073412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:35.074520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:35.074520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:35.074520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:39.845957 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:39.846512 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:39.846512 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:39.847839 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:39.885227 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:39.885638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.886528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:39.886528 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:39.886528 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:39.886528 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:39.886528 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:39.886528 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:39.886528 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.886528 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:39.887501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.887501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:39.887501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:39.887501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:39.887501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.887501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:39.887501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:39.887501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.887501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:39.887501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:39.887501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:39.887501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.888143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:39.888143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:39.888143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:39.888143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:39.888143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:39.888143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:39.888143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:39.888143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:39.888143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:39.888143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:39.888143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:39.888143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:39.888143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:39.888792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.888792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:39.888792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.888792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:39.888792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:39.888792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:39.888792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:39.888792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:39.888792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.888792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:39.888792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:39.888792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.888792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:39.888792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:39.888792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:39.889652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:39.890563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:39.890563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:39.890563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:39.890563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:39.890563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.890563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:39.957484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:39.957822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:39.958238 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:39.959179 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:39.959634 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:39.959867 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.960834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:39.960834 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:39.960834 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:39.960834 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:39.960834 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:39.960834 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:39.960834 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.960834 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:39.962383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.962383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:39.962383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:39.962383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:39.962383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.962383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:39.962383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:39.962383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.962383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:39.962383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:39.962383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:39.962383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.962934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:39.962934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:39.962934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:39.962934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:39.962934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:39.962934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:39.962934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:39.962934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:39.962934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:39.962934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:39.962934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:39.962934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:39.962934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:39.963519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.963519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:39.964094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.964094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:39.964094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:39.964094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:39.964094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:39.964094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:39.964094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.964094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:39.964094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:39.964094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.964094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:39.964094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:39.964094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.964094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:39.964094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:39.964094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:39.964828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:39.965738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:39.965738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.965738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:39.965738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:39.965738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:39.965993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:39.965993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:53:39.966493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:39.966849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.967529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:39.967529 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:39.967529 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:39.967529 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:39.967529 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:39.967529 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:39.967529 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.967529 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:39.968405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.968405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:39.968405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:39.968405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:39.968405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.968405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:39.968405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:39.968405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:39.968405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.968405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:39.968405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:39.968405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:39.968405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:39.968405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:39.968405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:39.968847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:39.968847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:39.968847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:39.968847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:39.968847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:39.968847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:39.968847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:39.968847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.968847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:39.969355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.969355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:39.969355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:39.969355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:39.969355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.969355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:39.969355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:39.969355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:53:39.969355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:39.969355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:39.969355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.969355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:39.969764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:39.969764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:39.969764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.969764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:39.969764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:39.969764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:39.969764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:39.969764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:39.969764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:39.969764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:39.969764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:39.969764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:39.969764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:39.969764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:39.970142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:39.970142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:39.970142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.970142 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:39.970815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.970815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:39.970815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:39.970815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:39.970815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:39.970815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:39.970815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.970815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:39.970815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:39.970815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.970815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:39.970815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:39.970815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.970815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:39.970815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:39.970815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:39.971243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:39.971739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:39.971739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:39.971739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:39.971739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:39.971739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:39.971739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.971739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:39.972360 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:39.972596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:39.972706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:39.972829 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:39.973186 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:39.973456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.973992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:39.973992 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:39.973992 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:39.973992 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:39.973992 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:39.973992 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:39.973992 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.973992 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:39.974749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.974749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:39.974749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:39.974749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:39.974749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.974749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:39.974749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:39.974749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:39.974749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.974749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:39.974749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:39.974749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:39.974749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:39.974749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:39.974749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:39.975178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:39.975178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:39.975178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:39.975178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:39.975178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:39.975178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:39.975178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:39.975178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.975178 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:39.975602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.975602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:39.975602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:39.975602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:39.975602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.975602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:39.975602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:39.975602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:39.975602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:39.975602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.975602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:39.975907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:39.975907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:39.975907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.975907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:39.975907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:39.975907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:39.975907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:39.975907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:39.975907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:39.975907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:39.975907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:39.975907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:39.975907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:39.975907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:39.976289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:39.976289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:39.976289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.976289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:39.976651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:39.977115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:39.977641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:39.977641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:39.977641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:39.977641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:40.065767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:40.066192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:40.066391 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:40.066754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:40.067626 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:40.067952 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:40.068211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:40.069156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:40.069156 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:40.069156 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:40.069156 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:40.069156 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:40.069156 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:40.069156 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:40.069156 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:40.070824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:40.070824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:40.070824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:40.070824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:40.070824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:40.070824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:40.070824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:40.070824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:40.070824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:40.070824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:40.070824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:40.070824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:40.071433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:40.071433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:40.071433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:40.071433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:40.071433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:40.071433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:40.071433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:40.071433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:40.071433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:40.071433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:40.071433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:40.071433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:40.071433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:40.071943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:40.071943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:40.072353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:40.072353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:40.072353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:40.072353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:40.072353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:40.072353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:40.072353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:40.072353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:40.072353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:40.072353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:40.072353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:40.072353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:40.072353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:40.072353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:40.072353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:40.072353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:40.072928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:40.073422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:40.073422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:40.073422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:44.846556 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:44.847509 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:44.847509 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:44.848972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:44.882609 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:44.883057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.883855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:44.883855 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:44.883855 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:44.883855 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:44.883855 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:44.883855 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:44.883855 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.883855 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:44.884608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.884608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:44.884608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:44.884608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:44.884608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.884608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:44.884608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:44.884608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.884608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:44.884608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:44.884608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:44.884608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.885467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:44.885467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:44.885467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:44.885467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:44.885467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:44.885467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:44.885467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:44.885467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:44.885467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:44.885467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:44.885467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:44.885467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:44.885467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:44.886341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.886341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:44.886341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.886341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:44.886341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:44.886341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:44.886341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:44.886341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:44.886341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.886341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:44.886341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:44.886341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.886341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:44.886341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:44.886341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:44.887240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:44.888153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:44.888153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:44.888153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:44.888153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:44.888153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.888153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:44.958155 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:44.958686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:44.958794 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:44.959707 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:44.960053 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:44.960296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.961161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:44.961161 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:44.961161 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:44.961161 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:44.961161 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:44.961161 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:44.961161 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.961161 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:44.962283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.962283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:44.962283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:44.962283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:44.962283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.962283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:44.962283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:44.962283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.962283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:44.962283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:44.962283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:44.962283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.962905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:44.962905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:44.962905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:44.962905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:44.962905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:44.962905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:44.962905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:44.962905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:44.962905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:44.962905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:44.962905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:44.962905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:44.962905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:44.963314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.963314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:44.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:44.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:44.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:44.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:44.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:44.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:44.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:44.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:44.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:44.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:44.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:44.963426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:44.963947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:44.964547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:44.964547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.964547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:44.965846 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:44.966335 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:44.966464 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:44.966666 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:53:44.967150 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:44.967509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.968498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:44.968498 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:44.968498 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:44.968498 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:44.968498 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:44.968498 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:44.968498 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.968498 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:44.970017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.970017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:44.970017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:44.970017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:44.970017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.970017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:44.970017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:44.970017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:44.970017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.970017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:44.970017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:44.970017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:44.970017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:44.970017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:44.970017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:44.970561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:44.970561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:44.970561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:44.970561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:44.970561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:44.970561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:44.970561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:44.970561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.970561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:44.971391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.971391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:44.971391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:44.971391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:44.971391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.971391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:44.971391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:44.971391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:53:44.971391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:44.971391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:44.971391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.971391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:44.971748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:44.971748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:44.971748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.971748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:44.971748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:44.971748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:44.971748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:44.971748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:44.971748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:44.971748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:44.971748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:44.971748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:44.971748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:44.971748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:44.972103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:44.972103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:44.972103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.972103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:44.972571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.972571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:44.972571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:44.972571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:44.972571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:44.972571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:44.972571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.972571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:44.972571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:44.972571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.972571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:44.972571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:44.972571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.972571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:44.972571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:44.972571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:44.973005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:44.973504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:44.973504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:44.973504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:44.973504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:44.973504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:44.973504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.973504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:44.973504 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:44.973504 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:44.973504 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:44.973793 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:44.973793 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:44.973988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.974585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:44.974585 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:44.974585 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:44.974585 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:44.974585 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:44.974585 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:44.974585 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.974585 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:44.975479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.975479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:44.975479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:44.975479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:44.975479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.975479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:44.975479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:44.975479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:44.975479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.975479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:44.975479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:44.975479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:44.975479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:44.975479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:44.975479 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:44.975900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:44.975900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:44.975900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:44.975900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:44.975900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:44.975900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:44.975900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:44.975900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.975900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:44.976511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.976511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:44.976511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:44.976511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:44.976511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.976511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:44.976511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:44.976511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:44.976511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:44.976511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.976511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:44.976850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:44.976850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:44.976850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.976850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:44.976850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:44.976850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:44.976850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:44.976850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:44.976850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:44.976850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:44.976850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:44.976850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:44.976850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:44.976850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:44.977187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:44.977187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:44.977187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.977187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:44.977561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:44.978035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:44.978641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:44.978641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:44.978641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:44.978641 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:45.066401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:45.067203 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:45.067317 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:45.067612 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:45.068173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:45.068463 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:45.068581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:45.069151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:45.069151 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:45.069151 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:45.069151 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:45.069151 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:45.069151 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:45.069151 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:45.069151 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:45.070629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:45.070629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:45.070629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:45.070629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:45.070629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:45.070629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:45.070629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:45.070629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:45.070629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:45.070629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:45.070629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:45.070629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:45.071229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:45.071229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:45.071229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:45.071229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:45.071229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:45.071229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:45.071229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:45.071229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:45.071229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:45.071229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:45.071229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:45.071229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:45.071229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:45.071792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:45.071792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:45.072188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:45.072188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:45.072188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:45.072188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:45.072188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:45.072188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:45.072188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:45.072188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:45.072188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:45.072188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:45.072188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:45.072188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:45.072188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:45.072188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:45.072188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:45.072188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:45.072917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:45.073793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:45.073793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:45.073793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:49.847158 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:49.848101 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:49.848101 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:49.849548 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:49.892840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:49.893314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.894233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:49.894233 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:49.894233 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:49.894233 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:49.894233 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:49.894233 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:49.894233 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.894233 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:49.895263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.046 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.895263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:49.895263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:49.895263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:49.895263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.895263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:49.895263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:49.895263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.895263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:49.895263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:49.895263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:49.895263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.895695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:49.895695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:49.895695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:49.895695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:49.895695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:49.895695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:49.895695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:49.895695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:49.895695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:49.895695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:49.895695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:49.895695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:49.895695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:49.896083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.896083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:49.896338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.896338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:49.896338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:49.896338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:49.896338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:49.896338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:49.896338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.896338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:49.896338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:49.896338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.896338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:49.896338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:49.896338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.896338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:49.896338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:49.896338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:49.897336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:49.898018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:49.898018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.898018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:49.958927 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:49.959570 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:49.959767 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:49.961025 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:49.961691 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:49.961910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.962964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:49.962964 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:49.962964 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:49.962964 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:49.962964 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:49.962964 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:49.962964 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.962964 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:49.964517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.964517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:49.964517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:49.964517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:49.964517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.964517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:49.964517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:49.964517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.964517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:49.964517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:49.964517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:49.964517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.965413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:49.965413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:49.965413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:49.965413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:49.965413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:49.965413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:49.965413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:49.965413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:49.965413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:49.965413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:49.965413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:49.965413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:49.965413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:49.965990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.965990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:49.966454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.966454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:49.966454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:49.966454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:49.966454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:49.966454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:49.966454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.966454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:49.966454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:49.966454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.966454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:49.966454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:49.966454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.966454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:49.966454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:49.966454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:49.967733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:49.969029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:49.969029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.969029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:49.969029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:49.969029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:49.969029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:49.969029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:53:49.969029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:49.969683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.969683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:49.969683 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:49.969683 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:49.969683 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:49.969683 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:49.969683 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:49.969683 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.969683 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:49.969986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.969986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:49.969986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:49.969986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:49.969986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.969986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:49.969986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:49.969986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:49.969986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.969986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:49.969986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:49.969986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:49.969986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:49.969986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:49.969986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:49.970482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:49.970482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:49.970482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:49.970482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:49.970482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:49.970482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:49.970482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:49.970482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.970482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:49.970482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.970482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:49.970482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:49.970482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:49.970482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.970957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:49.970957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:49.970957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:53:49.970957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:49.970957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:49.970957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.970957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:49.970957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:49.970957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:49.970957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.970957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:49.970957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:49.970957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:49.971345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:49.971345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:49.971345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:49.971345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:49.971345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:49.971345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:49.971345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:49.971345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:49.971345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:49.971345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:49.971345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.971345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:49.971995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.971995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:49.971995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:49.971995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:49.971995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:49.971995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:49.971995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.971995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:49.971995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:49.971995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.971995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:49.971995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:49.971995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.971995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:49.971995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:49.971995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:49.972536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:49.973766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:49.973766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:49.973766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:49.973766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:49.973766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:49.973766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.973766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:49.973766 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:49.973766 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:49.974732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:49.974732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:49.974732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:49.974732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.975286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:49.975286 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:49.975286 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:49.975286 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:49.975286 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:49.975286 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:49.975286 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.975286 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:49.975990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.975990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:49.975990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:49.975990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:49.975990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.975990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:49.975990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:49.975990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:49.975990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.975990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:49.975990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:49.975990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:49.975990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:49.975990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:49.975990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:49.976407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:49.976407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:49.976407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:49.976407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:49.976407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:49.976407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:49.976407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:49.976407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.976407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:49.976865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.976865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:49.976865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:49.976865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:49.976865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.976865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:49.976865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:49.976865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:49.976865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:49.976865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.976865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:49.977489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:49.977489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:49.977489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.977489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:49.977489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:49.977489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:49.977489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:49.977489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:49.977489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:49.977489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:49.977489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:49.977489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:49.977489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:49.977489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:49.977757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:49.977757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:49.977757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.977757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:49.978074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:49.978565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:49.978908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:49.978908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:49.978908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:49.978908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:50.067001 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:50.067695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:50.067893 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:50.068121 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:50.068624 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:50.068898 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:50.069088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:50.069806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:50.069806 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:50.069806 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:50.069806 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:50.069806 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:50.069806 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:50.069806 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:50.069806 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:50.071162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:50.071162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:50.071162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:50.071162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:50.071162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:50.071162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:50.071162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:50.071162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:50.071162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:50.071162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:50.071162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:50.071162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:50.071553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:50.071553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:50.071553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:50.071553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:50.071553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:50.071553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:50.071553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:50.071553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:50.071553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:50.071553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:50.071553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:50.071553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:50.071553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:50.071895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:50.071895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:50.072751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:50.072751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:50.072751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:50.072751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:50.072751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:50.072751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:50.072751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:50.072751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:50.072751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:50.072751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:50.072751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:50.072751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:50.072751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:50.072751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:50.072751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:50.072751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:50.073270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:50.073994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:50.073994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:50.073994 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:54.848016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:54.849364 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:54.850617 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:54.851938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:54.854265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:53:54.880402 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:54.880839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.881597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:54.881597 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:54.881597 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:54.881597 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:54.881597 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:54.881597 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:54.881597 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.881597 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:54.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.031 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:54.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:54.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:54.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:54.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:54.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:54.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:54.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:54.882241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.882782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:54.882782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:54.882782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:54.882782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:54.882782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:54.882782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:54.882782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:54.882782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:54.882782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:54.882782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:54.882782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:54.882782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:54.882782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:54.883186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.883186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:54.883186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.883186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:54.883186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:54.883186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:54.883186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:54.883186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:54.883186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.883186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:54.883186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:54.883186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.883186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:54.883186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:54.883186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:54.883767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:54.884387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:54.884387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:54.884387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:54.884387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:54.884387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.884387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:54.959590 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:54.960009 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:54.960269 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:54.961230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:54.961555 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:54.961783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.962660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:54.962660 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:54.962660 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:54.962660 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:54.962660 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:54.962660 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:54.962660 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.962660 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:54.964259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.964259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:54.964259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:54.964259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:54.964259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.964259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:54.964259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:54.964259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.964259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:54.964259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:54.964259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:54.964259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.964926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:54.964926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:54.964926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:54.964926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:54.964926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:54.964926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:54.964926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:54.964926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:54.964926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:54.964926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:54.964926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:54.964926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:54.964926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:54.965527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.965527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:54.966404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.966404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:54.966404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:54.966404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:54.966404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:54.966404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:54.966404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.966404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:54.966404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:54.966404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.966404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:54.966404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:54.966404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.966404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:54.966404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:54.966404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:54.967317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:54.968235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:54.968235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.968235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:54.968235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:54.968235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:54.968235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:54.968235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:53:54.968235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:54.968708 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.969273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:54.969273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:54.969273 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:54.969273 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:54.969273 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:54.969273 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:54.969273 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.969273 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:54.970301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.970301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:54.970301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:54.970301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:54.970301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.970301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:54.970301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:54.970301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:54.970301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.970301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:54.970301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:54.970301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:54.970301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:54.970301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:54.970301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:54.971112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:54.971112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:54.971112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:54.971112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:54.971112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:54.971112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:54.971112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:54.971112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.971112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:54.971583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.971583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:54.971583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:54.971583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:54.971583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.971583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:54.971583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:54.971583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:53:54.971583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:54.971583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:54.971583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.971583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:54.972143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:54.972143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:54.972143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.972143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:54.972143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:54.972143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:54.972143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:54.972143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:54.972143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:54.972143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:54.972143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:54.972143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:54.972143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:54.972143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:54.972837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:54.972837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:54.972837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.972837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:54.973033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.973033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:54.973033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:54.973033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:54.973033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:54.973033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:54.973033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.973033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:54.973033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:54.973033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.973033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:54.973033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:54.973033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.973033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:54.973033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:54.973033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:54.973919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:54.974765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:54.974765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:54.974765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:54.974765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:54.974765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:54.974765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.974765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:54.974765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:54.974765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:54.974765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:54.975597 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:54.975597 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:54.975597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.976115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:54.976115 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:54.976115 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:54.976115 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:54.976115 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:54.976115 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:54.976115 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.976115 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:54.977871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.977871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:54.977871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:54.977871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:54.977871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.977871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:54.977871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:54.977871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:54.977871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.977871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:54.977871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:54.977871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:54.977871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:54.977871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:54.977871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:54.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:54.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:54.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:54.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:54.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:54.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:54.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:54.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.978200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:54.978678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.978678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:54.978678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:54.978678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:54.978678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.978678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:54.978678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:54.978678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:54.978678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:54.978678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.978678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:54.978925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:54.978925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:54.978925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.978925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:54.978925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:54.978925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:54.978925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:54.978925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:54.978925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:54.978925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:54.978925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:54.978925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:54.978925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:54.978925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:54.979199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:54.979199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:54.979199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.979199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:54.979652 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:54.980082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:54.980556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:54.980556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:54.980556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:54.980556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:55.067935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:55.068396 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:55.068658 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:55.068977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:55.069704 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:55.070067 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:55.070290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:55.071208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:55.071208 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:55.071208 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:55.071208 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:55.071208 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:55.071208 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:55.071208 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:55.071208 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:55.072847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:55.072847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:55.072847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:55.072847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:55.072847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:55.072847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:55.072847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:55.072847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:55.072847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:55.072847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:55.072847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:55.072847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:55.073116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:55.073116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:55.073116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:55.073116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:55.073116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:55.073116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:55.073116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:55.073116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:55.073116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:55.073116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:55.073116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:55.073116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:55.073116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:55.073380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:55.073380 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:55.075811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:55.075811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:55.075811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:55.075811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:55.075811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:55.075811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:55.075811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:55.075811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:55.075811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:55.075811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:55.075811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:55.075811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:55.075811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:55.075811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:55.075811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:55.075811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:55.076126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:55.076495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:55.076495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:55.076495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:59.849591 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:59.850705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:59.850933 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:59.852288 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:59.888425 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:59.888937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.890103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:59.890103 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:59.890103 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:59.890103 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:59.890103 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:59.890103 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:59.890103 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.890103 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:59.891247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.891247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:59.891247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:59.891247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:59.891247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.891247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:59.891247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:59.891247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.891247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:59.891247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:59.891247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:59.891247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.892694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:59.892694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:59.892694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:59.892694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:59.892694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:59.892694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:59.892694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:59.892694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:59.892694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:59.892694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:59.892694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:59.892694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:59.892694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:59.894025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.894025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:59.894025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.894025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:59.894025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:59.894025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:59.894025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:59.894025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:59.894025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.894025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:59.894025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:59.894025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.894025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:59.894025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:59.894025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:59.895783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:59.899291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:59.899291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:59.899291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:59.899291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:59.899291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.899291 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:59.960581 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:59.961236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:59.961470 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:59.962894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:59.963294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:59.963700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.964938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:59.964938 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:59.964938 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:59.964938 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:59.964938 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:59.964938 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:59.964938 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.964938 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:59.966661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.966661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:59.966661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:59.966661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:59.966661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.966661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:59.966661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:59.966661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.966661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:59.966661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:59.966661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:59.966661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.967309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:59.967309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:59.967309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:59.967309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:59.967309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:59.967309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:59.967309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:59.967309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:59.967309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:59.967309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:59.967309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:59.967309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:59.967309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:59.968009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.968009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:59.968489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.968489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:59.968489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:59.968489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:59.968489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:59.968489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:59.968489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.968489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:59.968489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:59.968489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.968489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:59.968489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:59.968489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.968489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:59.968489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:59.968489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:59.969301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:59.970242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:59.970242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.970242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:59.970242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:59.970242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:59.970242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:59.970242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:53:59.970242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:59.970689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.970689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:59.970689 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:59.970689 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:59.970689 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:59.970689 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:59.970689 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:59.970689 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.970689 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:59.971703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.971703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:59.971703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:59.971703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:59.971703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.971703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:59.971703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:59.971703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:59.971703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.971703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:59.971703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:59.971703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:59.971703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:59.971703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:59.971703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:59.973329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:59.973329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:59.973329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:59.973329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:59.973329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:59.973329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:59.973329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:59.973329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.973329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:59.973329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.973329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:59.973329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:59.973329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:59.973329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.973758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:59.973758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:59.973758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:53:59.973758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:59.973758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:59.973758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.973758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:59.973758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:59.973758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:59.973758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.973758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:59.973758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:59.973758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:59.974110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:59.974110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:59.974110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:59.974110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:59.974110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:59.974110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:59.974110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:59.974110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:59.974110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:59.974110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:59.974110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.974110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:59.974478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.974478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:59.974478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:59.974478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:59.974478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:59.974478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:59.974478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.974478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:59.974478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:59.974478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.974478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:59.974478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:59.974478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.974478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:59.974478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:59.974478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:59.974948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:59.975466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:59.975466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:59.975466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:59.975466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:59.975466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:59.975466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.975466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:53:59.975466 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:53:59.975466 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:53:59.975466 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:53:59.975772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:53:59.975772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:53:59.975881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.976643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:53:59.976643 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:59.976643 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:53:59.976643 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:53:59.976643 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:59.976643 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:53:59.976643 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.976643 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:53:59.977392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.977392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:53:59.977392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:59.977392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:59.977392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.977392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:59.977392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:59.977392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:59.977392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.977392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:53:59.977392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:59.977392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:53:59.977392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:59.977392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:53:59.977392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:53:59.977831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:59.977831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:53:59.977831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:59.977831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:53:59.977831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:53:59.977831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:59.977831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:53:59.977831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.977831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:53:59.978258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.978258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:53:59.978258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:59.978258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:53:59.978258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.978258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:59.978258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:59.978258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:59.978258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:59.978258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.978258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:59.978604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:59.978604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:59.978604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.978604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:53:59.978604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:59.978604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:53:59.978604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:59.978604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:53:59.978604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:53:59.978604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:59.978604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:53:59.978604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:59.978604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:53:59.978604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:53:59.979088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:59.979088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:53:59.979088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.979088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:53:59.979306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:53:59.979874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:53:59.980441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:53:59.980441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:53:59.980441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:53:59.980441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:00.068870 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:00.069542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:00.069765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:00.070027 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:00.070922 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:00.071405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:00.071635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:00.072603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:00.072603 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:00.072603 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:00.072603 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:00.072603 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:00.072603 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:00.072603 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:00.072603 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:00.074668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:00.074668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:00.074668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:00.074668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:00.074668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:00.074668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:00.074668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:00.074668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:00.074668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:00.074668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:00.074668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:00.074668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:00.075377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:00.075377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:00.075377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:00.075377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:00.075377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:00.075377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:00.075377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:00.075377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:00.075377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:00.075377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:00.075377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:00.075377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:00.075377 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:00.076069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:00.076069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:00.076069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:00.076069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:00.076069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:00.076069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:00.076069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:00.076069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:00.076069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:00.076069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:00.076069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:00.076069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:00.076069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:00.076069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:00.076069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:00.076752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:00.077600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:00.077600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:00.077600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:00.077600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:00.077600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:00.077600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:04.850324 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:04.851646 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:04.851646 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:04.852835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:04.880854 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:04.881133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.881692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:04.881692 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:04.881692 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:04.881692 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:04.881692 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:04.881692 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:04.881692 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.881692 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:04.882364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.030 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.882364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:04.882364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:04.882364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:04.882364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.882364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:04.882364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:04.882364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.882364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:04.882364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:04.882364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:04.882364 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.882808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:04.882808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:04.882808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:04.882808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:04.882808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:04.882808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:04.882808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:04.882808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:04.882808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:04.882808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:04.882808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:04.882808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:04.882808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:04.883219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.883219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:04.883219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.883219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:04.883219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:04.883219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:04.883219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:04.883219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:04.883219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.883219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:04.883219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:04.883219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.883219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:04.883219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:04.883219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:04.883717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:04.884277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:04.884277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:04.884277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:04.884277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:04.884277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.884277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:04.961182 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:04.961812 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:04.962090 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:04.962926 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:04.963109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:04.963295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.963937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:04.963937 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:04.963937 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:04.963937 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:04.963937 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:04.963937 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:04.963937 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.963937 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:04.965430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.965430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:04.965430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:04.965430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:04.965430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.965430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:04.965430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:04.965430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.965430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:04.965430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:04.965430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:04.965430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.965825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:04.965825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:04.965825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:04.965825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:04.965825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:04.965825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:04.965825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:04.965825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:04.965825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:04.965825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:04.965825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:04.965825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:04.965825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:04.966229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.966229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:04.967258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.967258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:04.967258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:04.967258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:04.967258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:04.967258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:04.967258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.967258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:04.967258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:04.967258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.967258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:04.967258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:04.967258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.967258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:04.967258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:04.967258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:04.967792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:04.968582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:04.968582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.968582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:04.969310 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:04.969756 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:04.970039 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:04.970314 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:54:04.970654 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:04.970848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.971305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:04.971305 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:04.971305 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:04.971305 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:04.971305 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:04.971305 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:04.971305 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.971305 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:04.972055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.972055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:04.972055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:04.972055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:04.972055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.972055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:04.972055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:04.972055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:04.972055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.972055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:04.972055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:04.972055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:04.972055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:04.972055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:04.972055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:04.972880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:04.972880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:04.972880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:04.972880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:04.972880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:04.972880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:04.972880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:04.972880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.972880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:04.972880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.972880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:04.972880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:04.972880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:04.972880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.973638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:04.973638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:04.973638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:54:04.973638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:04.973638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:04.973638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.973638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:04.973638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:04.973638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:04.973638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.973638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:04.973638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:04.973638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:04.974622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:04.974622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:04.974622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:04.974622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:04.974622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:04.974622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:04.974622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:04.974622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:04.974622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:04.974622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:04.974622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.974622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:04.974926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.974926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:04.974926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:04.974926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:04.974926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:04.974926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:04.974926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.974926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:04.974926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:04.974926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.974926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:04.974926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:04.974926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.974926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:04.974926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:04.974926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:04.975355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:04.975998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:04.975998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:04.975998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:04.975998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:04.975998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:04.975998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.975998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:04.975998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:04.975998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:04.975998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:04.976306 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:04.976306 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:04.976306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.976306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:04.976306 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:04.976306 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:04.976306 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:04.976306 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:04.976306 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:04.976306 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.976306 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:04.976892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.976892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:04.976892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:04.976892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:04.976892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.976892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:04.976892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:04.976892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:04.976892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.976892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:04.976892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:04.976892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:04.976892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:04.976892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:04.976892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:04.977327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:04.977327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:04.977327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:04.977327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:04.977327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:04.977327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:04.977327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:04.977327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.977327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:04.978669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.978669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:04.978669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:04.978669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:04.978669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.978669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:04.978669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:04.978669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:04.978669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:04.978669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.978669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:04.979027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:04.979027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:04.979027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.979027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:04.979027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:04.979027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:04.979027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:04.979027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:04.979027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:04.979027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:04.979027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:04.979027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:04.979027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:04.979027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:04.979446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:04.979446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:04.979446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.979446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:04.980121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:04.980770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:04.981332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:04.981332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:04.981332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:04.981332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:05.069491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:05.070044 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:05.070253 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:05.070686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:05.071351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:05.071645 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:05.071797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:05.072543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:05.072543 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:05.072543 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:05.072543 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:05.072543 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:05.072543 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:05.072543 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:05.072543 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:05.074263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:05.074263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:05.074263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:05.074263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:05.074263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:05.074263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:05.074263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:05.074263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:05.074263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:05.074263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:05.074263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:05.074263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:05.074944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:05.074944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:05.074944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:05.074944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:05.074944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:05.074944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:05.074944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:05.074944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:05.074944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:05.074944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:05.074944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:05.074944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:05.074944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:05.075580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:05.075580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:05.075872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:05.075872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:05.075872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:05.075872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:05.075872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:05.075872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:05.075872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:05.075872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:05.075872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:05.075872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:05.075872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:05.075872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:05.075872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:05.075872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:05.075872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:05.075872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:05.076655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:05.077565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:05.077565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:05.077565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:09.851238 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:09.852165 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:09.852165 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:09.853453 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:09.886814 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:09.887136 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.887841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:09.887841 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:09.887841 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:09.887841 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:09.887841 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:09.887841 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:09.887841 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.887841 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:09.888544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.888544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:09.888544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:09.888544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:09.888544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.888544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:09.888544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:09.888544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.888544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:09.888544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:09.888544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:09.888544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.889224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:09.889224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:09.889224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:09.889224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:09.889224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:09.889224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:09.889224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:09.889224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:09.889224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:09.889224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:09.889224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:09.889224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:09.889224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:09.889914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.889914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:09.889914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.889914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:09.889914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:09.889914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:09.889914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:09.889914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:09.889914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.889914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:09.889914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:09.889914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.889914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:09.889914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:09.889914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:09.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:09.891979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:09.891979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:09.891979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:09.891979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:09.891979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.891979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:09.962004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:09.962580 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:09.962774 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:09.963727 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:09.964045 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:09.964303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.965180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:09.965180 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:09.965180 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:09.965180 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:09.965180 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:09.965180 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:09.965180 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.965180 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:09.966653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.966653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:09.966653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:09.966653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:09.966653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.966653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:09.966653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:09.966653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.966653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:09.966653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:09.966653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:09.966653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.967204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:09.967204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:09.967204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:09.967204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:09.967204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:09.967204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:09.967204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:09.967204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:09.967204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:09.967204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:09.967204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:09.967204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:09.967204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:09.967908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.967908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:09.968279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.968279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:09.968279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:09.968279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:09.968279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:09.968279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:09.968279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.968279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:09.968279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:09.968279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.968279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:09.968279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:09.968279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.968279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:09.968279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:09.968279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:09.969017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:09.969918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:09.969918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.969918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:09.970201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:09.970512 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:09.970626 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:09.970738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:54:09.971631 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:09.971937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.972568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:09.972568 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:09.972568 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:09.972568 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:09.972568 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:09.972568 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:09.972568 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.972568 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:09.973354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.973354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:09.973354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:09.973354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:09.973354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.973354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:09.973354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:09.973354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:09.973354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.973354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:09.973354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:09.973354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:09.973354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:09.973354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:09.973354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:09.973947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:09.973947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:09.973947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:09.973947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:09.973947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:09.973947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:09.973947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:09.973947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.973947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:09.974424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.974424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:09.974424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:09.974424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:09.974424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.974424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:09.974424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:09.974424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:54:09.974424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:09.974424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:09.974424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.974424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:09.974814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:09.974814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:09.974814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.974814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:09.974814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:09.974814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:09.974814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:09.974814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:09.974814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:09.974814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:09.974814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:09.974814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:09.974814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:09.974814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:09.975182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:09.975182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:09.975182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.975182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:09.975594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.975594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:09.975594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:09.975594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:09.975594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:09.975594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:09.975594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.975594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:09.975594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:09.975594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.975594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:09.975594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:09.975594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.975594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:09.975594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:09.975594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:09.976047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:09.976593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:09.976593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:09.976593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:09.976593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:09.976593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:09.976593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.976593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:09.976593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:09.976593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:09.976593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:09.976917 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:09.976917 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:09.977068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.977864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:09.977864 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:09.977864 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:09.977864 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:09.977864 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:09.977864 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:09.977864 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.977864 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:09.978494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.978494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:09.978494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:09.978494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:09.978494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.978494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:09.978494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:09.978494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:09.978494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.978494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:09.978494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:09.978494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:09.978494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:09.978494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:09.978494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:09.978933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:09.978933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:09.978933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:09.978933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:09.978933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:09.978933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:09.978933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:09.978933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.978933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:09.979647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.979647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:09.979647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:09.979647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:09.979647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.979647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:09.979647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:09.979647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:09.979647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:09.979647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.979647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:09.980008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:09.980008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:09.980008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.980008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:09.980008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:09.980008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:09.980008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:09.980008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:09.980008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:09.980008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:09.980008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:09.980008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:09.980008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:09.980008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:09.980542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:09.980542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:09.980542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.980542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:09.980542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.980542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:09.980542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:09.980542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:09.980542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:09.980542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:09.980542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.980542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:09.980542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:09.980542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:09.981057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:09.981675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:09.981675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:09.981675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:09.981675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:09.981675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:09.981675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:09.981675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:09.981675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:09.981675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:09.981675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:09.981675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:10.070173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:10.070728 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:10.070918 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:10.071188 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:10.071741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:10.072107 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:10.072334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:10.073143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:10.073143 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:10.073143 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:10.073143 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:10.073143 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:10.073143 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:10.073143 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:10.073143 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:10.074599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:10.074599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:10.074599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:10.074599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:10.074599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:10.074599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:10.074599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:10.074599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:10.074599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:10.074599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:10.074599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:10.074599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:10.075494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:10.075494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:10.075494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:10.075494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:10.075494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:10.075494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:10.075494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:10.075494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:10.075494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:10.075494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:10.075494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:10.075494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:10.075494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:10.076254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:10.076254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:10.076427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:10.076427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:10.076427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:10.076427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:10.076427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:10.076427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:10.076427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:10.076427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:10.076427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:10.076427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:10.076427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:10.076427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:10.076427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:10.076427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:10.076427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:10.076427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:10.077326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:10.078551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:10.078551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:10.078551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:14.851794 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:14.852814 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:14.852814 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:14.853961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:14.890475 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:14.890803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.891573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:14.891573 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:14.891573 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:14.891573 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:14.891573 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:14.891573 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:14.891573 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.891573 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:14.892195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.892195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:14.892195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:14.892195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:14.892195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.892195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:14.892195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:14.892195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.892195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:14.892195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:14.892195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:14.892195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.893234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:14.893234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:14.893234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:14.893234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:14.893234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:14.893234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:14.893234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:14.893234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:14.893234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:14.893234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:14.893234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:14.893234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:14.893234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:14.893947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.893947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:14.893947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.893947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:14.893947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:14.893947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:14.893947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:14.893947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:14.893947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.893947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:14.893947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:14.893947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.893947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:14.893947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:14.893947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:14.894727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:14.895665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:14.895665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:14.895665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:14.895665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:14.895665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.895665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:14.962695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:14.963132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:14.963338 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:14.964166 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:14.964473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:14.964705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.965700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:14.965700 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:14.965700 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:14.965700 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:14.965700 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:14.965700 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:14.965700 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.965700 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:14.967649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.967649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:14.967649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:14.967649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:14.967649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.967649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:14.967649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:14.967649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.967649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:14.967649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:14.967649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:14.967649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.968033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:14.968033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:14.968033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:14.968033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:14.968033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:14.968033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:14.968033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:14.968033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:14.968033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:14.968033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:14.968033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:14.968033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:14.968033 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:14.968412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.968412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:14.969269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.969269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:14.969269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:14.969269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:14.969269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:14.969269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:14.969269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.969269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:14.969269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:14.969269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.969269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:14.969269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:14.969269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.969269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:14.969269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:14.969269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:14.970233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:14.970775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:14.970775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.970775 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:14.970775 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:14.971248 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:14.971507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:14.971601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:54:14.972404 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:14.972618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.973357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:14.973357 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:14.973357 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:14.973357 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:14.973357 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:14.973357 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:14.973357 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.973357 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:14.974603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.974603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:14.974603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:14.974603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:14.974603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.974603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:14.974603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:14.974603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:14.974603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.974603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:14.974603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:14.974603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:14.974603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:14.974603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:14.974603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:14.975079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:14.975079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:14.975079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:14.975079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:14.975079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:14.975079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:14.975079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:14.975079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.975079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:14.976055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.976055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:14.976055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:14.976055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:14.976055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.976055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:14.976055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:14.976055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:54:14.976055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:14.976055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:14.976055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.976055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:14.976442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:14.976442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:14.976442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.976442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:14.976442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:14.976442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:14.976442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:14.976442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:14.976442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:14.976442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:14.976442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:14.976442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:14.976442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:14.976442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:14.976814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:14.976814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:14.976814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.976814 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:14.976814 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:14.977664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.977664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:14.977664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:14.977664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:14.977664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:14.977664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:14.977664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.977664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:14.977664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:14.977664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.977664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:14.977664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:14.977664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.977664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:14.977664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:14.977664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:14.978157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:14.978661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:14.978661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:14.978661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:14.978661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:14.978661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:14.978661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.978661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:14.978661 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:14.978661 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:14.978661 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:14.978983 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:14.978983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.979203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:14.979203 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:14.979203 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:14.979203 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:14.979203 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:14.979203 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:14.979203 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.979203 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:14.979897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.979897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:14.979897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:14.979897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:14.979897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.979897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:14.979897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:14.979897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:14.979897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.979897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:14.979897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:14.979897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:14.979897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:14.979897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:14.979897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:14.980318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:14.980318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:14.980318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:14.980318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:14.980318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:14.980318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:14.980318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:14.980318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.980318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:14.980761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.980761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:14.980761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:14.980761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:14.980761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.980761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:14.980761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:14.980761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:14.980761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:14.980761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.980761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:14.981115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:14.981115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:14.981115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.981115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:14.981115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:14.981115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:14.981115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:14.981115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:14.981115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:14.981115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:14.981115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:14.981115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:14.981115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:14.981115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:14.981491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:14.981491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:14.981491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.981491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:14.981821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:14.982297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:14.982827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:14.982827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:14.982827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:14.982827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:15.070867 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:15.071508 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:15.071714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:15.072010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:15.072637 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:15.073038 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:15.073337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:15.074247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:15.074247 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:15.074247 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:15.074247 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:15.074247 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:15.074247 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:15.074247 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:15.074247 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:15.075476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:15.075476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:15.075476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:15.075476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:15.075476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:15.075476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:15.075476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:15.075476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:15.075476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:15.075476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:15.075476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:15.075476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:15.076055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:15.076055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:15.076055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:15.076055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:15.076055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:15.076055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:15.076055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:15.076055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:15.076055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:15.076055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:15.076055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:15.076055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:15.076055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:15.076692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:15.076692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:15.076692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:15.076692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:15.076692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:15.076692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:15.076692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:15.076692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:15.076692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:15.076692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:15.076692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:15.076692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:15.076692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:15.076692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:15.076692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:15.077461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:15.078279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:15.078279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:15.078279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:15.078279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:15.078279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:15.078279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:19.852405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:19.853191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:19.853191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:19.854544 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:19.880447 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:19.880833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.881625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:19.881625 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:19.881625 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:19.881625 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:19.881625 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:19.881625 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:19.881625 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.881625 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:19.882400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.028 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.882400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:19.882400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:19.882400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:19.882400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.882400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:19.882400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:19.882400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.882400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:19.882400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:19.882400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:19.882400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.882950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:19.882950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:19.882950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:19.882950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:19.882950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:19.882950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:19.882950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:19.882950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:19.882950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:19.882950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:19.882950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:19.882950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:19.882950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:19.883482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.883482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:19.883482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.883482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:19.883482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:19.883482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:19.883482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:19.883482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:19.883482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.883482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:19.883482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:19.883482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.883482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:19.883482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:19.883482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:19.884288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:19.886006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:19.886006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:19.886006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:19.886006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:19.886006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.886006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:19.963332 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:19.963966 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:19.964166 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:19.965720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:19.966132 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:19.966527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.967671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:19.967671 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:19.967671 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:19.967671 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:19.967671 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:19.967671 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:19.967671 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.967671 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:19.969411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.969411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:19.969411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:19.969411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:19.969411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.969411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:19.969411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:19.969411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.969411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:19.969411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:19.969411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:19.969411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.970063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:19.970063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:19.970063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:19.970063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:19.970063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:19.970063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:19.970063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:19.970063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:19.970063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:19.970063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:19.970063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:19.970063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:19.970063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:19.970688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.970688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:19.971320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.971320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:19.971320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:19.971320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:19.971320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:19.971320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:19.971320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.971320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:19.971320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:19.971320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.971320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:19.971320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:19.971320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.971320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:19.971320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:19.971320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:19.973073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:19.974892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:19.974892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.974892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:19.974892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:19.974892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:19.974892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:19.974892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:54:19.974892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:19.975149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:19.976147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.976147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:19.976147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:19.976147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:19.976147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:19.976147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:19.976147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:19.976147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:19.976147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:19.976147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:19.976147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:19.976147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:19.976147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:19.976147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:19.976147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.976147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:19.976743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.976743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:19.976743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:19.976743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:19.976743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.976743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:19.976743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:19.976743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:54:19.976743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:19.976743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:19.976743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.976743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:19.977046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:19.977046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:19.977046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.977046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:19.977046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:19.977046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:19.977046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:19.977046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:19.977046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:19.977046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:19.977046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:19.977046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:19.977046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:19.977046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:19.977458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:19.977458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:19.977458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.977458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:19.977458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.977458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:19.977458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:19.977458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:19.977458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:19.977458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:19.977458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.977458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:19.977458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:19.977458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:19.977817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:19.978348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:19.978348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:19.978348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:19.978348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:19.978348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:19.978348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:19.978348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:19.978348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:19.978348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:19.978348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:19.978348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.978348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:19.978348 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:19.978348 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:19.978880 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:19.978880 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:19.979549 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:19.979890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.980753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:19.980753 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:19.980753 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:19.980753 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:19.980753 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:19.980753 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:19.980753 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.980753 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:19.981551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.981551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:19.981551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:19.981551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:19.981551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.981551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:19.981551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:19.981551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:19.981551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.981551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:19.981551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:19.981551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:19.981551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:19.981551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:19.981551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:19.982431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:19.982431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:19.982431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:19.982431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:19.982431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:19.982431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:19.982431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:19.982431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.982431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:19.982903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.982903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:19.982903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:19.982903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:19.982903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.982903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:19.982903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:19.982903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:19.982903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:19.982903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.982903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:19.983442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:19.983442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:19.983442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.983442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:19.983442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:19.983442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:19.983442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:19.983442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:19.983442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:19.983442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:19.983442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:19.983442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:19.983442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:19.983442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:19.983966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:19.983966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:19.983966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.983966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:19.983966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.983966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:19.983966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:19.983966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:19.983966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:19.983966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:19.983966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.983966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:19.983966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:19.983966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:19.984525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:19.985267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:19.985267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:19.985267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:19.985267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:19.985267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:19.985267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:19.985267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:19.985267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:19.985267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:19.985267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:19.985267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:20.071665 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:20.072075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:20.072157 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:20.072388 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:20.073013 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:20.073299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:20.073459 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:20.074097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:20.074097 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:20.074097 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:20.074097 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:20.074097 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:20.074097 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:20.074097 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:20.074097 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:20.075075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:20.075075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:20.075075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:20.075075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:20.075075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:20.075075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:20.075075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:20.075075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:20.075075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:20.075075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:20.075075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:20.075075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:20.075654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:20.075654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:20.075654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:20.075654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:20.075654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:20.075654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:20.075654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:20.075654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:20.075654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:20.075654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:20.075654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:20.075654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:20.075654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:20.076161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:20.076161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:20.076161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:20.076161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:20.076161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:20.076161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:20.076161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:20.076161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:20.076161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:20.076161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:20.076161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:20.076161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:20.076161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:20.076161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:20.076161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:20.076811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:20.077547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:20.077547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:20.077547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:20.077547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:20.077547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:20.077547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:24.853280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:24.854439 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:24.854712 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:24.856191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:24.897198 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:24.897679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.898633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:24.898633 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:24.898633 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:24.898633 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:24.898633 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:24.898633 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:24.898633 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.898633 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:24.899813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.044 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.899813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:24.899813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:24.899813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:24.899813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.899813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:24.899813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:24.899813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.899813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:24.899813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:24.899813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:24.899813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.900353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:24.900353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:24.900353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:24.900353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:24.900353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:24.900353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:24.900353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:24.900353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:24.900353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:24.900353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:24.900353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:24.900353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:24.900353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:24.901011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.901011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:24.901491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.901491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:24.901491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:24.901491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:24.901491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:24.901491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:24.901491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.901491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:24.901491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:24.901491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.901491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:24.901491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:24.901491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.901491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:24.901491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:24.901491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:24.902674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:24.903967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:24.903967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.903967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:24.964057 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:24.964578 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:24.964676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:24.965386 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:24.965585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:24.965748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.966334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:24.966334 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:24.966334 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:24.966334 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:24.966334 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:24.966334 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:24.966334 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.966334 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:24.967356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.967356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:24.967356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:24.967356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:24.967356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.967356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:24.967356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:24.967356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.967356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:24.967356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:24.967356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:24.967356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.967986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:24.967986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:24.967986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:24.967986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:24.967986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:24.967986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:24.967986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:24.967986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:24.967986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:24.967986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:24.967986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:24.967986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:24.967986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:24.968611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.968611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:24.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:24.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:24.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:24.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:24.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:24.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:24.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:24.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:24.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:24.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:24.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:24.969203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:24.970761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:24.971963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:24.971963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.971963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:24.972458 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:24.972623 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:24.972819 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:24.973013 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:54:24.973522 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:24.973817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.974805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:24.974805 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:24.974805 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:24.974805 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:24.974805 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:24.974805 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:24.974805 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.974805 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:24.976189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.976189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:24.976189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:24.976189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:24.976189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.976189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:24.976189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:24.976189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:24.976189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.976189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:24.976189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:24.976189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:24.976189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:24.976189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:24.976189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:24.976691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:24.976691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:24.976691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:24.976691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:24.976691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:24.976691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:24.976691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:24.976691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.976691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:24.977861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.977861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:24.977861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:24.977861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:24.977861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.977861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:24.977861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:24.977861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:54:24.977861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:24.977861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:24.977861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.977861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:24.978321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:24.978321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:24.978321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.978321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:24.978321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:24.978321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:24.978321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:24.978321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:24.978321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:24.978321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:24.978321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:24.978321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:24.978321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:24.978321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:24.978974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:24.978974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:24.978974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.978974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:24.979980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.979980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:24.979980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:24.979980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:24.979980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:24.979980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:24.979980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.979980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:24.979980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:24.979980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.979980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:24.979980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:24.979980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.979980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:24.979980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:24.979980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:24.980508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:24.980982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:24.980982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:24.980982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:24.980982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:24.980982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:24.980982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.980982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:24.980982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:24.980982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:24.980982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:24.981257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:24.981569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:24.981974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.982888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:24.982888 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:24.982888 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:24.982888 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:24.982888 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:24.982888 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:24.982888 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.982888 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:24.983818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.983818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:24.983818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:24.983818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:24.983818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.983818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:24.983818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:24.983818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:24.983818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.983818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:24.983818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:24.983818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:24.983818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:24.983818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:24.983818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:24.984529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:24.984529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:24.984529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:24.984529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:24.984529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:24.984529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:24.984529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:24.984529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.984529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:24.984772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.984772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:24.984772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:24.984772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:24.984772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.984772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:24.984772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:24.984772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:24.984772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:24.984772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.984772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:24.985094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:24.985094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:24.985094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.985094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:24.985094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:24.985094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:24.985094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:24.985094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:24.985094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:24.985094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:24.985094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:24.985094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:24.985094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:24.985094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:24.985508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:24.985508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:24.985508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.985508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:24.986084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:24.986702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:24.987203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:24.987203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:24.987203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:24.987203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:25.072316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:25.072882 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:25.073076 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:25.073360 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:25.074164 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:25.074665 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:25.074905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:25.075798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:25.075798 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:25.075798 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:25.075798 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:25.075798 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:25.075798 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:25.075798 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:25.075798 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:25.077310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:25.077310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:25.077310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:25.077310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:25.077310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:25.077310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:25.077310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:25.077310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:25.077310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:25.077310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:25.077310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:25.077310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:25.078006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:25.078006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:25.078006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:25.078006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:25.078006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:25.078006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:25.078006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:25.078006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:25.078006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:25.078006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:25.078006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:25.078006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:25.078006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:25.078669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:25.078669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:25.079293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:25.079293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:25.079293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:25.079293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:25.079293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:25.079293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:25.079293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:25.079293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:25.079293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:25.079293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:25.079293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:25.079293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:25.079293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:25.079293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:25.079293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:25.079293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:25.080289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:25.081468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:25.081468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:25.081468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:29.854268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:29.855088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:29.855235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:29.856006 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:29.888668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:29.889189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.890266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:29.890266 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:29.890266 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:29.890266 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:29.890266 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:29.890266 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:29.890266 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.890266 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:29.891352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.891352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:29.891352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:29.891352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:29.891352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.891352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:29.891352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:29.891352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.891352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:29.891352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:29.891352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:29.891352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.891712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:29.891712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:29.891712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:29.891712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:29.891712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:29.891712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:29.891712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:29.891712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:29.891712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:29.891712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:29.891712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:29.891712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:29.891712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:29.892084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.892084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:29.892569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.892569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:29.892569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:29.892569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:29.892569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:29.892569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:29.892569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.892569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:29.892569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:29.892569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.892569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:29.892569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:29.892569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.892569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:29.892569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:29.892569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:29.893007 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:29.893531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:29.893531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.893531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:29.964821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:29.965183 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:29.965392 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:29.966124 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:29.966519 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:29.966810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.967800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:29.967800 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:29.967800 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:29.967800 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:29.967800 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:29.967800 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:29.967800 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.967800 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:29.969719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.969719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:29.969719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:29.969719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:29.969719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.969719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:29.969719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:29.969719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.969719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:29.969719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:29.969719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:29.969719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.970008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:29.970008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:29.970008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:29.970008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:29.970008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:29.970008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:29.970008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:29.970008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:29.970008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:29.970008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:29.970008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:29.970008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:29.970008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:29.970367 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.970367 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:29.971777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.971777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:29.971777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:29.971777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:29.971777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:29.971777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:29.971777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.971777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:29.971777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:29.971777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.971777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:29.971777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:29.971777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.971777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:29.971777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:29.971777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:29.972252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:29.972863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:29.972863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.972863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:29.972863 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:29.973055 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:29.973280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:29.973708 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:54:29.974066 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:29.974348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.974976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:29.974976 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:29.974976 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:29.974976 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:29.974976 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:29.974976 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:29.974976 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.974976 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:29.976229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.976229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:29.976229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:29.976229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:29.976229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.976229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:29.976229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:29.976229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:29.976229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.976229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:29.976229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:29.976229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:29.976229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:29.976229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:29.976229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:29.976747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:29.976747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:29.976747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:29.976747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:29.976747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:29.976747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:29.976747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:29.976747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.976747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:29.977838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.977838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:29.977838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:29.977838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:29.977838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.977838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:29.977838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:29.977838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:54:29.977838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:29.977838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:29.977838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.977838 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:29.978231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:29.978231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:29.978231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.978231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:29.978231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:29.978231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:29.978231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:29.978231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:29.978231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:29.978231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:29.978231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:29.978231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:29.978231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:29.978231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:29.978770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:29.978770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:29.978770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.978770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:29.978995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.978995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:29.978995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:29.978995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:29.978995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:29.978995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:29.978995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.978995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:29.978995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:29.978995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.978995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:29.978995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:29.978995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.978995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:29.978995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:29.978995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:29.979758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:29.980265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:29.980265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:29.980265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:29.980265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:29.980265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:29.980265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.980265 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:29.980686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:29.980965 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:29.981064 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:29.981191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:29.981733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:29.981733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.982181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:29.982181 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:29.982181 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:29.982181 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:29.982181 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:29.982181 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:29.982181 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.982181 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:29.982879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.982879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:29.982879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:29.982879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:29.982879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.982879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:29.982879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:29.982879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:29.982879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.982879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:29.982879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:29.982879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:29.982879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:29.982879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:29.982879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:29.983285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:29.983285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:29.983285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:29.983285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:29.983285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:29.983285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:29.983285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:29.983285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.983285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:29.983751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.983751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:29.983751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:29.983751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:29.983751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.983751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:29.983751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:29.983751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:29.983751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:29.983751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.983751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:29.984194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:29.984194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:29.984194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.984194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:29.984194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:29.984194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:29.984194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:29.984194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:29.984194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:29.984194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:29.984194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:29.984194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:29.984194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:29.984194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:29.984745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:29.984745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:29.984745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.984745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:29.985092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:29.985748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:29.986458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:29.986458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:29.986458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:29.986458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:30.073093 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:30.073635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:30.073772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:30.073959 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:30.074394 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:30.074660 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:30.074857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:30.075521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:30.075521 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:30.075521 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:30.075521 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:30.075521 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:30.075521 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:30.075521 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:30.075521 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:30.076388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:30.076388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:30.076388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:30.076388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:30.076388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:30.076388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:30.076388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:30.076388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:30.076388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:30.076388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:30.076388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:30.076388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:30.077273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:30.077273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:30.077273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:30.077273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:30.077273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:30.077273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:30.077273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:30.077273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:30.077273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:30.077273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:30.077273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:30.077273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:30.077273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:30.077784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:30.077784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:30.077784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:30.077784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:30.077784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:30.077784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:30.077784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:30.077784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:30.077784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:30.077784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:30.077784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:30.077784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:30.077784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:30.077784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:30.077784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:30.078346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:30.079093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:30.079093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:30.079093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:30.079093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:30.079093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:30.079093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:34.855239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:34.856460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:34.856460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:34.858149 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:34.891604 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:34.891769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.892193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:34.892193 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:34.892193 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:34.892193 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:34.892193 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:34.892193 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:34.892193 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.892193 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:34.892869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.892869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:34.892869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:34.892869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:34.892869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.892869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:34.892869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:34.892869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.892869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:34.892869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:34.892869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:34.892869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.893324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:34.893324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:34.893324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:34.893324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:34.893324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:34.893324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:34.893324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:34.893324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:34.893324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:34.893324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:34.893324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:34.893324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:34.893324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:34.893778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.893778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:34.893778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.893778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:34.893778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:34.893778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:34.893778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:34.893778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:34.893778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.893778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:34.893778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:34.893778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.893778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:34.893778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:34.893778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:34.894285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:34.894949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:34.894949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:34.894949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:34.894949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:34.894949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.894949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:34.965473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:34.965852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:34.966008 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:34.967081 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:34.967551 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:34.967900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.968909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:34.968909 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:34.968909 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:34.968909 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:34.968909 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:34.968909 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:34.968909 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.968909 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:34.970519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.970519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:34.970519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:34.970519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:34.970519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.970519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:34.970519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:34.970519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.970519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:34.970519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:34.970519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:34.970519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.971054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:34.971054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:34.971054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:34.971054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:34.971054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:34.971054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:34.971054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:34.971054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:34.971054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:34.971054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:34.971054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:34.971054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:34.971054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:34.971750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.971750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:34.972600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.972600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:34.972600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:34.972600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:34.972600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:34.972600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:34.972600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.972600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:34.972600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:34.972600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.972600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:34.972600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:34.972600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.972600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:34.972600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:34.972600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:34.974706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:34.975801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:34.975801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.975801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:34.975801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:34.975801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:34.975801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:34.975801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:54:34.975801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:34.976192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:34.976759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.976759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:34.976759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:34.976759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:34.976759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:34.976759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:34.976759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:34.976759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:34.976759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:34.976759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:34.976759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:34.976759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:34.976759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:34.976759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:34.976759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.976759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:34.977215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.977215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:34.977215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:34.977215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:34.977215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.977215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:34.977215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:34.977215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:54:34.977215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:34.977215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:34.977215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.977215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:34.978241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:34.978241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:34.978241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.978241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:34.978241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:34.978241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:34.978241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:34.978241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:34.978241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:34.978241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:34.978241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:34.978241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:34.978241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:34.978241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:34.978938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:34.978938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:34.978938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.978938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:34.978938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.978938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:34.978938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:34.978938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:34.978938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:34.978938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:34.978938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.978938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:34.978938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:34.978938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:34.980018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:34.981326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:34.981326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:34.981326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:34.981326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:34.981326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:34.981326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:34.981326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:34.981326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:34.981326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:34.981326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:34.981326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.981326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:34.981326 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:34.981326 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:34.982401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:34.982401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:34.982401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:34.982401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.983048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:34.983048 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:34.983048 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:34.983048 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:34.983048 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:34.983048 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:34.983048 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.983048 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:34.983939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.983939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:34.983939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:34.983939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:34.983939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.983939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:34.983939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:34.983939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:34.983939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.983939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:34.983939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:34.983939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:34.983939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:34.983939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:34.983939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:34.984840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:34.984840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:34.984840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:34.984840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:34.984840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:34.984840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:34.984840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:34.984840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.984840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:34.984840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.984840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:34.984840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:34.984840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:34.984840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.985440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:34.985440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:34.985440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:34.985440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:34.985440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.985440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:34.985440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:34.985440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:34.985440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.985440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:34.985440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:34.985440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:34.985440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:34.985955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:34.985955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:34.985955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:34.985955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:34.985955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:34.985955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:34.985955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:34.985955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:34.985955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:34.985955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.985955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:34.987168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:34.988821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:34.990156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:34.990156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:34.990156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:34.990156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:35.074026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:35.074335 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:35.074456 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:35.074789 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:35.075458 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:35.075810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:35.076023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:35.076809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:35.076809 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:35.076809 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:35.076809 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:35.076809 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:35.076809 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:35.076809 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:35.076809 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:35.078244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:35.078244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:35.078244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:35.078244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:35.078244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:35.078244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:35.078244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:35.078244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:35.078244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:35.078244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:35.078244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:35.078244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:35.078863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:35.078863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:35.078863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:35.078863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:35.078863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:35.078863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:35.078863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:35.078863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:35.078863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:35.078863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:35.078863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:35.078863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:35.078863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:35.079491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:35.079491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:35.080023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:35.080023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:35.080023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:35.080023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:35.080023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:35.080023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:35.080023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:35.080023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:35.080023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:35.080023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:35.080023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:35.080023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:35.080023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:35.080023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:35.080023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:35.080023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:35.080756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:35.081746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:35.081746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:35.081746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:39.856189 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:39.857073 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:39.857073 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:39.858931 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:40.052594 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:40.057915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:40.059121 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:40.074956 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:40.078642 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:40.078971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.079968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:40.079968 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.079968 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:40.079968 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.079968 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.079968 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:40.079968 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.079968 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:40.080843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.223 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.080843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:40.080843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:40.080843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:40.080843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.080843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:40.080843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:40.080843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.080843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:40.080843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:40.080843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:40.080843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.081572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:40.081572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:40.081572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:40.081572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:40.081572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:40.081572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:40.081572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:40.081572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:40.081572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.081572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:40.081572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.081572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.081572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:40.081908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.081908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:40.081908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.081908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:40.081908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:40.081908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:40.081908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:40.081908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:40.081908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.081908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:40.081908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:40.081908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.081908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:40.081908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:40.081908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:40.082298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.082802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:40.082802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.082802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.082802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:40.082802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.082802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:40.082802 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:40.082802 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:40.082802 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:40.082802 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:40.083072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.083072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:40.083072 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.083072 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:40.083072 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.083072 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.083072 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:40.083072 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.083072 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:40.084018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.084018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:40.084018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:40.084018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:40.084018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.084018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:40.084018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:40.084018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.084018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:40.084018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:40.084018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:40.084018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.084859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:40.084859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:40.084859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:40.084859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:40.084859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:40.084859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:40.084859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:40.084859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:40.084859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.084859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:40.084859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.084859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.084859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:40.085797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.085797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:40.085797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.085797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:40.085797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:40.085797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:40.085797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:40.085797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:40.085797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.085797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:40.085797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:40.085797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.085797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:40.085797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:40.085797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:40.087151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.088350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:40.088350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.088350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.088350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:40.088350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.088350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:40.088350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:40.088350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:40.088350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:54:40.088350 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:40.088727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:40.089182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.089182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:40.089182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:40.089182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:40.089182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:40.089182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:40.089182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:40.089182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:40.089182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:40.089182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.089182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:40.089182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.089182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.089182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:40.089182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.089182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:40.090161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.090161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:40.090161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:40.090161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:40.090161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.090161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:40.090161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:40.090161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:54:40.090161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:40.090161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:40.090161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.090161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:40.090754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:40.090754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:40.090754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.090754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:40.090754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:40.090754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:40.090754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:40.090754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:40.090754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:40.090754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:40.090754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:40.090754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.090754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:40.090754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.091198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.091198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:40.091198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.091198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:40.091198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.091198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:40.091198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:40.091198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:40.091198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:40.091198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:40.091198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.091198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:40.091198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:40.091198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:40.091512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:40.091832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:40.091832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:40.091832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:40.091832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:40.091832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:40.091832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.091832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:40.091832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.091832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.091832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:40.091832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.091832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:40.091832 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:40.091832 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:40.092089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:40.092089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:40.092089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.092089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:40.092089 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.092089 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:40.092089 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.092089 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.092089 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:40.092089 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.092089 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:40.092089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:40.092305 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.092626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:40.092626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.092626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.092626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:40.092626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.092626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:40.092626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.092626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:40.092626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:40.092626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:40.092626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.092626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:40.092626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:40.092865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:40.092865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:40.092865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.092865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:40.092865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:40.092865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:40.092865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.092865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:40.092865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:40.092865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:40.092865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:40.092865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:40.092865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:40.093101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:40.093101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:40.093101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.093101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:40.093101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.093101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.093101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:40.093101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.093101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:40.093101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.093101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:40.093101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.093337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.094915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:40.095705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:40.095705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:40.095705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:40.095705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:40.095705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:40.095705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.095993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:40.095993 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.095993 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:40.095993 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.095993 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.095993 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:40.095993 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.095993 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:40.095993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.095993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:40.095993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:40.095993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:40.095993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.095993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:40.095993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:40.096685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.096685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:40.096685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:40.096685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:40.096685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.096685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:40.096685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:40.096685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:40.096685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:40.096685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:40.096685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:40.096685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:40.096685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:40.096685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.097279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:40.097279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.097279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.097279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:40.097279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.097279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:40.097279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.097279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:40.097279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:40.097279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:40.097279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:40.097279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:40.097279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.097279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:40.098019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:40.098357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:40.098357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:40.098357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:40.098357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:40.098357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:40.098357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:40.098357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:40.098357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:40.098357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:40.098357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:44.857401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:44.857972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:44.858016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:44.859245 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:44.899174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:44.899597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:44.900537 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:44.900537 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:44.900537 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:44.900537 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:44.900537 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:44.900537 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:44.900537 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:44.900537 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:44.901800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:44.901800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:44.901800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:44.901800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:44.901800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:44.901800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:44.901800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:44.901800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:44.901800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:44.901800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:44.901800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:44.901800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:44.902355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:44.902355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:44.902355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:44.902355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:44.902355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:44.902355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:44.902355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:44.902355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:44.902355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:44.902355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:44.902355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:44.902355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:44.902355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:44.902921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:44.902921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:44.903023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:44.903023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:44.903023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:44.903023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:44.903023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:44.903023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:44.903023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:44.903023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:44.903023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:44.903023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:44.903023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:44.903023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:44.903023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:44.903023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:44.903023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:44.903023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:44.903618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:44.904250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:44.904250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:44.904250 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:45.081741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:45.082330 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:45.082566 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:45.083658 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:45.083994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:45.084208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.085064 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:45.085469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:45.085469 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:45.085469 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:45.085469 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:45.085469 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:45.085469 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:45.085469 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.085469 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:45.087074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.087074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:45.087074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:45.087074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:45.087074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.087074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:45.087074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:45.087074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.087074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:45.087074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:45.087074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:45.087074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.087809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:45.087809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:45.087809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:45.087809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:45.087809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:45.087809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:45.087809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:45.087809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:45.087809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:45.087809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:45.087809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:45.087809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:45.087809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:45.088466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.088466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:45.088583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.088583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:45.088583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:45.088583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:45.088583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:45.088583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:45.088583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.088583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:45.088583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:45.088583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.088583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:45.088583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:45.088583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.088583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:45.088583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:45.088583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:45.089336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:45.090243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:45.090243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.090243 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:45.090243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:45.090243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:45.090243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:54:45.090243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:45.090243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:45.090720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.090776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:45.090776 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:45.090776 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:45.090776 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:45.090776 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:45.090776 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:45.090776 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.090776 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:45.091626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.091626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:45.091626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:45.091626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:45.091626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.091626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:45.091626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:45.091626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:45.091626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.091626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:45.091626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:45.091626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:45.091626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:45.091626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:45.091626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:45.092093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:45.092093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:45.092093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:45.092093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:45.092093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:45.092093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:45.092093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:45.092093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.092093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:45.092526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.092526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:45.092526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:45.092526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:45.092526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.092526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:45.092526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:45.092526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:54:45.092526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:45.092526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:45.092526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.092526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:45.092887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:45.092887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:45.092887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.092887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:45.092887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:45.092887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:45.092887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:45.092887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:45.092887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:45.092887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:45.092887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:45.092887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:45.092887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:45.092887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:45.093228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:45.093228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:45.093228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.093228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:45.093668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.093668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:45.093668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:45.093668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:45.093668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:45.093668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:45.093668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.093668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:45.093668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:45.093668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.093668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:45.093668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:45.093668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.093668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:45.093668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:45.093668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:45.094074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:45.094534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:45.094534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:45.094534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:45.094534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:45.094534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:45.094534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.094534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:45.094534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:45.094534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:45.094534 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:45.094908 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:45.095008 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:45.095390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.096274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:45.096274 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:45.096274 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:45.096274 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:45.096274 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:45.096274 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:45.096274 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.096274 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:45.097087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.097087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:45.097087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:45.097087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:45.097087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.097087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:45.097087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:45.097087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:45.097087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.097087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:45.097087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:45.097087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:45.097087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:45.097087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:45.097087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:45.097560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:45.097560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:45.097560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:45.097560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:45.097560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:45.097560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:45.097560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:45.097560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.097560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:45.098055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.098055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:45.098055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:45.098055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:45.098055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.098055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:45.098055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:45.098055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:45.098055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:45.098055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.098055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:45.098410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:45.098410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:45.098410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.098410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:45.098410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:45.098410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:45.098410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:45.098410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:45.098410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:45.098410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:45.098410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:45.098410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:45.098410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:45.098410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:45.098794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:45.098794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:45.098794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.098794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.099331 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:45.099978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:45.100588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:45.100588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:45.100588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.100588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:45.100588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:45.100588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:45.100588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:45.100588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:45.100875 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:45.100875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.101590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:45.101590 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:45.101590 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:45.101590 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:45.101590 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:45.101590 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:45.101590 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.101590 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:45.102567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.102567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:45.102567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:45.102567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:45.102567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.102567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:45.102567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:45.102567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.102567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:45.102567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:45.102567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:45.102567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.102961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:45.102961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:45.102961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:45.102961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:45.102961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:45.102961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:45.102961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:45.102961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:45.102961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:45.102961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:45.102961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:45.102961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:45.102961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:45.103546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.103546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:45.103786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.103786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:45.103786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:45.103786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:45.103786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:45.103786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:45.103786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.103786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:45.103786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:45.103786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.103786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:45.103786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:45.103786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.103786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:45.103786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:45.103786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:45.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:45.104939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:45.104939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:45.104939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:49.857948 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:49.858749 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:49.858749 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:49.859877 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:49.891750 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:49.892256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:49.893388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:49.893388 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:49.893388 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:49.893388 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:49.893388 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:49.893388 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:49.893388 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:49.893388 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:49.894453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:49.894453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:49.894453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:49.894453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:49.894453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:49.894453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:49.894453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:49.894453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:49.894453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:49.894453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:49.894453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:49.894453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:49.895914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:49.895914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:49.895914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:49.895914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:49.895914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:49.895914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:49.895914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:49.895914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:49.895914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:49.895914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:49.895914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:49.895914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:49.895914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:49.896535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:49.896535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:49.896535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:49.896535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:49.896535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:49.896535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:49.896535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:49.896535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:49.896535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:49.896535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:49.896535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:49.896535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:49.896535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:49.896535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:49.896535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:49.897272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:49.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:49.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:49.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:49.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:49.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:49.898199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:50.082451 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:50.083086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:50.083362 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:50.084391 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:50.084885 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:50.085111 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.086137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:50.086137 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:50.086137 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:50.086137 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:50.086137 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:50.086137 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:50.086137 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.086137 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:50.087800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.087800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:50.087800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:50.087800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:50.087800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.087800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:50.087800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:50.087800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.087800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:50.087800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:50.087800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:50.087800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.088395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:50.088395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:50.088395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:50.088395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:50.088395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:50.088395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:50.088395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:50.088395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:50.088395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:50.088395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:50.088395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:50.088395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:50.088395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:50.088970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.088970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:50.089601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.089601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:50.089601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:50.089601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:50.089601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:50.089601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:50.089601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.089601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:50.089601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:50.089601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.089601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:50.089601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:50.089601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.089601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:50.089601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:50.089601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:50.090501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:50.091454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:50.091454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.091454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:50.091454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:50.091454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:50.091454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:50.091454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:54:50.091454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:50.091900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.092035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:50.092035 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:50.092035 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:50.092035 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:50.092035 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:50.092035 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:50.092035 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.092035 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:50.092753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.092753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:50.092753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:50.092753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:50.092753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.092753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:50.092753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:50.092753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:50.092753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.092753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:50.092753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:50.092753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:50.092753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:50.092753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:50.092753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:50.093573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:50.093573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:50.093573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:50.093573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:50.093573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:50.093573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:50.093573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:50.093573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.093573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:50.093573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.093573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:50.093573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:50.093573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:50.093573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.094430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:50.094430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:50.094430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:54:50.094430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:50.094430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:50.094430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.094430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:50.094430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:50.094430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:50.094430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.094430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:50.094430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:50.094430 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:50.095013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:50.095013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:50.095013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:50.095013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:50.095013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:50.095013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:50.095013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:50.095013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:50.095013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:50.095013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:50.095013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.095013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:50.095231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.095231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:50.095231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:50.095231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:50.095231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:50.095231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:50.095231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.095231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:50.095231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:50.095231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.095231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:50.095231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:50.095231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.095231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:50.095231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:50.095231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:50.095542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:50.095841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:50.095841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:50.095841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:50.095841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:50.095841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:50.095841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.095841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:50.095841 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:50.095841 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:50.095841 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:50.096028 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:50.096028 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:50.096028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.096663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:50.096663 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:50.096663 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:50.096663 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:50.096663 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:50.096663 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:50.096663 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.096663 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:50.097376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.097376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:50.097376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:50.097376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:50.097376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.097376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:50.097376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:50.097376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:50.097376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.097376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:50.097376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:50.097376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:50.097376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:50.097376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:50.097376 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:50.097653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:50.097653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:50.097653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:50.097653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:50.097653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:50.097653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:50.097653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:50.097653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.097653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:50.098229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.098229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:50.098229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:50.098229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:50.098229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.098229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:50.098229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:50.098229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:50.098229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:50.098229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.098229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:50.098488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:50.098488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:50.098488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.098488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:50.098488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:50.098488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:50.098488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:50.098488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:50.098488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:50.098488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:50.098488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:50.098488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:50.098488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:50.098488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:50.098756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:50.098756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:50.098756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.098756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.099304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:50.099633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:50.100001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:50.100001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:50.100001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.100001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:50.100001 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:50.100001 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:50.100001 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:50.100154 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:50.100403 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:50.100597 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:50.100738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.101452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:50.101452 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:50.101452 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:50.101452 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:50.101452 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:50.101452 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:50.101452 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.101452 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:50.102247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.102247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:50.102247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:50.102247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:50.102247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.102247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:50.102247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:50.102247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.102247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:50.102247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:50.102247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:50.102247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.102531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:50.102531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:50.102531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:50.102531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:50.102531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:50.102531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:50.102531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:50.102531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:50.102531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:50.102531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:50.102531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:50.102531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:50.102531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:50.102772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.102772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:50.103214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.103214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:50.103214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:50.103214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:50.103214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:50.103214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:50.103214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.103214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:50.103214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:50.103214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.103214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:50.103214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:50.103214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.103214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:50.103214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:50.103214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:50.103518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:50.103859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:50.103859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:50.103859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:54.858748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:54.859614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:54.859614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:54.860981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:54.862858 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:54:54.896562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:54.896980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:54.897618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:54.897618 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:54.897618 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:54.897618 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:54.897618 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:54.897618 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:54.897618 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:54.897618 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:54.898657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:54.898657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:54.898657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:54.898657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:54.898657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:54.898657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:54.898657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:54.898657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:54.898657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:54.898657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:54.898657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:54.898657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:54.899219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:54.899219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:54.899219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:54.899219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:54.899219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:54.899219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:54.899219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:54.899219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:54.899219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:54.899219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:54.899219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:54.899219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:54.899219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:54.899758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:54.899758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:54.899758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:54.899758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:54.899758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:54.899758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:54.899758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:54.899758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:54.899758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:54.899758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:54.899758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:54.899758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:54.899758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:54.899758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:54.899758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:54.900798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:54.902301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:54.902301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:54.902301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:54.902301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:54.902301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:54.902301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:55.083206 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:55.083835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:55.084030 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:55.085209 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:55.085696 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:55.086013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.087090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:55.087090 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:55.087090 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:55.087090 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:55.087090 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:55.087090 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:55.087090 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.087090 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:55.088875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.088875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:55.088875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:55.088875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:55.088875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.088875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:55.088875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:55.088875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.088875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:55.088875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:55.088875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:55.088875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.090101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:55.090101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:55.090101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:55.090101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:55.090101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:55.090101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:55.090101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:55.090101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:55.090101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:55.090101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:55.090101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:55.090101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:55.090101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:55.090448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.090448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:55.090783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.090783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:55.090783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:55.090783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:55.090783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:55.090783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:55.090783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.090783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:55.090783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:55.090783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.090783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:55.090783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:55.090783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.090783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:55.090783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:55.090783 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:55.091203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:55.091721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:55.091721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.091721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:55.091721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:55.091721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:55.091721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:55.091721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:54:55.092460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:55.092460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.092948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:55.092948 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:55.092948 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:55.092948 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:55.092948 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:55.092948 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:55.092948 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.092948 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:55.093816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.093816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:55.093816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:55.093816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:55.093816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.093816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:55.093816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:55.093816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:55.093816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.093816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:55.093816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:55.093816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:55.093816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:55.093816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:55.093816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:55.094747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:55.094747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:55.094747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:55.094747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:55.094747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:55.094747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:55.094747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:55.094747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.094747 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:55.095235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.095235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:55.095235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:55.095235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:55.095235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.095235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:55.095235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:55.095235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:54:55.095235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:55.095235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:55.095235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.095235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:55.095669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:55.095669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:55.095669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.095669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:55.095669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:55.095669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:55.095669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:55.095669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:55.095669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:55.095669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:55.095669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:55.095669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:55.095669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:55.095669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:55.095999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:55.095999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:55.095999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.095999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:55.096215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.096215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:55.096215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:55.096215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:55.096215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:55.096215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:55.096215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.096215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:55.096215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:55.096215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.096215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:55.096215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:55.096215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.096215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:55.096215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:55.096215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:55.097137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:55.098252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:55.098252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:55.098252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:55.098252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:55.098252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:55.098252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.098252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:55.098252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:55.098252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:55.098252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:55.098512 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:55.098512 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:55.098512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.098512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:55.098512 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:55.098512 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:55.098512 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:55.098512 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:55.098512 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:55.098512 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.098512 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:55.099282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.099282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:54:55.099282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:55.099282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:55.099282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.099282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:55.099282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:55.099282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:55.099282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.099282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:54:55.099282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:55.099282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:54:55.099282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:55.099282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:54:55.099282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:54:55.099609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:55.099609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:54:55.099609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:55.099609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:54:55.099609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:54:55.099609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:55.099609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:54:55.099609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.099609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:54:55.100691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.100691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:55.100691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:55.100691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:55.100691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.100691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:55.100691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:55.100691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:55.100691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:55.100691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.100691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:55.100918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:55.100918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:55.100918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.100918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:55.100918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:55.100918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:55.100918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:55.100918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:55.100918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:55.100918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:55.100918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:55.100918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:55.100918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:55.100918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:55.101155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:55.101155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:55.101155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.101155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:55.101155 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:55.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:55.103010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:55.103010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:55.103010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.103010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:55.103010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:55.103010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:55.103010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:55.103209 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:55.103353 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:55.103447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.103895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:55.103895 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:55.103895 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:55.103895 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:55.103895 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:55.103895 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:55.103895 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.103895 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:55.104869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.104869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:55.104869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:55.104869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:55.104869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.104869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:55.104869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:55.104869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.104869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:55.104869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:55.104869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:55.104869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.105492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:55.105492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:55.105492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:55.105492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:55.105492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:55.105492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:55.105492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:55.105492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:55.105492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:55.105492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:55.105492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:55.105492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:55.105492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:55.106012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.106012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:55.106012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.106012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:55.106012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:55.106012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:55.106012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:55.106012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:55.106012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.106012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:55.106012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:55.106012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.106012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:55.106012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:55.106012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:55.106746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:55.107801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:55.107801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:55.107801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:55.107801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:55.107801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:55.107801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:54:59.859737 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:54:59.860817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:54:59.860817 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:54:59.862273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:54:59.898053 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:54:59.898564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:59.899525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:54:59.899525 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:59.899525 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:54:59.899525 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:54:59.899525 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:59.899525 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:54:59.899525 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:59.899525 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:54:59.900394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:59.900394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:54:59.900394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:59.900394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:54:59.900394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:59.900394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:59.900394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:59.900394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:59.900394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:59.900394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:59.900394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:59.900394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:59.901046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:54:59.901046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:59.901046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:54:59.901046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:59.901046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:54:59.901046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:54:59.901046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:59.901046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:54:59.901046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:59.901046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:54:59.901046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:54:59.901046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:59.901046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:54:59.901903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:59.901903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:54:59.901903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:59.901903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:54:59.901903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:54:59.901903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:54:59.901903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:54:59.901903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:54:59.901903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:59.901903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:54:59.901903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:54:59.901903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:59.901903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:54:59.901903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:54:59.901903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:54:59.903034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:54:59.904032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:54:59.904032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:54:59.904032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:54:59.904032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:54:59.904032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:54:59.904032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:00.083875 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:00.085354 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:00.085669 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:00.087193 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:00.087599 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:00.087842 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.088751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:00.088751 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:00.088751 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:00.088751 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:00.088751 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:00.088751 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:00.088751 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.088751 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:00.090512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.090512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:00.090512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:00.090512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:00.090512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.090512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:00.090512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:00.090512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.090512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:00.090512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:00.090512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:00.090512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.092671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:00.092671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:00.092671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:00.092671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:00.092671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:00.092671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:00.092671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:00.092671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:00.092671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:00.092671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:00.092671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:00.092671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:00.092671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:00.093559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.093559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:00.093559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.093559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:00.093559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:00.093559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:00.093559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:00.093559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:00.093559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.093559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:00.093559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:00.093559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.093559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:00.093559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:00.093559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:00.094292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:00.095763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:00.095763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:00.095763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:00.095763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:00.095763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.095763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:00.095763 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:00.095763 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:00.095763 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:00.095763 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:55:00.096483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:00.096483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.096483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:00.096483 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:00.096483 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:00.096483 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:00.096483 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:00.096483 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:00.096483 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.096483 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:00.096483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.096483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:00.096483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:00.096483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:00.097462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:00.098712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.098712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:00.098712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.098712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:00.098712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:00.098712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:00.098712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.098712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:00.098712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:00.098712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:55:00.098712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:00.098712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:00.099132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.099132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:00.099132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:00.099132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:00.099132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.099132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:00.099132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:00.099132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:00.099132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:00.099132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:00.099132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:00.099132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:00.099132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:00.099132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:00.099489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:00.099489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:00.099489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:00.099489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:00.099489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.099489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:00.099489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.099489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:00.099489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:00.099489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:00.099489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:00.099489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:00.099489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.099489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.099871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:00.100969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:00.100969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:00.100969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:00.100969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:00.100969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:00.100969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:00.100969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:00.100969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:00.100969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:00.100969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:00.100969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:00.100969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:00.100969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.100969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:00.100969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:00.101633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:00.101633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:00.101633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:00.101633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:00.101633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.101633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:00.101633 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:00.101633 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:00.101633 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:00.101891 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:00.101891 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:00.101891 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.101891 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:00.101891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.101891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:00.101891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:00.101891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:00.101891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.101891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:00.101891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:00.101891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:00.101891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.101891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:00.101891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:00.101891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:00.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:00.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:00.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:00.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:00.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:00.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:00.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:00.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:00.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:00.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:00.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:00.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.102242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:00.102516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:00.102516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:00.102516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.102516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:00.102516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:00.102516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:00.102516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:00.102516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.102516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:00.102516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:00.102516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:00.102516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.102516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:00.102755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:00.102755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:00.102755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:00.102755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:00.102755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:00.102755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:00.102755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:00.102755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:00.102755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:00.102755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:00.102755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:00.102755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:00.102755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:00.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:00.103286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:00.103772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:00.103772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:00.103772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:00.103772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.103772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:00.103772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:00.103772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:00.103772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:00.103772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:00.103969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:00.103969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:00.104216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.104943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:00.104943 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:00.104943 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:00.104943 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:00.104943 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:00.104943 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:00.104943 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.104943 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:00.105593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.105593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:00.105593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:00.105593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:00.105593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.105593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:00.105593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:00.105593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.105593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:00.105593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:00.105593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:00.105593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.105879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:00.105879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:00.105879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:00.105879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:00.105879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:00.105879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:00.105879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:00.105879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:00.105879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:00.105879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:00.105879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:00.105879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:00.105879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:00.106140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.106140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:00.106289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.106289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:00.106289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:00.106289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:00.106289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:00.106289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:00.106289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.106289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:00.106289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:00.106289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.106289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:00.106289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:00.106289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.106289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:00.106289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:00.106289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:00.106618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:00.106962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:00.106962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:00.106962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:03.775616 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:03.776455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_for_inconsistencies {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:03.776455 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Checking Neutron and OVN revision consistency. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:03.785498 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:440}}
Apr 24 10:55:03.785641 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=106381) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:419}}
Apr 24 10:55:03.785763 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 412fe0fb-d3c8-41ef-b742-c7e091bf5e56 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:55:03.824056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, resource={'id': '412fe0fb-d3c8-41ef-b742-c7e091bf5e56', 'name': 'private', 'tenant_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'project_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['bedea127-581a-4245-bdcf-823b49c82996', 'd98dd98c-3740-4b7b-9054-95b7f384275a'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:19:49Z', 'updated_at': '2026-04-24T10:19:53Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 21598}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:03.824548 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:03.825156 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-d9e6c44e-2c1f-4e1c-97fa-3abe15d536c8, external_ids_update=None, columns={'tag': 21598}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:03.825302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.826195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:03.826195 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:03.826195 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:03.826195 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:03.826195 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:03.826195 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:03.826195 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.826195 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:03.827113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 412fe0fb-d3c8-41ef-b742-c7e091bf5e56 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.827113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:03.827113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:55:03.827113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:55:03.827113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:55:03.827113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:55:03.827113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:55:03.827113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:03.827113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:03.827113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:03.827113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:03.827696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:03.827696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:03.827696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:03.827696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:03.827696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:03.827696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:03.827696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:03.827696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:03.827696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:03.827696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:03.827696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:03.827696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:03.827696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:03.827696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:03.828300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:03.828300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.828300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:03.828300 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 86c46bc9-7739-46e7-9c49-62d2723e0d83 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:55:03.855401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, resource={'id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'name': 'public', 'tenant_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'project_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['4daf396b-50dc-4100-9154-fd24fc0e5f1d', '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-24T10:19:55Z', 'updated_at': '2026-04-24T10:20:05Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:03.855840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:03.856494 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-b792be55-4fbf-4e4f-a9dc-10cee932ceea, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:03.856916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.857787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:03.857787 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:03.857787 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:03.857787 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:03.857787 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:03.857787 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:03.857787 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.857787 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:03.858711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 86c46bc9-7739-46e7-9c49-62d2723e0d83 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.858711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:03.858711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:55:03.858711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:55:03.858711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:55:03.858711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:55:03.858711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:55:03.858711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:03.858711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:03.858711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:03.858711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:03.859191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:03.859191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:03.859191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:03.859191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:03.859191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:03.859191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:03.859191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:03.859191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:03.859191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:03.859191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:03.859191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:03.859191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:03.859191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:03.859191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:03.859753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:03.859753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.859753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:03.859753 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 64c3f969-5120-406a-afc1-20f8f45b7533 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:55:03.885620 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-64c3f969-5120-406a-afc1-20f8f45b7533, resource={'id': '64c3f969-5120-406a-afc1-20f8f45b7533', 'name': 'admin_net', 'tenant_id': '91bc93878b40449c8fd1c9924d8a3e8b', 'project_id': '91bc93878b40449c8fd1c9924d8a3e8b', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['18db2f65-6ba9-4ddd-8ab7-55370a16debc'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:23:22Z', 'updated_at': '2026-04-24T10:23:23Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 10837}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:03.885951 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-64c3f969-5120-406a-afc1-20f8f45b7533, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:03.886483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-a26d15c8-ce05-4e3e-84bc-9aa33edf96fe, external_ids_update=None, columns={'tag': 10837}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:03.886637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.887451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:03.887451 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:03.887451 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:03.887451 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:03.887451 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:03.887451 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:03.887451 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.887451 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:03.888590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 64c3f969-5120-406a-afc1-20f8f45b7533 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.888590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:03.888590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:55:03.888590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:55:03.888590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:55:03.888590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:55:03.888590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:55:03.888590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:03.888590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:03.888590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:03.888590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:03.889529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:03.889529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:03.889529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:03.889529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:03.889529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:03.889529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:03.889529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:03.889529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:03.889529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:03.889529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:03.889529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:03.889529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:03.889529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:03.889529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:03.890293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:03.890293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.890293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:03.890293 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource b30b34a1-477c-4ef7-aea4-d9540988f10a (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:55:03.917834 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a, resource={'id': 'b30b34a1-477c-4ef7-aea4-d9540988f10a', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'tenant_id': '277dd31c279b430f90665727a827242c', 'project_id': '277dd31c279b430f90665727a827242c', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['a3090689-5a84-48d5-9685-f418bb1fd559'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:24:04Z', 'updated_at': '2026-04-24T10:24:05Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 23713}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:03.918190 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:03.918720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-6d5b7906-0378-49b8-88fc-e9fa642055e4, external_ids_update=None, columns={'tag': 23713}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:03.918908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.919698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:03.919698 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:03.919698 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:03.919698 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:03.919698 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:03.919698 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:03.919698 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.919698 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:03.920732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource b30b34a1-477c-4ef7-aea4-d9540988f10a (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.920732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:03.920732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:55:03.920732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:55:03.920732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:55:03.920732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:55:03.920732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 10:55:03.920732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:03.920732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:03.920732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:03.920732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:03.921036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:03.921036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:03.921036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:03.921036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:03.921036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:03.921036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:03.921036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:03.921036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:03.921036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:03.921036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:03.921036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:03.921036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:03.921036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:03.921036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:03.921427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:03.921427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.921427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:03.921427 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 931f18d3-b7f8-4874-928b-3c06d4d5d355 (type: routers) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:55:03.987648 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, resource={'id': '931f18d3-b7f8-4874-928b-3c06d4d5d355', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'project_id': '277dd31c279b430f90665727a827242c', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'external_fixed_ips': [{'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7', 'ip_address': '172.24.5.167'}, {'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'ip_address': '2001:db8::1b3'}], 'enable_snat': True}, 'gw_port_id': '77659748-a2b4-448f-aa2d-e166be8f2be9', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-7ytfi', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'external_fixed_ips': [{'ip_address': '172.24.5.167', 'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7'}, {'ip_address': '2001:db8::1b3', 'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-24T10:24:05Z', 'updated_at': '2026-04-24T10:24:08Z', 'revision_number': 3, 'tenant_id': '277dd31c279b430f90665727a827242c'}, resource_type=routers, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:03.987926 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:03.988266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "77659748-a2b4-448f-aa2d-e166be8f2be9"')], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:03.988529 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "77659748-a2b4-448f-aa2d-e166be8f2be9"')], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:03.988729 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.989926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:03.989926 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:03.989926 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:03.989926 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:03.989926 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:03.989926 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:03.989926 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.989926 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:03.990514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Unable to update router 931f18d3-b7f8-4874-928b-3c06d4d5d355. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.991754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 931f18d3-b7f8-4874-928b-3c06d4d5d355 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.991754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:03.991754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:55:03.991754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:55:03.991754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:55:03.991754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:55:03.991754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1634, in update_router
Apr 24 10:55:03.991754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 24 10:55:03.991754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
Apr 24 10:55:03.991754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 24 10:55:03.991754 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 24 10:55:03.992458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 24 10:55:03.992458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1568, in update_router
Apr 24 10:55:03.992458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:03.992458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:03.992458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:03.992458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:03.992458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:03.992458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:03.992458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:03.992458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:03.992458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:03.992458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:03.992458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:03.992458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:03.993279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:03.993279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:03.993279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:03.993279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:03.993279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:03.993279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:03.993279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:03.993279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:03.993279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:03.993279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 77659748-a2b4-448f-aa2d-e166be8f2be9 (type: router_ports) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 10:55:04.091532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, resource={'id': '77659748-a2b4-448f-aa2d-e166be8f2be9', 'name': '', 'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'project_id': '', 'mac_address': 'fa:16:3e:fa:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '931f18d3-b7f8-4874-928b-3c06d4d5d355', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7', 'ip_address': '172.24.5.167'}, {'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'ip_address': '2001:db8::1b3'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000170011', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-24T10:24:06Z', 'updated_at': '2026-04-24T10:24:07Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:04.091903 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7 4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'neutron:network_name': 'neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.167/24', '2001:db8::1b3/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:04.092432 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=77659748-a2b4-448f-aa2d-e166be8f2be9, lrouter_port=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:04.092818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:04.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:04.093656 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:04.093656 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:04.093656 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:04.093656 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:04.093656 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:04.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:04.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:04.094511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 77659748-a2b4-448f-aa2d-e166be8f2be9 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:04.094511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:04.094511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 10:55:04.094511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 10:55:04.094511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 10:55:04.094511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 10:55:04.094511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1971, in update_router_port
Apr 24 10:55:04.094511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:04.094511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:04.094511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:04.094511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:04.095281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:04.095281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:04.095281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:04.095281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:04.095281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:04.095281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:04.095281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:04.095281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:04.095281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:04.095281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:04.095281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:04.095281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:04.095281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:04.095281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:04.095597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:04.095597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:04.095597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:04.095597 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_for_inconsistencies finished in 0.318 seconds
Apr 24 10:55:04.860644 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:04.861512 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:04.861512 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:04.861985 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:04.893426 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:04.893910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:04.894664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:04.894664 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:04.894664 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:04.894664 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:04.894664 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:04.894664 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:04.894664 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:04.894664 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:04.895595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:04.895595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:04.895595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:04.895595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:04.895595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:04.895595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:04.895595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:04.895595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:04.895595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:04.895595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:04.895595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:04.895595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:04.895857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:04.895857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:04.895857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:04.895857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:04.895857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:04.895857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:04.895857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:04.895857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:04.895857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:04.895857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:04.895857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:04.895857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:04.895857 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:04.896127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:04.896127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:04.896760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:04.896760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:04.896760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:04.896760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:04.896760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:04.896760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:04.896760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:04.896760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:04.896760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:04.896760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:04.896760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:04.896760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:04.896760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:04.896760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:04.896760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:04.896760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:04.897132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:04.897551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:04.897551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:04.897551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:05.085405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:05.085905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:05.086002 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:05.087526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:05.087526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:05.087526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.088308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:05.088308 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:05.088308 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:05.088308 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:05.088308 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:05.088308 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:05.088308 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.088308 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:05.089209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.089209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:05.089209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:05.089209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:05.089209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.089209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:05.089209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:05.089209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.089209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:05.089209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:05.089209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:05.089209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.089989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:05.089989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:05.089989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:05.089989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:05.089989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:05.089989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:05.089989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:05.089989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:05.089989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:05.089989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:05.089989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:05.089989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:05.089989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:05.090856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.090856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:05.090856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.090856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:05.090856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:05.090856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:05.090856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:05.090856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:05.090856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.090856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:05.090856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:05.090856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.090856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:05.090856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:05.090856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:05.091794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:05.092927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:05.092927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:05.092927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:05.092927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:05.092927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.092927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:05.094209 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:05.094588 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:05.094692 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:05.094829 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:55:05.095135 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:05.095316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.095955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:05.095955 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:05.095955 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:05.095955 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:05.095955 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:05.095955 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:05.095955 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.095955 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:05.096702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.096702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:05.096702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:05.096702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:05.096702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.096702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:05.096702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:05.096702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:05.096702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.096702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:05.096702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:05.096702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:05.096702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:05.096702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:05.096702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:05.097086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:05.097086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:05.097086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:05.097086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:05.097086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:05.097086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:05.097086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:05.097086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.097086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:05.097552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.097552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:05.097552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:05.097552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:05.097552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.097552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:05.097552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:05.097552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:55:05.097552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:05.097552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:05.097552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.097552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:05.097874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:05.097874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:05.097874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.097874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:05.097874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:05.097874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:05.097874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:05.097874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:05.097874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:05.097874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:05.097874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:05.097874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:05.097874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:05.097874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:05.098232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:05.098232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:05.098232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.098232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:05.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:05.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:05.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:05.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:05.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:05.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:05.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:05.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:05.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:05.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:05.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:05.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:05.099143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:05.099623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:05.099623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:05.099623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:05.099623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:05.099623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:05.099623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.099623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:05.099623 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:05.099623 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:05.099623 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:05.099887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:05.099988 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:05.100201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.100719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:05.100719 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:05.100719 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:05.100719 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:05.100719 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:05.100719 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:05.100719 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.100719 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:05.101357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.101357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:05.101357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:05.101357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:05.101357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.101357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:05.101357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:05.101357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:05.101357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.101357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:05.101357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:05.101357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:05.101357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:05.101357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:05.101357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:05.101757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:05.101757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:05.101757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:05.101757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:05.101757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:05.101757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:05.101757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:05.101757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.101757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:05.102223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.102223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:05.102223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:05.102223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:05.102223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.102223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:05.102223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:05.102223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:05.102223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:05.102223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.102223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:05.102711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:05.102711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:05.102711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.102711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:05.102711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:05.102711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:05.102711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:05.102711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:05.102711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:05.102711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:05.102711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:05.102711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:05.102711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:05.102711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:05.103073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:05.103073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:05.103073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.103073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.103588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:05.104008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:05.104586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:05.104586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:05.104586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.104586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:05.104586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:05.104586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:05.104586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:05.104586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:05.104821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:05.105011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:05.105148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.105677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:05.105677 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:05.105677 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:05.105677 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:05.105677 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:05.105677 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:05.105677 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.105677 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:05.106549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.106549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:05.106549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:05.106549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:05.106549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.106549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:05.106549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:05.106549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.106549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:05.106549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:05.106549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:05.106549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.106886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:05.106886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:05.106886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:05.106886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:05.106886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:05.106886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:05.106886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:05.106886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:05.106886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:05.106886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:05.106886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:05.106886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:05.106886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:05.107228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.107228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:05.107534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.107534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:05.107534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:05.107534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:05.107534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:05.107534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:05.107534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.107534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:05.107534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:05.107534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.107534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:05.107534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:05.107534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.107534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:05.107534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:05.107534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:05.107954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:05.108464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:05.108464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:05.108464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:09.861182 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:09.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:09.862084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:09.863140 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:09.897756 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:09.898254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:09.899205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:09.899205 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:09.899205 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:09.899205 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:09.899205 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:09.899205 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:09.899205 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:09.899205 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:09.900187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:09.900187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:09.900187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:09.900187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:09.900187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:09.900187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:09.900187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:09.900187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:09.900187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:09.900187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:09.900187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:09.900187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:09.900644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:09.900644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:09.900644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:09.900644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:09.900644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:09.900644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:09.900644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:09.900644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:09.900644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:09.900644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:09.900644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:09.900644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:09.900644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:09.901070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:09.901070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:09.901247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:09.901247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:09.901247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:09.901247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:09.901247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:09.901247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:09.901247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:09.901247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:09.901247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:09.901247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:09.901247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:09.901247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:09.901247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:09.901247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:09.901247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:09.901247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:09.901805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:09.902523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:09.902523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:09.902523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:10.086133 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:10.086815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:10.087102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:10.088275 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:10.088650 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:10.088888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.089949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:10.089949 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:10.089949 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:10.089949 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:10.089949 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:10.089949 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:10.089949 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.089949 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:10.091584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.091584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:10.091584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:10.091584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:10.091584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.091584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:10.091584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:10.091584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.091584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:10.091584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:10.091584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:10.091584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.092401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:10.092401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:10.092401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:10.092401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:10.092401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:10.092401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:10.092401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:10.092401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:10.092401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:10.092401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:10.092401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:10.092401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:10.092401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:10.093035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.093035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:10.093273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.093273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:10.093273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:10.093273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:10.093273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:10.093273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:10.093273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.093273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:10.093273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:10.093273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.093273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:10.093273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:10.093273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.093273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:10.093273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:10.093273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:10.094047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:10.095004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:10.095004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.095004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:10.095004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:10.095196 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:10.096594 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:10.096594 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:55:10.096594 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:10.096594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.097338 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:10.097338 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:10.097338 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:10.097338 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:10.097338 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:10.097338 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:10.097338 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.097338 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:10.098286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.098286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:10.098286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:10.098286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:10.098286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.098286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:10.098286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:10.098286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:10.098286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.098286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:10.098286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:10.098286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:10.098286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:10.098286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:10.098286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:10.099355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:10.099355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:10.099355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:10.099355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:10.099355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:10.099355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:10.099355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:10.099355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.099355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:10.099840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.099840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:10.099840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:10.099840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:10.099840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.099840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:10.099840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:10.099840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:55:10.099840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:10.099840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:10.099840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.099840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:10.100562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:10.100562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:10.100562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.100562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:10.100562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:10.100562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:10.100562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:10.100562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:10.100562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:10.100562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:10.100562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:10.100562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:10.100562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:10.100562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:10.101069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:10.101069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:10.101069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.101069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:10.101670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.101670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:10.101670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:10.101670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:10.101670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:10.101670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:10.101670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.101670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:10.101670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:10.101670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.101670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:10.101670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:10.101670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.101670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:10.101670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:10.101670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:10.102182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:10.102897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:10.102897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:10.102897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:10.102897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:10.102897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:10.102897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.102897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:10.102897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:10.102897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:10.102897 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:10.103192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:10.103192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:10.103314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.103937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:10.103937 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:10.103937 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:10.103937 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:10.103937 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:10.103937 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:10.103937 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.103937 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:10.104968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.104968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:10.104968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:10.104968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:10.104968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.104968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:10.104968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:10.104968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:10.104968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.104968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:10.104968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:10.104968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:10.104968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:10.104968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:10.104968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:10.105570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:10.105570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:10.105570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:10.105570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:10.105570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:10.105570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:10.105570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:10.105570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.105570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:10.105570 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:10.107383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.107383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:10.107383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:10.107383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:10.107383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.107383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:10.107383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:10.107383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:10.107383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:10.107383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.107383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:10.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:10.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:10.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:10.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:10.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:10.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:10.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:10.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:10.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:10.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:10.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:10.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:10.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:10.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:10.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:10.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.108927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:10.109740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:10.110244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:10.110244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:10.110244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.110244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:10.110244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:10.110244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:10.110244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:10.110244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:10.110538 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:10.110780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.111620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:10.111620 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:10.111620 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:10.111620 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:10.111620 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:10.111620 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:10.111620 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.111620 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:10.112605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.112605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:10.112605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:10.112605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:10.112605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.112605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:10.112605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:10.112605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.112605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:10.112605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:10.112605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:10.112605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.113192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:10.113192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:10.113192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:10.113192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:10.113192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:10.113192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:10.113192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:10.113192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:10.113192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:10.113192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:10.113192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:10.113192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:10.113192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:10.113738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.113738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:10.114025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.114025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:10.114025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:10.114025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:10.114025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:10.114025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:10.114025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.114025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:10.114025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:10.114025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.114025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:10.114025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:10.114025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.114025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:10.114025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:10.114025 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:10.114528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:10.115019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:10.115019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:10.115019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:14.861885 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:14.862743 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:14.862743 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:14.863802 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:14.898972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:14.899389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:14.900315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:14.900315 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:14.900315 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:14.900315 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:14.900315 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:14.900315 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:14.900315 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:14.900315 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:14.901475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:14.901475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:14.901475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:14.901475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:14.901475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:14.901475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:14.901475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:14.901475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:14.901475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:14.901475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:14.901475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:14.901475 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:14.902205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:14.902205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:14.902205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:14.902205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:14.902205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:14.902205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:14.902205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:14.902205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:14.902205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:14.902205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:14.902205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:14.902205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:14.902205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:14.902948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:14.902948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:14.902948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:14.902948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:14.902948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:14.902948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:14.902948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:14.902948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:14.902948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:14.902948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:14.902948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:14.902948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:14.902948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:14.902948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:14.902948 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:14.903881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:14.904980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:14.904980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:14.904980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:14.904980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:14.904980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:14.904980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:15.086888 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:15.087331 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:15.087581 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:15.088957 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:15.089551 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:15.089551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.090392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:15.090392 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:15.090392 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:15.090392 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:15.090392 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:15.090392 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:15.090392 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.090392 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:15.092209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.092209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:15.092209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:15.092209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:15.092209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.092209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:15.092209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:15.092209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.092209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:15.092209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:15.092209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:15.092209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.092727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:15.092727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:15.092727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:15.092727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:15.092727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:15.092727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:15.092727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:15.092727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:15.092727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:15.092727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:15.092727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:15.092727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:15.092727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:15.093095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.093095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:15.094129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.094129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:15.094129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:15.094129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:15.094129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:15.094129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:15.094129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.094129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:15.094129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:15.094129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.094129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:15.094129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:15.094129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.094129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:15.094129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:15.094129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:15.094509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:15.094872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:15.094872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.094872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:15.095280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:15.095691 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:15.095803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:15.095919 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:55:15.096597 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:15.096931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.097886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:15.097886 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:15.097886 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:15.097886 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:15.097886 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:15.097886 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:15.097886 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.097886 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:15.099387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.099387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:15.099387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:15.099387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:15.099387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.099387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:15.099387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:15.099387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:15.099387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.099387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:15.099387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:15.099387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:15.099387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:15.099387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:15.099387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:15.099863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:15.099863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:15.099863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:15.099863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:15.099863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:15.099863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:15.099863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:15.099863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.099863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:15.101040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.101040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:15.101040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:15.101040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:15.101040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.101040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:15.101040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:15.101040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:55:15.101040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:15.101040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:15.101040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.101040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:15.101630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:15.101630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:15.101630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.101630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:15.101630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:15.101630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:15.101630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:15.101630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:15.101630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:15.101630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:15.101630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:15.101630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:15.101630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:15.101630 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:15.102126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:15.102126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:15.102126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.102126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:15.102267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.102267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:15.102267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:15.102267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:15.102267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:15.102267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:15.102267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.102267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:15.102267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:15.102267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.102267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:15.102267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:15.102267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.102267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:15.102267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:15.102267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:15.102864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:15.103460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:15.103460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:15.103460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:15.103460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:15.103460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:15.103460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.103460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:15.103460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:15.103460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:15.103460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:15.103775 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:15.103864 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:15.104296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.105037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:15.105037 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:15.105037 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:15.105037 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:15.105037 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:15.105037 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:15.105037 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.105037 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:15.105780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.105780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:15.105780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:15.105780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:15.105780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.105780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:15.105780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:15.105780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:15.105780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.105780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:15.105780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:15.105780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:15.105780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:15.105780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:15.105780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:15.106326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:15.106326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:15.106326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:15.106326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:15.106326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:15.106326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:15.106326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:15.106326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.106326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:15.106721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.106721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:15.106721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:15.106721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:15.106721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.106721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:15.106721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:15.106721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:15.106721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:15.106721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.106721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:15.107093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:15.107093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:15.107093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.107093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:15.107093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:15.107093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:15.107093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:15.107093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:15.107093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:15.107093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:15.107093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:15.107093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:15.107093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:15.107093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:15.107494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:15.107494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:15.107494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.107494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.107833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:15.108498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:15.109022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:15.109022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:15.109022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.109022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:15.109349 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:15.109738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:15.109846 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:15.110032 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:15.110529 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:15.110928 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:15.111170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.112067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:15.112067 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:15.112067 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:15.112067 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:15.112067 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:15.112067 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:15.112067 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.112067 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:15.112931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.112931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:15.112931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:15.112931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:15.112931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.112931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:15.112931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:15.112931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.112931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:15.112931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:15.112931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:15.112931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.113460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:15.113460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:15.113460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:15.113460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:15.113460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:15.113460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:15.113460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:15.113460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:15.113460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:15.113460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:15.113460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:15.113460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:15.113460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:15.113941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.113941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:15.113941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.113941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:15.113941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:15.113941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:15.113941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:15.113941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:15.113941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.113941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:15.113941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:15.113941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.113941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:15.113941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:15.113941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:15.114569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:15.115312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:15.115312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:15.115312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:15.115312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:15.115312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:15.115312 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:19.862575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:19.863321 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:19.863321 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:19.864001 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:19.895535 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:19.896015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:19.897213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:19.897213 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:19.897213 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:19.897213 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:19.897213 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:19.897213 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:19.897213 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:19.897213 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:19.898310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:19.898310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:19.898310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:19.898310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:19.898310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:19.898310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:19.898310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:19.898310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:19.898310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:19.898310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:19.898310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:19.898310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:19.899081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:19.899081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:19.899081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:19.899081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:19.899081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:19.899081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:19.899081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:19.899081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:19.899081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:19.899081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:19.899081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:19.899081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:19.899081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:19.899669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:19.899669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:19.899669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:19.899669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:19.899669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:19.899669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:19.899669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:19.899669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:19.899669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:19.899669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:19.899669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:19.899669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:19.899669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:19.899669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:19.899669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:19.900343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:19.901215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:19.901215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:19.901215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:19.901215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:19.901215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:19.901215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:20.087596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:20.088311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:20.088603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:20.089976 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:20.090311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:20.090591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.091440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:20.091440 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:20.091440 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:20.091440 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:20.091440 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:20.091440 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:20.091440 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.091440 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:20.092428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.092428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:20.092428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:20.092428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:20.092428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.092428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:20.092428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:20.092428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.092428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:20.092428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:20.092428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:20.092428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.092996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:20.092996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:20.092996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:20.092996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:20.092996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:20.092996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:20.092996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:20.092996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:20.092996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:20.092996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:20.092996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:20.092996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:20.092996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:20.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:20.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:20.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:20.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:20.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:20.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:20.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:20.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:20.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:20.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:20.093656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:20.094323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:20.095145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:20.095145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:20.095145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:20.095145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:20.095145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.095145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:20.095840 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:20.096139 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:20.096245 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:20.096395 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:55:20.096722 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:20.096916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.098245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:20.098245 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:20.098245 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:20.098245 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:20.098245 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:20.098245 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:20.098245 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.098245 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:20.098984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.098984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:20.098984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:20.098984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:20.098984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.098984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:20.098984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:20.098984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:20.098984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.098984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:20.098984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:20.098984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:20.098984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:20.098984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:20.098984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:20.099659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:20.099659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:20.099659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:20.099659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:20.099659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:20.099659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:20.099659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:20.099659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.099659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:20.100080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.100080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:20.100080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:20.100080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:20.100080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.100080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:20.100080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:20.100080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:55:20.100080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:20.100080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:20.100080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.100080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:20.100694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:20.100694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:20.100694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.100694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:20.100694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:20.100694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:20.100694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:20.100694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:20.100694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:20.100694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:20.100694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:20.100694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:20.100694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:20.100694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:20.101488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:20.101488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:20.101488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.101488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:20.101488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.101488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:20.101488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:20.101488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:20.101488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:20.101488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:20.101488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.101488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:20.101488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:20.101488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:20.102067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:20.102585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:20.102585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:20.102585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:20.102585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:20.102585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:20.102585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:20.102585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:20.102585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:20.102585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:20.102585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:20.102585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.102585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:20.103225 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:20.103573 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:20.103682 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:20.103805 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:20.104290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:20.104749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.105569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:20.105569 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:20.105569 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:20.105569 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:20.105569 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:20.105569 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:20.105569 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.105569 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:20.106316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.106316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:20.106316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:20.106316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:20.106316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.106316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:20.106316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:20.106316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:20.106316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.106316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:20.106316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:20.106316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:20.106316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:20.106316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:20.106316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:20.106757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:20.106757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:20.106757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:20.106757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:20.106757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:20.106757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:20.106757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:20.106757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.106757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:20.107199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.107199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:20.107199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:20.107199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:20.107199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.107199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:20.107199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:20.107199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:20.107199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:20.107199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.107199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:20.107508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:20.107508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:20.107508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.107508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:20.107508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:20.107508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:20.107508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:20.107508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:20.107508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:20.107508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:20.107508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:20.107508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:20.107508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:20.107508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:20.107891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:20.107891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:20.107891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.107891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.108256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:20.108713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:20.109285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:20.109285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:20.109285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.109285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:20.109871 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:20.110176 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:20.110291 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:20.110537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:20.110881 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:20.111102 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:20.111246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.111801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:20.111801 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:20.111801 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:20.111801 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:20.111801 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:20.111801 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:20.111801 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.111801 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:20.112700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.112700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:20.112700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:20.112700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:20.112700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.112700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:20.112700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:20.112700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.112700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:20.112700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:20.112700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:20.112700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.113055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:20.113055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:20.113055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:20.113055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:20.113055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:20.113055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:20.113055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:20.113055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:20.113055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:20.113055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:20.113055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:20.113055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:20.113055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:20.113432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.113432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:20.113757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.113757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:20.113757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:20.113757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:20.113757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:20.113757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:20.113757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.113757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:20.113757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:20.113757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.113757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:20.113757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:20.113757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.113757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:20.113757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:20.113757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:20.114181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:20.114713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:20.114713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:20.114713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:24.863317 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:24.864521 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:24.864521 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:24.865580 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:24.892831 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:24.892967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:24.893382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:24.893382 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:24.893382 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:24.893382 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:24.893382 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:24.893382 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:24.893382 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:24.893382 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:24.894092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.029 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:24.894092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:24.894092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:24.894092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:24.894092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:24.894092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:24.894092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:24.894092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:24.894092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:24.894092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:24.894092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:24.894092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:24.894850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:24.894850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:24.894850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:24.894850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:24.894850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:24.894850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:24.894850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:24.894850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:24.894850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:24.894850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:24.894850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:24.894850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:24.894850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:24.895530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:24.895530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:24.895530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:24.895530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:24.895530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:24.895530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:24.895530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:24.895530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:24.895530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:24.895530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:24.895530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:24.895530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:24.895530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:24.895530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:24.895530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:24.896293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:24.897223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:24.897223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:24.897223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:24.897223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:24.897223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:24.897223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:25.088418 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:25.089078 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:25.089380 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:25.090353 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:25.090692 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:25.091017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.091894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:25.091894 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:25.091894 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:25.091894 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:25.091894 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:25.091894 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:25.091894 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.091894 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:25.093478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.093478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:25.093478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:25.093478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:25.093478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.093478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:25.093478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:25.093478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.093478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:25.093478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:25.093478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:25.093478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.094064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:25.094064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:25.094064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:25.094064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:25.094064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:25.094064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:25.094064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:25.094064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:25.094064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:25.094064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:25.094064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:25.094064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:25.094064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:25.094671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.094671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:25.095397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.095397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:25.095397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:25.095397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:25.095397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:25.095397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:25.095397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.095397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:25.095397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:25.095397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.095397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:25.095397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:25.095397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.095397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:25.095397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:25.095397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:25.096120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:25.096915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:25.096915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.096915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:25.096915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:25.096915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:25.096915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:25.096915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:55:25.097287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:25.097287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.097723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:25.097723 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:25.097723 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:25.097723 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:25.097723 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:25.097723 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:25.097723 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.097723 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:25.098539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.098539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:25.098539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:25.098539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:25.098539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.098539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:25.098539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:25.098539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:25.098539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.098539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:25.098539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:25.098539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:25.098539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:25.098539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:25.098539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:25.099316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:25.099316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:25.099316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:25.099316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:25.099316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:25.099316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:25.099316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:25.099316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.099316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:25.099808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.099808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:25.099808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:25.099808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:25.099808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.099808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:25.099808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:25.099808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:55:25.099808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:25.099808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:25.099808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.099808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:25.100182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:25.100182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:25.100182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.100182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:25.100182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:25.100182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:25.100182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:25.100182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:25.100182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:25.100182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:25.100182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:25.100182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:25.100182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:25.100182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:25.100608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:25.100608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:25.100608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.100608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:25.100608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.100608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:25.100608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:25.100608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:25.100608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:25.100608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:25.100608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.100608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:25.100608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:25.100608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:25.101013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:25.101644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:25.101644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:25.101644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:25.101644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:25.101644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:25.101644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:25.101644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:25.101644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:25.101644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:25.101644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:25.101644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.101644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:25.103771 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:25.104062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:25.104173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:25.104295 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:25.104753 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:25.105115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.105922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:25.105922 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:25.105922 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:25.105922 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:25.105922 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:25.105922 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:25.105922 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.105922 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:25.106760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.106760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:25.106760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:25.106760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:25.106760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.106760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:25.106760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:25.106760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:25.106760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.106760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:25.106760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:25.106760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:25.106760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:25.106760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:25.106760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:25.107219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:25.107219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:25.107219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:25.107219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:25.107219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:25.107219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:25.107219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:25.107219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.107219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:25.107703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.107703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:25.107703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:25.107703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:25.107703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.107703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:25.107703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:25.107703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:25.107703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:25.107703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.107703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:25.108031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:25.108031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:25.108031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.108031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:25.108031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:25.108031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:25.108031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:25.108031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:25.108031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:25.108031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:25.108031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:25.108031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:25.108031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:25.108031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:25.108431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:25.108431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:25.108431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.108431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.108939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:25.109749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:25.110299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:25.110299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:25.110299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.110299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:25.110449 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:25.110738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:25.110883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:25.111031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:25.111514 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:25.111862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:25.112080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.112756 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:25.112756 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:25.112756 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:25.112756 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:25.112756 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:25.112756 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:25.112756 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.112756 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:25.113584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.113584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:25.113584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:25.113584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:25.113584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.113584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:25.113584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:25.113584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.113584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:25.113584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:25.113584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:25.113584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.113936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:25.113936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:25.113936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:25.113936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:25.113936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:25.113936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:25.113936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:25.113936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:25.113936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:25.113936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:25.113936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:25.113936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:25.113936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:25.114274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.114274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:25.114500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.114500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:25.114500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:25.114500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:25.114500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:25.114500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:25.114500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.114500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:25.114500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:25.114500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.114500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:25.114500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:25.114500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.114500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:25.114500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:25.114500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:25.114977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:25.115477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:25.115477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:25.115477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:29.864014 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:29.864844 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:29.864844 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:29.866071 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:29.897634 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:29.897947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:29.898672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:29.898672 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:29.898672 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:29.898672 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:29.898672 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:29.898672 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:29.898672 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:29.898672 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:29.899647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:29.899647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:29.899647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:29.899647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:29.899647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:29.899647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:29.899647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:29.899647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:29.899647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:29.899647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:29.899647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:29.899647 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:29.900245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:29.900245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:29.900245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:29.900245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:29.900245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:29.900245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:29.900245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:29.900245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:29.900245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:29.900245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:29.900245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:29.900245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:29.900245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:29.900901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:29.900901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:29.900901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:29.900901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:29.900901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:29.900901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:29.900901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:29.900901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:29.900901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:29.900901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:29.900901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:29.900901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:29.900901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:29.900901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:29.900901 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:29.901626 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:29.903181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:29.903181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:29.903181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:29.903181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:29.903181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:29.903181 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:30.089430 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:30.090046 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:30.090306 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:30.091283 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:30.091526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:30.091712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.092494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:30.092494 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:30.092494 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:30.092494 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:30.092494 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:30.092494 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:30.092494 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.092494 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:30.093553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.093553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:30.093553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:30.093553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:30.093553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.093553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:30.093553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:30.093553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.093553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:30.093553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:30.093553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:30.093553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.094104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:30.094104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:30.094104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:30.094104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:30.094104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:30.094104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:30.094104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:30.094104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:30.094104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:30.094104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:30.094104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:30.094104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:30.094104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:30.094696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.094696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:30.095073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.095073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:30.095073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:30.095073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:30.095073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:30.095073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:30.095073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.095073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:30.095073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:30.095073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.095073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:30.095073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:30.095073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.095073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:30.095073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:30.095073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:30.095781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:30.096433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:30.096433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.096433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:30.096684 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:30.096956 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:30.097117 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:30.097292 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:55:30.097602 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:30.097773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.098229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:30.098229 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:30.098229 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:30.098229 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:30.098229 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:30.098229 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:30.098229 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.098229 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:30.099164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.099164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:30.099164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:30.099164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:30.099164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.099164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:30.099164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:30.099164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:30.099164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.099164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:30.099164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:30.099164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:30.099164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:30.099164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:30.099164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:30.099872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:30.099872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:30.099872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:30.099872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:30.099872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:30.099872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:30.099872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:30.099872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.099872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:30.100473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.100473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:30.100473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:30.100473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:30.100473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.100473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:30.100473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:30.100473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:55:30.100473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:30.100473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:30.100473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.100473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:30.101150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:30.101150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:30.101150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.101150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:30.101150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:30.101150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:30.101150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:30.101150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:30.101150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:30.101150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:30.101150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:30.101150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:30.101150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:30.101150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:30.101839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:30.101839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:30.101839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.101839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:30.102046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.102046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:30.102046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:30.102046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:30.102046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:30.102046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:30.102046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.102046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:30.102046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:30.102046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.102046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:30.102046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:30.102046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.102046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:30.102046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:30.102046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:30.102614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:30.103253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:30.103253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:30.103253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:30.103253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:30.103253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:30.103253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.103253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:30.104058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:30.104286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:30.104488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:30.104633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:30.104925 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:30.105143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.105600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:30.105600 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:30.105600 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:30.105600 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:30.105600 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:30.105600 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:30.105600 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.105600 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:30.106538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.106538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:30.106538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:30.106538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:30.106538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.106538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:30.106538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:30.106538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:30.106538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.106538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:30.106538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:30.106538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:30.106538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:30.106538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:30.106538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:30.107009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:30.107009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:30.107009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:30.107009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:30.107009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:30.107009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:30.107009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:30.107009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.107009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:30.107874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.107874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:30.107874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:30.107874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:30.107874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.107874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:30.107874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:30.107874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:30.107874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:30.107874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.107874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:30.108327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:30.108327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:30.108327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.108327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:30.108327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:30.108327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:30.108327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:30.108327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:30.108327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:30.108327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:30.108327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:30.108327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:30.108327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:30.108327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:30.108870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:30.108870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:30.108870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.108870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.109458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:30.109973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:30.110568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:30.110568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:30.110568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.110568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:30.110837 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:30.111094 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:30.111297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:30.111536 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:30.111867 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:30.112159 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:30.112350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.112879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:30.112879 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:30.112879 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:30.112879 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:30.112879 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:30.112879 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:30.112879 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.112879 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:30.113916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.113916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:30.113916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:30.113916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:30.113916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.113916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:30.113916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:30.113916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.113916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:30.113916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:30.113916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:30.113916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.114343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:30.114343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:30.114343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:30.114343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:30.114343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:30.114343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:30.114343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:30.114343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:30.114343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:30.114343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:30.114343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:30.114343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:30.114343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:30.114763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.114763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:30.115262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.115262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:30.115262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:30.115262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:30.115262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:30.115262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:30.115262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.115262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:30.115262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:30.115262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.115262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:30.115262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:30.115262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.115262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:30.115262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:30.115262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:30.115944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:30.116468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:30.116468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:30.116468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:34.864703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:34.865667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:34.865667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:34.866989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:34.900578 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:34.900959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:34.901919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:34.901919 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:34.901919 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:34.901919 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:34.901919 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:34.901919 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:34.901919 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:34.901919 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:34.903161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:34.903161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:34.903161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:34.903161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:34.903161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:34.903161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:34.903161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:34.903161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:34.903161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:34.903161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:34.903161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:34.903161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:34.904020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:34.904020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:34.904020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:34.904020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:34.904020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:34.904020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:34.904020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:34.904020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:34.904020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:34.904020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:34.904020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:34.904020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:34.904020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:34.904752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:34.904752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:34.904752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:34.904752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:34.904752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:34.904752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:34.904752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:34.904752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:34.904752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:34.904752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:34.904752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:34.904752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:34.904752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:34.904752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:34.904752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:34.905540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:34.906486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:34.906486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:34.906486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:34.906486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:34.906486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:34.906486 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:35.090246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:35.090963 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:35.091157 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:35.092495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:35.092832 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:35.093071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.093967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:35.093967 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:35.093967 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:35.093967 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:35.093967 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:35.093967 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:35.093967 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.093967 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:35.095604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.095604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:35.095604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:35.095604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:35.095604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.095604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:35.095604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:35.095604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.095604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:35.095604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:35.095604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:35.095604 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.096334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:35.096334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:35.096334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:35.096334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:35.096334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:35.096334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:35.096334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:35.096334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:35.096334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:35.096334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:35.096334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:35.096334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:35.096334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:35.096897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.096897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:35.097307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.097307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:35.097307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:35.097307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:35.097307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:35.097307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:35.097307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.097307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:35.097307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:35.097307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.097307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:35.097307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:35.097307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.097307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:35.097307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:35.097307 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:35.098048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:35.098886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:35.098886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.098886 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:35.098886 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:35.098886 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:35.098886 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:35.098886 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:55:35.098886 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:35.099310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.099813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:35.099813 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:35.099813 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:35.099813 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:35.099813 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:35.099813 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:35.099813 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.099813 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:35.100565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.100565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:35.100565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:35.100565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:35.100565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.100565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:35.100565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:35.100565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:35.100565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.100565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:35.100565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:35.100565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:35.100565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:35.100565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:35.100565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:35.101284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:35.101284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:35.101284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:35.101284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:35.101284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:35.101284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:35.101284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:35.101284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.101284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:35.101779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.101779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:35.101779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:35.101779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:35.101779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.101779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:35.101779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:35.101779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:55:35.101779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:35.101779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:35.101779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.101779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:35.102319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:35.102319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:35.102319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.102319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:35.102319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:35.102319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:35.102319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:35.102319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:35.102319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:35.102319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:35.102319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:35.102319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:35.102319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:35.102319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:35.102966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:35.102966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:35.102966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.102966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:35.102966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.102966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:35.102966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:35.102966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:35.102966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:35.102966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:35.102966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.102966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:35.102966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:35.102966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:35.103761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:35.104600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:35.104600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:35.104600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:35.104600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:35.104600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:35.104600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:35.104600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:35.104600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:35.104600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:35.104600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:35.104600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.104600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:35.104600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:35.105168 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:35.105168 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:35.105168 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:35.105525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:35.105908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.106660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:35.106660 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:35.106660 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:35.106660 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:35.106660 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:35.106660 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:35.106660 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.106660 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:35.107439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.107439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:35.107439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:35.107439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:35.107439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.107439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:35.107439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:35.107439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:35.107439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.107439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:35.107439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:35.107439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:35.107439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:35.107439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:35.107439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:35.107730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:35.107730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:35.107730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:35.107730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:35.107730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:35.107730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:35.107730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:35.107730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.107730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:35.108289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.108289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:35.108289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:35.108289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:35.108289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.108289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:35.108289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:35.108289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:35.108289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:35.108289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.108289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:35.108529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:35.108529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:35.108529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.108529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:35.108529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:35.108529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:35.108529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:35.108529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:35.108529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:35.108529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:35.108529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:35.108529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:35.108529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:35.108529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:35.108770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:35.108770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:35.108770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.108770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.109680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:35.110006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:35.110339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:35.110339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:35.110339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.110339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:35.111241 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:35.111513 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:35.111623 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:35.111773 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:35.112137 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:35.112412 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:35.112571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.113100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:35.113100 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:35.113100 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:35.113100 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:35.113100 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:35.113100 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:35.113100 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.113100 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:35.113970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.113970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:35.113970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:35.113970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:35.113970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.113970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:35.113970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:35.113970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.113970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:35.113970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:35.113970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:35.113970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.114224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:35.114224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:35.114224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:35.114224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:35.114224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:35.114224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:35.114224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:35.114224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:35.114224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:35.114224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:35.114224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:35.114224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:35.114224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:35.114568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.114568 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:35.115130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.115130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:35.115130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:35.115130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:35.115130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:35.115130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:35.115130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.115130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:35.115130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:35.115130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.115130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:35.115130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:35.115130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.115130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:35.115130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:35.115130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:35.115643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:35.116175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:35.116175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:35.116175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:39.865556 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:39.866540 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:39.866540 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:39.867595 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:39.901763 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:39.902159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:39.903096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:39.903096 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:39.903096 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:39.903096 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:39.903096 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:39.903096 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:39.903096 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:39.903096 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:39.904215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:39.904215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:39.904215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:39.904215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:39.904215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:39.904215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:39.904215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:39.904215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:39.904215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:39.904215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:39.904215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:39.904215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:39.904929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:39.904929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:39.904929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:39.904929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:39.904929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:39.904929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:39.904929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:39.904929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:39.904929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:39.904929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:39.904929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:39.904929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:39.904929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:39.905662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:39.905662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:39.905662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:39.905662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:39.905662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:39.905662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:39.905662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:39.905662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:39.905662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:39.905662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:39.905662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:39.905662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:39.905662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:39.905662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:39.905662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:39.906478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:39.907514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:39.907514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:39.907514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:39.907514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:39.907514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:39.907514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:40.091048 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:40.091732 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:40.091960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:40.093107 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:40.093537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:40.093834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.094786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:40.094786 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:40.094786 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:40.094786 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:40.094786 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:40.094786 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:40.094786 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.094786 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:40.096332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.096332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:40.096332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:40.096332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:40.096332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.096332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:40.096332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:40.096332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.096332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:40.096332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:40.096332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:40.096332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.097019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:40.097019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:40.097019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:40.097019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:40.097019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:40.097019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:40.097019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:40.097019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:40.097019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:40.097019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:40.097019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:40.097019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:40.097019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:40.097653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.097653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:40.098192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.098192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:40.098192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:40.098192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:40.098192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:40.098192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:40.098192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.098192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:40.098192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:40.098192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.098192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:40.098192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:40.098192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.098192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:40.098192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:40.098192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:40.099022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:40.099971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:40.099971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.099971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:40.099971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:40.099971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:40.099971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:40.099971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:55:40.099971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:40.100447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.100908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:40.100908 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:40.100908 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:40.100908 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:40.100908 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:40.100908 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:40.100908 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.100908 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:40.102030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.102030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:40.102030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:40.102030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:40.102030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.102030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:40.102030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:40.102030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:40.102030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.102030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:40.102030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:40.102030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:40.102030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:40.102030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:40.102030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:40.102890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:40.102890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:40.102890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:40.102890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:40.102890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:40.102890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:40.102890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:40.102890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.102890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:40.103524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.103524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:40.103524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:40.103524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:40.103524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.103524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:40.103524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:40.103524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:55:40.103524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:40.103524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:40.103524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.103524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:40.104156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:40.104156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:40.104156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.104156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:40.104156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:40.104156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:40.104156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:40.104156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:40.104156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:40.104156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:40.104156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:40.104156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:40.104156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:40.104156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:40.104656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:40.104656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:40.104656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.104656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:40.105392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.105392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:40.105392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:40.105392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:40.105392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:40.105392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:40.105392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.105392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:40.105392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:40.105392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.105392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:40.105392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:40.105392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.105392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:40.105392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:40.105392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:40.105851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:40.106425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:40.106425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:40.106425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:40.106425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:40.106425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:40.106425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.106425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:40.106425 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:40.106425 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:40.106425 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:40.106759 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:40.106759 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:40.106759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.106888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:40.106888 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:40.106888 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:40.106888 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:40.106888 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:40.106888 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:40.106888 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.106888 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:40.107386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.107386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:40.107386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:40.107386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:40.107386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.107386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:40.107386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:40.107386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:40.107386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.107386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:40.107386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:40.107386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:40.107386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:40.107386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:40.107386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:40.107840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:40.107840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:40.107840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:40.107840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:40.107840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:40.107840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:40.107840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:40.107840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.107840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:40.108076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.108076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:40.108076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:40.108076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:40.108076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.108076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:40.108076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:40.108076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:40.108076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:40.108076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.108076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:40.108416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:40.108416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:40.108416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.108416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:40.108416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:40.108416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:40.108416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:40.108416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:40.108416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:40.108416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:40.108416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:40.108416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:40.108416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:40.108416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:40.108841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:40.108841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:40.108841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.108841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:40.108841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.108841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:40.108841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:40.108841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:40.108841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:40.108841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:40.108841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.108841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:40.108841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:40.108841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:40.109253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:40.109802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:40.109802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:40.109802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:40.109802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:40.109802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:40.109802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:40.109802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:40.109802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:40.109802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:40.109802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.109802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:40.111684 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:40.111916 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:40.111988 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:40.112100 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:40.112654 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:40.112943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:40.113085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.113610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:40.113610 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:40.113610 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:40.113610 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:40.113610 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:40.113610 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:40.113610 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.113610 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:40.114488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.114488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:40.114488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:40.114488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:40.114488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.114488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:40.114488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:40.114488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.114488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:40.114488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:40.114488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:40.114488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.114858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:40.114858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:40.114858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:40.114858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:40.114858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:40.114858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:40.114858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:40.114858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:40.114858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:40.114858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:40.114858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:40.114858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:40.114858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:40.115183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.115183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:40.115521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.115521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:40.115521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:40.115521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:40.115521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:40.115521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:40.115521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.115521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:40.115521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:40.115521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.115521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:40.115521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:40.115521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.115521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:40.115521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:40.115521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:40.116062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:40.116649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:40.116649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:40.116649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:44.866002 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:44.866885 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:44.867048 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:44.868480 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:44.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:44.905769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:44.907001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:44.907001 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:44.907001 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:44.907001 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:44.907001 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:44.907001 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:44.907001 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:44.907001 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:44.907723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:44.907723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:44.907723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:44.907723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:44.907723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:44.907723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:44.907723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:44.907723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:44.907723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:44.907723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:44.907723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:44.907723 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:44.908361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:44.908361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:44.908361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:44.908361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:44.908361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:44.908361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:44.908361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:44.908361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:44.908361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:44.908361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:44.908361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:44.908361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:44.908361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:44.908941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:44.908941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:44.908941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:44.908941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:44.908941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:44.908941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:44.908941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:44.908941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:44.908941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:44.908941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:44.908941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:44.908941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:44.908941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:44.908941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:44.908941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:44.909620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:44.910407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:44.910407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:44.910407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:44.910407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:44.910407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:44.910407 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:45.091643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:45.092255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:45.092494 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:45.093481 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:45.093766 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:45.093976 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.094801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:45.094801 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:45.094801 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:45.094801 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:45.094801 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:45.094801 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:45.094801 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.094801 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:45.096231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.096231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:45.096231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:45.096231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:45.096231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.096231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:45.096231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:45.096231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.096231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:45.096231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:45.096231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:45.096231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.096765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:45.096765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:45.096765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:45.096765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:45.096765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:45.096765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:45.096765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:45.096765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:45.096765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:45.096765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:45.096765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:45.096765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:45.096765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:45.097391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.097391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:45.097858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.097858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:45.097858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:45.097858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:45.097858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:45.097858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:45.097858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.097858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:45.097858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:45.097858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.097858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:45.097858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:45.097858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.097858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:45.097858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:45.097858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:45.098601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:45.099520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:45.099520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.099520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:45.099520 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:45.099520 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:45.099520 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:45.099520 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:55:45.100173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:45.100963 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.101506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:45.101506 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:45.101506 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:45.101506 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:45.101506 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:45.101506 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:45.101506 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.101506 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:45.102199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.102199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:45.102199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:45.102199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:45.102199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.102199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:45.102199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:45.102199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:45.102199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.102199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:45.102199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:45.102199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:45.102199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:45.102199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:45.102199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:45.102917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:45.102917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:45.102917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:45.102917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:45.102917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:45.102917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:45.102917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:45.102917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.102917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:45.103330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.103330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:45.103330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:45.103330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:45.103330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.103330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:45.103330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:45.103330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:55:45.103330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:45.103330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:45.103330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.103330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:45.104128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:45.104128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:45.104128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.104128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:45.104128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:45.104128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:45.104128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:45.104128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:45.104128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:45.104128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:45.104128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:45.104128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:45.104128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:45.104128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:45.104731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:45.104731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:45.104731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.104731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:45.104731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.104731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:45.104731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:45.104731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:45.104731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:45.104731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:45.104731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.104731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:45.104731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:45.104731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:45.105015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:45.105462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:45.105462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:45.105462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:45.105462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:45.105462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:45.105462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:45.105462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:45.105462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:45.105462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:45.105462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:45.105462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.105462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:45.106201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:45.106486 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:45.106593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:45.106728 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:45.107233 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:45.107744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.108602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:45.108602 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:45.108602 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:45.108602 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:45.108602 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:45.108602 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:45.108602 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.108602 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:45.109316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.109316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:45.109316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:45.109316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:45.109316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.109316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:45.109316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:45.109316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:45.109316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.109316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:45.109316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:45.109316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:45.109316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:45.109316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:45.109316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:45.109674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:45.109674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:45.109674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:45.109674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:45.109674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:45.109674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:45.109674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:45.109674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.109674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:45.110246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.110246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:45.110246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:45.110246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:45.110246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.110246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:45.110246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:45.110246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:45.110246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:45.110246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.110246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:45.110824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:45.110824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:45.110824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.110824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:45.110824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:45.110824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:45.110824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:45.110824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:45.110824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:45.110824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:45.110824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:45.110824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:45.110824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:45.110824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:45.111244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:45.111244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:45.111244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.111244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.111334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:45.111826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:45.112406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:45.112406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:45.112406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.112406 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:45.112406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:45.112406 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:45.112730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:45.112730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:45.113197 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:45.113270 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:45.113510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.114006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:45.114006 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:45.114006 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:45.114006 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:45.114006 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:45.114006 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:45.114006 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.114006 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:45.114793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.114793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:45.114793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:45.114793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:45.114793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.114793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:45.114793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:45.114793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.114793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:45.114793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:45.114793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:45.114793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.115350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:45.115350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:45.115350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:45.115350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:45.115350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:45.115350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:45.115350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:45.115350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:45.115350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:45.115350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:45.115350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:45.115350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:45.115350 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:45.115762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.115762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:45.115827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.115827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:45.115827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:45.115827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:45.115827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:45.115827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:45.115827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.115827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:45.115827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:45.115827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.115827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:45.115827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:45.115827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.115827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:45.115827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:45.115827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:45.116352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:45.116945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:45.116945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:45.116945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:49.866799 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:49.867483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:49.867483 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:49.868060 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:49.899686 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:49.900193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:49.901356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:49.901356 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:49.901356 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:49.901356 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:49.901356 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:49.901356 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:49.901356 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:49.901356 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:49.902411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:49.902411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:49.902411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:49.902411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:49.902411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:49.902411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:49.902411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:49.902411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:49.902411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:49.902411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:49.902411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:49.902411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:49.902816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:49.902816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:49.902816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:49.902816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:49.902816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:49.902816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:49.902816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:49.902816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:49.902816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:49.902816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:49.902816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:49.902816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:49.902816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:49.903205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:49.903205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:49.903567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:49.903567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:49.903567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:49.903567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:49.903567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:49.903567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:49.903567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:49.903567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:49.903567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:49.903567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:49.903567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:49.903567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:49.903567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:49.903567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:49.903567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:49.903567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:49.905032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:49.906953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:49.906953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:49.906953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:50.092353 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:50.092976 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:50.093171 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:50.094552 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:50.094869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:50.095204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.097551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:50.097551 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:50.097551 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:50.097551 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:50.097551 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:50.097551 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:50.097551 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.097551 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:50.097967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.097967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:50.097967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:50.097967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:50.097967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.097967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:50.097967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:50.097967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.097967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:50.097967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:50.097967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:50.097967 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.098353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:50.098353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:50.098353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:50.098353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:50.098353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:50.098353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:50.098353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:50.098353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:50.098353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:50.098353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:50.098353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:50.098353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:50.098353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:50.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.098739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:50.099767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.099767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:50.099767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:50.099767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:50.099767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:50.099767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:50.099767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.099767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:50.099767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:50.099767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.099767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:50.099767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:50.099767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.099767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:50.099767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:50.099767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:50.100280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:50.100894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:50.100894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.100894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:50.100894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:50.100894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:50.100894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:50.100894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:55:50.101297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:50.101584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.102266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:50.102266 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:50.102266 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:50.102266 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:50.102266 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:50.102266 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:50.102266 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.102266 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:50.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:50.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:50.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:50.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:50.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:50.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:50.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:50.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:50.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:50.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:50.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:50.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:50.103590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:50.103590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:50.103590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:50.103590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:50.103590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:50.103590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:50.103590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:50.103590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.103590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:50.103939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.103939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:50.103939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:50.103939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:50.103939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.103939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:50.103939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:50.103939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:55:50.103939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:50.103939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:50.103939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.103939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:50.104298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:50.104298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:50.104298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.104298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:50.104298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:50.104298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:50.104298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:50.104298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:50.104298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:50.104298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:50.104298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:50.104298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:50.104298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:50.104298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:50.104691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:50.104691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:50.104691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.104691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:50.104975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.104975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:50.104975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:50.104975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:50.104975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:50.104975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:50.104975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.104975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:50.104975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:50.104975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.104975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:50.104975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:50.104975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.104975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:50.104975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:50.104975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:50.105498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:50.106102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:50.106102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:50.106102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:50.106102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:50.106102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:50.106102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.106102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:50.106700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:50.107004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:50.107152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:50.107319 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:50.107848 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:50.108151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.108786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:50.108786 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:50.108786 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:50.108786 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:50.108786 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:50.108786 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:50.108786 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.108786 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:50.109644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.109644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:50.109644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:50.109644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:50.109644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.109644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:50.109644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:50.109644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:50.109644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.109644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:50.109644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:50.109644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:50.109644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:50.109644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:50.109644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:50.110107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:50.110107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:50.110107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:50.110107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:50.110107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:50.110107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:50.110107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:50.110107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.110107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:50.110546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.110546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:50.110546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:50.110546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:50.110546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.110546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:50.110546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:50.110546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:50.110546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:50.110546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.110546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:50.110903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:50.110903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:50.110903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.110903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:50.110903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:50.110903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:50.110903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:50.110903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:50.110903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:50.110903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:50.110903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:50.110903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:50.110903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:50.110903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:50.111319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:50.111319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:50.111319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.111319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:50.112104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:50.112671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:50.112671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:50.112671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.112671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:50.112671 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:50.112940 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:50.112940 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:50.113028 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:50.113487 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:50.113720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:50.113869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.114397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:50.114397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:50.114397 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:50.114397 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:50.114397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:50.114397 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:50.114397 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.114397 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:50.115218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.115218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:50.115218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:50.115218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:50.115218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.115218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:50.115218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:50.115218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.115218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:50.115218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:50.115218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:50.115218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.115629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:50.115629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:50.115629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:50.115629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:50.115629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:50.115629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:50.115629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:50.115629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:50.115629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:50.115629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:50.115629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:50.115629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:50.115629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:50.116012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.116012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:50.116192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.116192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:50.116192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:50.116192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:50.116192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:50.116192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:50.116192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.116192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:50.116192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:50.116192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.116192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:50.116192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:50.116192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.116192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:50.116192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:50.116192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:50.116710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:50.117327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:50.117327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:50.117327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:54.867491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:54.868319 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:54.868319 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:54.869653 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:54.872748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=434 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:55:54.904182 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:54.904681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:54.905928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:54.905928 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:54.905928 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:54.905928 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:54.905928 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:54.905928 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:54.905928 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:54.905928 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:54.907052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:54.907052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:54.907052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:54.907052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:54.907052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:54.907052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:54.907052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:54.907052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:54.907052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:54.907052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:54.907052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:54.907052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:54.907771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:54.907771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:54.907771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:54.907771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:54.907771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:54.907771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:54.907771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:54.907771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:54.907771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:54.907771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:54.907771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:54.907771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:54.907771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:54.908386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:54.908386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:54.908386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:54.908386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:54.908386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:54.908386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:54.908386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:54.908386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:54.908386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:54.908386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:54.908386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:54.908386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:54.908386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:54.908386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:54.908386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:54.909104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:54.910008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:54.910008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:54.910008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:54.910008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:54.910008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:54.910008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:55.093030 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:55.094034 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:55.094279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:55.095924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:55.096345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:55.096721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.097851 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:55.097851 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:55.097851 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:55.097851 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:55.097851 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:55.097851 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:55.097851 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.097851 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:55.099531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.099531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:55.099531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:55.099531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:55.099531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.099531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:55.099531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:55.099531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.099531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:55.099531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:55.099531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:55.099531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.100140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:55.100140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:55.100140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:55.100140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:55.100140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:55.100140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:55.100140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:55.100140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:55.100140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:55.100140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:55.100140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:55.100140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:55.100140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:55.100728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.100728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:55.101412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.101412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:55.101412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:55.101412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:55.101412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:55.101412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:55.101412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.101412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:55.101412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:55.101412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.101412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:55.101412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:55.101412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.101412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:55.101412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:55.101412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:55.102115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:55.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:55.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:55.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:55.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:55.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:55.102979 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:55:55.103324 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:55.103741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.104361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:55.104361 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:55.104361 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:55.104361 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:55.104361 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:55.104361 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:55.104361 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.104361 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:55.105134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.105134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:55.105134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:55.105134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:55.105134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.105134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:55.105134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:55.105134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:55.105134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.105134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:55.105134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:55.105134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:55.105134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:55.105134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:55.105134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:55.105822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:55.105822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:55.105822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:55.105822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:55.105822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:55.105822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:55.105822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:55.105822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.105822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:55.106070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.106070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:55.106070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:55.106070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:55.106070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.106070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:55.106070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:55.106070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:55:55.106070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:55.106070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:55.106070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.106070 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:55.106440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:55.106440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:55.106440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.106440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:55.106440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:55.106440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:55.106440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:55.106440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:55.106440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:55.106440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:55.106440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:55.106440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:55.106440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:55.106440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:55.106807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:55.106807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:55.106807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.106807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:55.106956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.106956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:55.106956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:55.106956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:55.106956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:55.106956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:55.106956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.106956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:55.106956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:55.106956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.106956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:55.106956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:55.106956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.106956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:55.106956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:55.106956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:55.107398 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:55.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:55.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:55.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:55.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:55.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:55.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:55.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:55.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:55.107894 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:55.108211 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:55.108211 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:55.108502 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.109045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:55.109045 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:55.109045 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:55.109045 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:55.109045 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:55.109045 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:55.109045 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.109045 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:55.109919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.109919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:55:55.109919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:55.109919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:55.109919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.109919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:55.109919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:55.109919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:55.109919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.109919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:55:55.109919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:55.109919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:55:55.109919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:55.109919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:55:55.109919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:55:55.110385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:55.110385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:55:55.110385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:55.110385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:55:55.110385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:55:55.110385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:55.110385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:55:55.110385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.110385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:55:55.110782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.110782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:55.110782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:55.110782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:55.110782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.110782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:55.110782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:55.110782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:55.110782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:55.110782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.110782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:55.111117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:55.111117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:55.111117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.111117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:55.111117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:55.111117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:55.111117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:55.111117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:55.111117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:55.111117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:55.111117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:55.111117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:55.111117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:55.111117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:55.111534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:55.111534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:55.111534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.111534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.111937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:55.112425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:55.112943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:55.112943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:55.112943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.112943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:55.112943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:55.113272 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:55.113353 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:55.113529 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:55.113921 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:55.114157 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:55.114313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.114938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:55.114938 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:55.114938 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:55.114938 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:55.114938 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:55.114938 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:55.114938 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.114938 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:55.115875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.115875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:55.115875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:55.115875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:55.115875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.115875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:55.115875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:55.115875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.115875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:55.115875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:55.115875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:55.115875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.116233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:55.116233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:55.116233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:55.116233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:55.116233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:55.116233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:55.116233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:55.116233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:55.116233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:55.116233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:55.116233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:55.116233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:55.116233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:55.116596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.116596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:55.116833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.116833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:55.116833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:55.116833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:55.116833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:55.116833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:55.116833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.116833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:55.116833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:55.116833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.116833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:55.116833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:55.116833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.116833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:55.116833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:55.116833 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:55.117321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:55.117896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:55.117896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:55.117896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:55:59.868263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:55:59.869263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:55:59.869263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:55:59.870566 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:55:59.910879 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:55:59.911385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:59.912268 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:55:59.912268 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:59.912268 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:55:59.912268 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:55:59.912268 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:59.912268 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:55:59.912268 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:59.912268 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:55:59.913041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:59.913041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:55:59.913041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:59.913041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:55:59.913041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:59.913041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:59.913041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:59.913041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:59.913041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:59.913041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:59.913041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:59.913041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:59.913731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:55:59.913731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:59.913731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:55:59.913731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:59.913731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:55:59.913731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:55:59.913731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:59.913731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:55:59.913731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:59.913731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:55:59.913731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:55:59.913731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:59.913731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:55:59.915038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:59.915038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:55:59.915038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:59.915038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:55:59.915038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:55:59.915038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:55:59.915038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:55:59.915038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:55:59.915038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:59.915038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:55:59.915038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:55:59.915038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:59.915038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:55:59.915038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:55:59.915038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:55:59.915774 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:55:59.917693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:55:59.917693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:55:59.917693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:55:59.917693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:55:59.917693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:55:59.917693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:00.093749 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:00.094355 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:00.094528 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:00.095466 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:00.095791 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:00.096069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.096895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:00.096895 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:00.096895 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:00.096895 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:00.096895 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:00.096895 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:00.096895 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.096895 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:00.098061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.098061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:00.098061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:00.098061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:00.098061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.098061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:00.098061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:00.098061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.098061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:00.098061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:00.098061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:00.098061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.098683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:00.098683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:00.098683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:00.098683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:00.098683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:00.098683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:00.098683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:00.098683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:00.098683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:00.098683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:00.098683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:00.098683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:00.098683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:00.099183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.099183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:00.099183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.099183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:00.099183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:00.099183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:00.099183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:00.099183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:00.099183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.099183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:00.099183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:00.099183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.099183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:00.099183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:00.099183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:00.099826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:00.100576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:00.100576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:00.100576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:00.100576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:00.100576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.100576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:00.102153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:00.102469 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:00.102563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:00.102684 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:56:00.103125 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:00.103487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.104183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:00.104183 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:00.104183 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:00.104183 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:00.104183 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:00.104183 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:00.104183 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.104183 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:00.104927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.104927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:00.104927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:00.104927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:00.104927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.104927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:00.104927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:00.104927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:00.104927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.104927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:00.104927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:00.104927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:00.104927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:00.104927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:00.104927 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:00.105355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:00.105355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:00.105355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:00.105355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:00.105355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:00.105355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:00.105355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:00.105355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.105355 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:00.105743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.105743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:00.105743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:00.105743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:00.105743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.105743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:00.105743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:00.105743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:56:00.105743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:00.105743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:00.105743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.105743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:00.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:00.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:00.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:00.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:00.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:00.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:00.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:00.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:00.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:00.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:00.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:00.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:00.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:00.106810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:00.106810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:00.106810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.106810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:00.107035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.107035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:00.107035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:00.107035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:00.107035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:00.107035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:00.107035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.107035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:00.107035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:00.107035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.107035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:00.107035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:00.107035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.107035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:00.107035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:00.107035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:00.107750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:00.108217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:00.108217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:00.108217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:00.108217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:00.108217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:00.108217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.108217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:00.108217 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:00.108217 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:00.108217 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:00.108517 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:00.108709 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:00.109036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.109778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:00.109778 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:00.109778 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:00.109778 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:00.109778 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:00.109778 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:00.109778 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.109778 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:00.110562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.110562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:00.110562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:00.110562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:00.110562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.110562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:00.110562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:00.110562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:00.110562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.110562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:00.110562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:00.110562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:00.110562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:00.110562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:00.110562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:00.111359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:00.111359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:00.111359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:00.111359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:00.111359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:00.111359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:00.111359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:00.111359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.111359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:00.111856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.111856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:00.111856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:00.111856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:00.111856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.111856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:00.111856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:00.111856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:00.111856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:00.111856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.111856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:00.112295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:00.112295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:00.112295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.112295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:00.112295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:00.112295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:00.112295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:00.112295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:00.112295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:00.112295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:00.112295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:00.112295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:00.112295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:00.112295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:00.112657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:00.112657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:00.112657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.112657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:00.112657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.112657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:00.112657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:00.112657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:00.112657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:00.112657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:00.112657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.112657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:00.112657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:00.112657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:00.113009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:00.113488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:00.113488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:00.113488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:00.113488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:00.113488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:00.113488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:00.113488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:00.113488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:00.113488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:00.113488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.113488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:00.113488 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:00.113805 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:00.113805 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:00.114100 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:00.114541 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:00.114901 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:00.115133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.115875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:00.115875 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:00.115875 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:00.115875 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:00.115875 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:00.115875 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:00.115875 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.115875 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:00.116858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.116858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:00.116858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:00.116858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:00.116858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.116858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:00.116858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:00.116858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.116858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:00.116858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:00.116858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:00.116858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.117190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:00.117190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:00.117190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:00.117190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:00.117190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:00.117190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:00.117190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:00.117190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:00.117190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:00.117190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:00.117190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:00.117190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:00.117190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:00.117548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.117548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:00.118062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.118062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:00.118062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:00.118062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:00.118062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:00.118062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:00.118062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.118062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:00.118062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:00.118062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.118062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:00.118062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:00.118062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.118062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:00.118062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:00.118062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:00.118580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:00.119093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:00.119093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:00.119093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:04.869027 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:04.869961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:04.870037 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:04.871407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:04.906221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:04.906510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:04.907198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:04.907198 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:04.907198 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:04.907198 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:04.907198 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:04.907198 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:04.907198 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:04.907198 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:04.908242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:04.908242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:04.908242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:04.908242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:04.908242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:04.908242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:04.908242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:04.908242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:04.908242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:04.908242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:04.908242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:04.908242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:04.908868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:04.908868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:04.908868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:04.908868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:04.908868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:04.908868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:04.908868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:04.908868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:04.908868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:04.908868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:04.908868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:04.908868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:04.908868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:04.909476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:04.909476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:04.909476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:04.909476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:04.909476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:04.909476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:04.909476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:04.909476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:04.909476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:04.909476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:04.909476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:04.909476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:04.909476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:04.909476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:04.909476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:04.910172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:04.911035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:04.911035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:04.911035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:04.911035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:04.911035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:04.911035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:05.094570 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:05.095260 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:05.095577 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:05.096715 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:05.097073 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:05.097301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.098314 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:05.098314 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:05.098314 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:05.098314 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:05.098314 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:05.098314 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:05.098314 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.098314 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:05.099815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.099815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:05.099815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:05.099815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:05.099815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.099815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:05.099815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:05.099815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.099815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:05.099815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:05.099815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:05.099815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.100461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:05.100461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:05.100461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:05.100461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:05.100461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:05.100461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:05.100461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:05.100461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:05.100461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:05.100461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:05.100461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:05.100461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:05.100461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:05.101062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.101062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:05.101637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.101637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:05.101637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:05.101637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:05.101637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:05.101637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:05.101637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.101637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:05.101637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:05.101637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.101637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:05.101637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:05.101637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.101637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:05.101637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:05.101637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:05.102429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:05.103296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:05.103296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.103296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:05.103296 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:05.103296 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:05.103296 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:05.103296 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:56:05.103687 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:05.103863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.104587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:05.104587 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:05.104587 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:05.104587 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:05.104587 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:05.104587 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:05.104587 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.104587 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:05.105280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.105280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:05.105280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:05.105280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:05.105280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.105280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:05.105280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:05.105280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:05.105280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.105280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:05.105280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:05.105280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:05.105280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:05.105280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:05.105280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:05.106056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:05.106056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:05.106056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:05.106056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:05.106056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:05.106056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:05.106056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:05.106056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.106056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:05.106534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.106534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:05.106534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:05.106534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:05.106534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.106534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:05.106534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:05.106534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:56:05.106534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:05.106534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:05.106534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.106534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:05.107118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:05.107118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:05.107118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.107118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:05.107118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:05.107118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:05.107118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:05.107118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:05.107118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:05.107118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:05.107118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:05.107118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:05.107118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:05.107118 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:05.107810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:05.107810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:05.107810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.107810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:05.107810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.107810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:05.107810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:05.107810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:05.107810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:05.107810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:05.107810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.107810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:05.107810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:05.107810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:05.108508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:05.109405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:05.109405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:05.109405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:05.109405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:05.109405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:05.109405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:05.109405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:05.109405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:05.109405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:05.109405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:05.109405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.109405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:05.109405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:05.109405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:05.110114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:05.110114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:05.110114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:05.110114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.110114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:05.110114 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:05.110114 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:05.110114 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:05.110114 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:05.110114 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:05.110114 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.110114 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:05.111063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.111063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:05.111063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:05.111063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:05.111063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.111063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:05.111063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:05.111063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:05.111063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.111063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:05.111063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:05.111063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:05.111063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:05.111063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:05.111063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:05.111386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:05.111386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:05.111386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:05.111386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:05.111386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:05.111386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:05.111386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:05.111386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.111386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:05.112290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.112290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:05.112290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:05.112290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:05.112290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.112290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:05.112290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:05.112290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:05.112290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:05.112290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.112290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:05.112540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:05.112540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:05.112540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.112540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:05.112540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:05.112540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:05.112540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:05.112540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:05.112540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:05.112540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:05.112540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:05.112540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:05.112540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:05.112540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:05.112806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:05.112806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:05.112806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.112806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.113852 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:05.114193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:05.114594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:05.114594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:05.114594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.114594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:05.114594 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:05.114594 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:05.114725 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:05.114878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:05.115148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:05.115375 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:05.115528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.116090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:05.116090 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:05.116090 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:05.116090 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:05.116090 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:05.116090 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:05.116090 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.116090 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:05.116955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.116955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:05.116955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:05.116955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:05.116955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.116955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:05.116955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:05.116955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.116955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:05.116955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:05.116955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:05.116955 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.117202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:05.117202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:05.117202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:05.117202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:05.117202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:05.117202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:05.117202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:05.117202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:05.117202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:05.117202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:05.117202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:05.117202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:05.117202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:05.117473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.117473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:05.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:05.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:05.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:05.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:05.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:05.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:05.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:05.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:05.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:05.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:05.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:05.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:05.118445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:05.118826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:05.118826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:05.118826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:09.870166 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:09.871284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:09.871284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:09.871801 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:09.903667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:09.904294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:09.904933 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:09.904933 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:09.904933 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:09.904933 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:09.904933 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:09.904933 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:09.904933 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:09.904933 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:09.905918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:09.905918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:09.905918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:09.905918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:09.905918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:09.905918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:09.905918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:09.905918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:09.905918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:09.905918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:09.905918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:09.905918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:09.906608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:09.906608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:09.906608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:09.906608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:09.906608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:09.906608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:09.906608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:09.906608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:09.906608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:09.906608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:09.906608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:09.906608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:09.906608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:09.907236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:09.907236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:09.907236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:09.907236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:09.907236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:09.907236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:09.907236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:09.907236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:09.907236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:09.907236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:09.907236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:09.907236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:09.907236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:09.907236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:09.907236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:09.908000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:09.910569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:09.910569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:09.910569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:09.910569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:09.910569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:09.910569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:10.095199 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:10.096011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:10.096206 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:10.097450 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:10.097803 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:10.098043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.099103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:10.099103 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:10.099103 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:10.099103 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:10.099103 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:10.099103 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:10.099103 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.099103 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:10.101003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.101003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:10.101003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:10.101003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:10.101003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.101003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:10.101003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:10.101003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.101003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:10.101003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:10.101003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:10.101003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.102351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:10.102351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:10.102351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:10.102351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:10.102351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:10.102351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:10.102351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:10.102351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:10.102351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:10.102351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:10.102351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:10.102351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:10.102351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:10.103009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.103009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:10.103106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.103106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:10.103106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:10.103106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:10.103106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:10.103106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:10.103106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.103106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:10.103106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:10.103106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.103106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:10.103106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:10.103106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.103106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:10.103106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:10.103106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:10.103792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:10.105638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:10.105638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.105638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:10.105638 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:10.105638 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:10.105638 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:10.105638 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:56:10.105638 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:10.106505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.106505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:10.106505 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:10.106505 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:10.106505 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:10.106505 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:10.106505 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:10.106505 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.106505 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:10.107424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.107424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:10.107424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:10.107424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:10.107424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.107424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:10.107424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:10.107424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:10.107424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.107424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:10.107424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:10.107424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:10.107424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:10.107424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:10.107424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:10.108351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:10.108351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:10.108351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:10.108351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:10.108351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:10.108351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:10.108351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:10.108351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.108351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:10.108351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.108351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:10.108351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:10.108351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:10.108351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.109113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:10.109113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:10.109113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:56:10.109113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:10.109113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:10.109113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.109113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:10.109113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:10.109113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:10.109113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.109113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:10.109113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:10.109113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:10.109469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:10.109469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:10.109469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:10.109469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:10.109469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:10.109469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:10.109469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:10.109469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:10.109469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:10.109469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:10.109469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.109469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:10.109696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.109696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:10.109696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:10.109696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:10.109696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:10.109696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:10.109696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.109696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:10.109696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:10.109696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.109696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:10.109696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:10.109696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.109696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:10.109696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:10.109696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:10.110018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:10.110400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:10.110400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:10.110400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:10.110400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:10.110400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:10.110400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.110400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:10.110400 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:10.110400 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:10.110400 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:10.110635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:10.110635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:10.110635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:10.110993 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:10.110993 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:10.110993 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:10.110993 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:10.110993 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:10.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:10.111751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.111751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:10.111751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:10.111751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:10.111751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.111751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:10.111751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:10.111751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:10.111751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.111751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:10.111751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:10.111751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:10.111751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:10.111751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:10.111751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:10.112088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:10.112088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:10.112088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:10.112088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:10.112088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:10.112088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:10.112088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:10.112088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.112088 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:10.112656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.112656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:10.112656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:10.112656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:10.112656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.112656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:10.112656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:10.112656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:10.112656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:10.112656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.112656 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:10.112924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:10.112924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:10.112924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.112924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:10.112924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:10.112924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:10.112924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:10.112924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:10.112924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:10.112924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:10.112924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:10.112924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:10.112924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:10.112924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:10.113208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:10.113208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:10.113208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.113208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.113690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:10.114040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:10.114410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:10.114410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:10.114410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.114410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:10.114630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:10.114967 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:10.115074 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:10.115230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:10.115674 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:10.116089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:10.116313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.117156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:10.117156 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:10.117156 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:10.117156 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:10.117156 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:10.117156 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:10.117156 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.117156 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:10.118035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.118035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:10.118035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:10.118035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:10.118035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.118035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:10.118035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:10.118035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.118035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:10.118035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:10.118035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:10.118035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.118359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:10.118359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:10.118359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:10.118359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:10.118359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:10.118359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:10.118359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:10.118359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:10.118359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:10.118359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:10.118359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:10.118359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:10.118359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:10.118733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.118733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:10.119004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.119004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:10.119004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:10.119004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:10.119004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:10.119004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:10.119004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.119004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:10.119004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:10.119004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.119004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:10.119004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:10.119004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.119004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:10.119004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:10.119004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:10.119504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:10.120020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:10.120020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:10.120020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:14.870896 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:14.871753 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:14.871753 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:14.872189 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:14.917069 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:14.918297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:14.919465 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:14.919465 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:14.919465 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:14.919465 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:14.919465 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:14.919465 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:14.919465 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:14.919465 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:14.922011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.048 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:14.922011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:14.922011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:14.922011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:14.922011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:14.922011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:14.922011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:14.922011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:14.922011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:14.922011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:14.922011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:14.922011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:14.922560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:14.922560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:14.922560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:14.922560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:14.922560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:14.922560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:14.922560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:14.922560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:14.922560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:14.922560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:14.922560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:14.922560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:14.922560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:14.923059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:14.923059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:14.923059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:14.923059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:14.923059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:14.923059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:14.923059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:14.923059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:14.923059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:14.923059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:14.923059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:14.923059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:14.923059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:14.923059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:14.923059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:14.923637 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:14.924287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:14.924287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:14.924287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:14.924287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:14.924287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:14.924287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:15.096024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:15.098852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:15.098852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:15.098852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:15.099075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:15.099491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.102469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:15.102469 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:15.102469 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:15.102469 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:15.102469 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:15.102469 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:15.102469 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.102469 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:15.102469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.102469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:15.102469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:15.102469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:15.102469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.102469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:15.102469 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:15.102819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.102819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:15.102819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:15.102819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:15.102819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.102819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:15.102819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:15.102819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:15.102819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:15.102819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:15.102819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:15.102819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:15.102819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:15.102819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:15.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:15.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:15.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:15.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:15.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:15.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:15.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:15.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:15.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:15.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:15.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.103108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:15.103884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:15.104633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:15.104633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:15.104633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:15.104633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:15.104633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:15.104633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:15.104633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:15.104633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:15.104633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.104633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:15.104633 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:15.105448 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:15.105448 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:15.105448 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:56:15.105772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:15.106009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.108764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:15.109150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:15.109150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:15.109150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:15.109150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:15.109150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:15.109150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:15.109150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:15.109150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:15.109150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:15.109150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:15.109150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:15.109150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:15.109150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.109150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:15.109150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.109519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:15.109519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:15.109519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:15.109519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.109519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:15.109519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:15.109519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:56:15.109519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:15.109519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:15.109519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.109519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:15.109519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:15.109519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:15.109782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.109782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:15.109782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:15.109782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:15.109782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:15.109782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:15.109782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:15.109782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:15.109782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:15.109782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:15.109782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:15.109782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:15.109782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:15.109782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:15.110027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.110027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:15.110027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.110027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:15.110027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:15.110027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:15.110027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:15.110027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:15.110027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.110027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:15.110027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:15.110027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.110027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:15.110027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:15.110027 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:15.110292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:15.110748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:15.110748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:15.110748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:15.110748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:15.110748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:15.110748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:15.110748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:15.110748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.110748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:15.110748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:15.111524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:15.111524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:15.111524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:15.112815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:15.113128 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.115681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:15.116401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:15.116401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:15.116401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:15.116401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:15.116401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:15.116401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:15.116401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:15.116401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:15.116401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:15.116401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:15.116401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:15.116401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:15.116401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.116401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:15.116401 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.116741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:15.116741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:15.116741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:15.116741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.116741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:15.116741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:15.116741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:15.116741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:15.116741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.116741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:15.116741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:15.116741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:15.116741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.117076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:15.117076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:15.117076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:15.117076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:15.117076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:15.117076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:15.117076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:15.117076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:15.117076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:15.117076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:15.117076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:15.117076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:15.117076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:15.117297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.117297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.119382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:15.119762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:15.120115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:15.120115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:15.120115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.120115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:15.121507 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:15.123906 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:15.124243 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:15.124667 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:15.125285 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:15.125717 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:15.125964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.126953 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:15.126953 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:15.126953 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:15.126953 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:15.126953 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:15.126953 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:15.126953 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.126953 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:15.129461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.129461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:15.129461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:15.129461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:15.129461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.129461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:15.129461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:15.129461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.129461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:15.129461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:15.129461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:15.129461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.129910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:15.129910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:15.129910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:15.129910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:15.129910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:15.129910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:15.129910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:15.129910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:15.129910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:15.129910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:15.129910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:15.129910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:15.129910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:15.130297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.130297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:15.132727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.132727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:15.132727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:15.132727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:15.132727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:15.132727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:15.132727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.132727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:15.132727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:15.132727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.132727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:15.132727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:15.132727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.132727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:15.132727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:15.132727 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:15.133273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:15.134036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:15.134036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:15.134036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:19.871560 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:19.872730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:19.872730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:19.872908 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:19.902059 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:19.902455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:19.903301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:19.903301 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:19.903301 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:19.903301 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:19.903301 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:19.903301 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:19.903301 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:19.903301 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:19.904321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.031 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:19.904321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:19.904321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:19.904321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:19.904321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:19.904321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:19.904321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:19.904321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:19.904321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:19.904321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:19.904321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:19.904321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:19.906122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:19.906122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:19.906122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:19.906122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:19.906122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:19.906122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:19.906122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:19.906122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:19.906122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:19.906122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:19.906122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:19.906122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:19.906122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:19.907273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:19.907273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:19.907273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:19.907273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:19.907273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:19.907273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:19.907273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:19.907273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:19.907273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:19.907273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:19.907273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:19.907273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:19.907273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:19.907273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:19.907273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:19.907925 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:19.909869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:19.909869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:19.909869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:19.909869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:19.909869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:19.909869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:20.097754 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:20.098154 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:20.098154 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:20.099053 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:20.099309 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:20.099557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.100467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:20.100467 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:20.100467 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:20.100467 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:20.100467 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:20.100467 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:20.100467 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.100467 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:20.101508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.101508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:20.101508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:20.101508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:20.101508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.101508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:20.101508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:20.101508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.101508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:20.101508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:20.101508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:20.101508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.101916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:20.101916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:20.101916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:20.101916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:20.101916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:20.101916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:20.101916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:20.101916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:20.101916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:20.101916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:20.101916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:20.101916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:20.101916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:20.102297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.102297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:20.106556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.106556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:20.106556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:20.106556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:20.106556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:20.106556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:20.106556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.106556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:20.106556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:20.106556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.106556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:20.106556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:20.106556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.106556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:20.106556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:20.106556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:20.107176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:20.107739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:20.107739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.107739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:20.107739 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:20.107739 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:20.107739 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:20.107739 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:56:20.107739 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:20.108005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:20.110689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.110689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:20.110689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:20.110689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:20.110689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:20.110689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:20.110689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:20.110689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:20.110689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:20.110689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:20.110689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:20.110689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:20.110689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:20.110689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:20.110689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.110689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:20.111038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.111038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:20.111038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:20.111038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:20.111038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.111038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:20.111038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:20.111038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:56:20.111038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:20.111038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:20.111038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.111038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:20.111311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:20.111311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:20.111311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.111311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:20.111311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:20.111311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:20.111311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:20.111311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:20.111311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:20.111311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:20.111311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:20.111311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:20.111311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:20.111311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:20.111616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:20.111616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:20.111616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.111616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:20.111616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.111616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:20.111616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:20.111616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:20.111616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:20.111616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:20.111616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.111616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:20.111616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:20.111616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:20.111929 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:20.112311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:20.112311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:20.112311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:20.112311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:20.112311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:20.112311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:20.112311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:20.112311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:20.112311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:20.112311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:20.112311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.112311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:20.112311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:20.112311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:20.112614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:20.112614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:20.112614 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:20.113147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.113986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:20.113986 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:20.113986 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:20.113986 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:20.113986 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:20.113986 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:20.113986 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.113986 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:20.114798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.114798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:20.114798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:20.114798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:20.114798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.114798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:20.114798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:20.114798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:20.114798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.114798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:20.114798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:20.114798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:20.114798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:20.114798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:20.114798 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:20.115276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:20.115276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:20.115276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:20.115276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:20.115276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:20.115276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:20.115276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:20.115276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.115276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:20.115738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.115738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:20.115738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:20.115738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:20.115738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.115738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:20.115738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:20.115738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:20.115738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:20.115738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.115738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:20.116205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:20.116205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:20.116205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.116205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:20.116205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:20.116205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:20.116205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:20.116205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:20.116205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:20.116205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:20.116205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:20.116205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:20.116205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:20.116205 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:20.116608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:20.116608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:20.116608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.116608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.117629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:20.118102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:20.118655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:20.118655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:20.118655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.118655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:20.123696 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:20.124287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:20.124433 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:20.124677 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:20.125261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:20.125603 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:20.125792 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.126824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:20.126824 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:20.126824 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:20.126824 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:20.126824 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:20.126824 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:20.126824 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.126824 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:20.127876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.127876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:20.127876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:20.127876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:20.127876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.127876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:20.127876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:20.127876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.127876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:20.127876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:20.127876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:20.127876 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.128150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:20.128150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:20.128150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:20.128150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:20.128150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:20.128150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:20.128150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:20.128150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:20.128150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:20.128150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:20.128150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:20.128150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:20.128150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:20.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:20.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:20.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:20.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:20.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:20.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:20.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:20.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:20.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:20.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:20.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:20.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:20.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:20.131555 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:20.131932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:20.131932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:20.131932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:24.874692 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:24.877502 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:24.877502 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:24.877502 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:24.920742 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:24.921049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:24.922145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:24.922145 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:24.922145 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:24.922145 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:24.922145 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:24.922145 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:24.922145 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:24.922145 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:24.924797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.046 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:24.924797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:24.924797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:24.924797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:24.924797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:24.924797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:24.924797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:24.924797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:24.924797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:24.924797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:24.924797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:24.924797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:24.925172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:24.925172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:24.925172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:24.925172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:24.925172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:24.925172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:24.925172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:24.925172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:24.925172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:24.925172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:24.925172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:24.925172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:24.925172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:24.925679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:24.925679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:24.925679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:24.925679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:24.925679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:24.925679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:24.925679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:24.925679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:24.925679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:24.925679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:24.925679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:24.925679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:24.925679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:24.925679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:24.925679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:24.926248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:24.926985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:24.926985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:24.926985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:24.926985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:24.926985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:24.926985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:25.097959 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:25.100625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:25.100625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:25.100971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:25.101090 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:25.101341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.102935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:25.102935 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:25.102935 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:25.102935 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:25.102935 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:25.102935 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:25.102935 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.102935 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:25.106062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.106062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:25.106062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:25.106062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:25.106062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.106062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:25.106062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:25.106062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.106062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:25.106062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:25.106062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:25.106062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.106464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:25.106464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:25.106464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:25.106464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:25.106464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:25.106464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:25.106464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:25.106464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:25.106464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:25.106464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:25.106464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:25.106464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:25.106464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:25.106832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.106832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:25.108030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.108030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:25.108030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:25.108030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:25.108030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:25.108030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:25.108030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.108030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:25.108030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:25.108030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.108030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:25.108030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:25.108030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.108030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:25.108030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:25.108030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:25.109110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:25.111231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:25.111231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.111231 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:25.111231 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:25.111231 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:25.111231 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:25.111231 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:56:25.111796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:25.112210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:25.112446 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.115607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:25.116324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:25.116324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:25.116324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:25.116324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:25.116324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:25.116324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:25.116324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:25.116324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:25.116324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:25.116324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:25.116324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:25.116324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:25.116324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.116324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:25.116324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.116821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:25.116821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:25.116821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:25.116821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.116821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:25.116821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:25.116821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:56:25.116821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:25.116821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:25.116821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.116821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:25.116821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:25.116821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:25.117074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.117074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:25.117074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:25.117074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:25.117074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:25.117074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:25.117074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:25.117074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:25.117074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:25.117074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:25.117074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:25.117074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:25.117074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:25.117074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:25.117501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.117501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:25.117501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.117501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:25.117501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:25.117501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:25.117501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:25.117501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:25.117501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.117501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:25.117501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:25.117501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.117501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:25.117501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:25.117501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:25.117789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:25.118168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:25.118168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:25.118168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:25.118168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:25.118168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:25.118168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:25.118168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:25.118168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.118168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:25.118168 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:25.118168 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:25.118168 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:25.118435 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:25.118435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.119772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:25.119772 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:25.119772 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:25.119772 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:25.119772 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:25.119772 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:25.119772 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.119772 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:25.121411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.121411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:25.121411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:25.121411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:25.121411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.121411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:25.121411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:25.121411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:25.121411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.121411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:25.121411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:25.121411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:25.121411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:25.121411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:25.121411 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:25.123525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:25.123525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:25.123525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:25.123525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:25.123525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:25.123525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:25.123525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:25.123525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.123525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:25.123525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.006 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.123525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:25.123525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:25.123525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:25.123525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.123816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:25.123816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:25.123816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:25.123816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:25.123816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.123816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:25.123816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:25.123816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:25.123816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.123816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:25.123816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:25.123816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:25.123816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:25.124076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:25.124076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:25.124076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:25.124076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:25.124076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:25.124076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:25.124076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:25.124076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:25.124076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:25.124076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.124076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:25.124076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:25.124528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.124947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:25.126730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:25.127533 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:25.127533 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:25.127533 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:25.128093 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:25.128859 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:25.129084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.130503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:25.130503 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:25.130503 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:25.130503 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:25.130503 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:25.130503 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:25.130503 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.130503 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:25.130900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.130900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:25.130900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:25.130900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:25.130900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.130900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:25.130900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:25.130900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.130900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:25.130900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:25.130900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:25.130900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.131297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:25.131297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:25.131297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:25.131297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:25.131297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:25.131297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:25.131297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:25.131297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:25.131297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:25.131297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:25.131297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:25.131297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:25.131297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:25.131673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.131673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:25.133201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.133201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:25.133201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:25.133201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:25.133201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:25.133201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:25.133201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.133201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:25.133201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:25.133201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.133201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:25.133201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:25.133201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.133201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:25.133201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:25.133201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:25.133789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:25.134348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:25.134348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:25.134348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:29.876097 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:29.877112 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:29.877318 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:29.879030 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:29.916035 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:29.916035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:29.916466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:29.916466 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:29.916466 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:29.916466 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:29.916466 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:29.916466 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:29.916466 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:29.916466 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:29.917596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:29.917596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:29.917596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:29.917596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:29.917596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:29.917596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:29.917596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:29.917596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:29.917596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:29.917596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:29.917596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:29.917596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:29.918081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:29.918081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:29.918081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:29.918081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:29.918081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:29.918081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:29.918081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:29.918081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:29.918081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:29.918081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:29.918081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:29.918081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:29.918081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:29.918584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:29.918584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:29.919144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:29.919144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:29.919144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:29.919144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:29.919144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:29.919144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:29.919144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:29.919144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:29.919144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:29.919144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:29.919144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:29.919144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:29.919144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:29.919144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:29.919144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:29.919144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:29.920041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:29.920699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:29.920699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:29.920699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:30.098970 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:30.099811 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:30.099997 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:30.101513 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:30.101843 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:30.101843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.102629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:30.102629 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:30.102629 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:30.102629 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:30.102629 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:30.102629 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:30.102629 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.102629 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:30.104452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.104452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:30.104452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:30.104452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:30.104452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.104452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:30.104452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:30.104452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.104452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:30.104452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:30.104452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:30.104452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.104880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:30.104880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:30.104880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:30.104880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:30.104880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:30.104880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:30.104880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:30.104880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:30.104880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:30.104880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:30.104880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:30.104880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:30.104880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:30.105235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.105235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:30.107694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.107694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:30.107694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:30.107694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:30.107694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:30.107694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:30.107694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.107694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:30.107694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:30.107694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.107694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:30.107694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:30.107694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.107694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:30.107694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:30.107694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:30.108248 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:30.108921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:30.108921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.108921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:30.110796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:30.111411 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:30.111411 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:30.111411 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:56:30.112078 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:30.112288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.112932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:30.112932 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:30.112932 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:30.112932 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:30.112932 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:30.112932 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:30.112932 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.112932 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:30.113553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.113553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:30.113553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:30.113553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:30.113553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.113553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:30.113553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:30.113553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:30.113553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.113553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:30.113553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:30.113553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:30.113553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:30.113553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:30.113553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:30.114107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:30.114107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:30.114107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:30.114107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:30.114107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:30.114107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:30.114107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:30.114107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.114107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:30.114436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.114436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:30.114436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:30.114436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:30.114436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.114436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:30.114436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:30.114436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:56:30.114436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:30.114436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:30.114436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.114436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:30.114817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:30.114817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:30.114817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.114817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:30.114817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:30.114817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:30.114817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:30.114817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:30.114817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:30.114817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:30.114817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:30.114817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:30.114817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:30.114817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:30.115318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:30.115318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:30.115318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.115318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:30.115318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.115318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:30.115318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:30.115318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:30.115318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:30.115318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:30.115318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.115318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:30.115318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:30.115318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:30.115764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:30.116301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:30.116301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:30.116301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:30.116301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:30.116301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:30.116301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:30.116301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:30.116301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:30.116301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:30.116301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:30.116301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.116301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:30.116301 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:30.119778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:30.119778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:30.119778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:30.119778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:30.119778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.119778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:30.119778 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:30.119778 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:30.119778 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:30.120276 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:30.120276 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:30.120276 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.120276 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:30.120276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.120276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:30.120276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:30.120276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:30.120276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.120276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:30.120276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:30.120276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:30.120276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.120276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:30.120276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:30.120276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:30.120813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:30.120813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:30.120813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:30.120813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:30.120813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:30.120813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:30.120813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:30.120813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:30.120813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:30.120813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:30.120813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.120813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:30.120813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.120813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:30.121269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:30.121269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:30.121269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.121269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:30.121269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:30.121269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:30.121269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:30.121269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.121269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:30.121269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:30.121269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:30.121269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.121269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:30.121770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:30.121770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:30.121770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:30.121770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:30.121770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:30.121770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:30.121770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:30.121770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:30.121770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:30.121770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:30.121770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:30.121770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:30.121770 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.122194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.122389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:30.122789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:30.123167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:30.123167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:30.123167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.123167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:30.127306 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:30.127616 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:30.128016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:30.128325 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:30.129992 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:30.130221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:30.130388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.131423 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:30.131423 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:30.131423 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:30.131423 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:30.131423 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:30.131423 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:30.131423 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.131423 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:30.132989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.132989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:30.132989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:30.132989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:30.132989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.132989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:30.132989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:30.132989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.132989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:30.132989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:30.132989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:30.132989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.133968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:30.133968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:30.133968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:30.133968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:30.133968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:30.133968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:30.133968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:30.133968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:30.133968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:30.133968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:30.133968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:30.133968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:30.133968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:30.134396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.134396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:30.135254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.135254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:30.135254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:30.135254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:30.135254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:30.135254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:30.135254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.135254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:30.135254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:30.135254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.135254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:30.135254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:30.135254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.135254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:30.135254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:30.135254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:30.135797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:30.136337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:30.136337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:30.136337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:34.876998 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:34.877719 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:34.877889 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:34.879322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:34.920282 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:34.920421 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:34.920823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:34.920823 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:34.920823 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:34.920823 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:34.920823 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:34.920823 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:34.920823 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:34.920823 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:34.921476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:34.921476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:34.921476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:34.921476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:34.921476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:34.921476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:34.921476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:34.921476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:34.921476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:34.921476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:34.921476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:34.921476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:34.921870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:34.921870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:34.921870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:34.921870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:34.921870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:34.921870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:34.921870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:34.921870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:34.921870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:34.921870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:34.921870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:34.921870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:34.921870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:34.922215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:34.922215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:34.922295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:34.922295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:34.922295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:34.922295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:34.922295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:34.922295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:34.922295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:34.922295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:34.922295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:34.922295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:34.922295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:34.922295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:34.922295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:34.922295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:34.922295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:34.922295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:34.922759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:34.923283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:34.923283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:34.923283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:35.099661 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:35.100116 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:35.100313 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:35.101225 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:35.101566 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:35.101789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.102703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:35.102703 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:35.102703 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:35.102703 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:35.102703 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:35.102703 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:35.102703 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.102703 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:35.104306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.104306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:35.104306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:35.104306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:35.104306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.104306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:35.104306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:35.104306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.104306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:35.104306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:35.104306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:35.104306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.104966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:35.104966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:35.104966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:35.104966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:35.104966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:35.104966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:35.104966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:35.104966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:35.104966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:35.104966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:35.104966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:35.104966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:35.104966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:35.105586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.105586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:35.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:35.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:35.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:35.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:35.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:35.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:35.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:35.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:35.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:35.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:35.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:35.106086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:35.106854 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:35.107726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:35.107726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.107726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:35.111201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:35.111477 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:35.111591 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:35.111707 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:56:35.111961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:35.112139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.112616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:35.112616 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:35.112616 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:35.112616 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:35.112616 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:35.112616 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:35.112616 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.112616 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:35.113354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.113354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:35.113354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:35.113354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:35.113354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.113354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:35.113354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:35.113354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:35.113354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.113354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:35.113354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:35.113354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:35.113354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:35.113354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:35.113354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:35.113831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:35.113831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:35.113831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:35.113831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:35.113831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:35.113831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:35.113831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:35.113831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.113831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:35.114208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.114208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:35.114208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:35.114208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:35.114208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.114208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:35.114208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:35.114208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:56:35.114208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:35.114208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:35.114208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.114208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:35.114566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:35.114566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:35.114566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.114566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:35.114566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:35.114566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:35.114566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:35.114566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:35.114566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:35.114566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:35.114566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:35.114566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:35.114566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:35.114566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:35.114960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:35.114960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:35.114960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.114960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:35.115321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.115321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:35.115321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:35.115321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:35.115321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:35.115321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:35.115321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.115321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:35.115321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:35.115321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.115321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:35.115321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:35.115321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.115321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:35.115321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:35.115321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:35.115779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:35.116251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:35.116251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:35.116251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:35.116251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:35.116251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:35.116251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.116251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:35.116251 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:35.116663 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:35.116944 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:35.117227 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:35.117722 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:35.118056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.118554 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:35.118554 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:35.118554 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:35.118554 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:35.118554 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:35.118554 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:35.118554 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.118554 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:35.119295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.119295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:35.119295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:35.119295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:35.119295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.119295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:35.119295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:35.119295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:35.119295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.119295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:35.119295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:35.119295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:35.119295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:35.119295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:35.119295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:35.119737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:35.119737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:35.119737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:35.119737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:35.119737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:35.119737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:35.119737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:35.119737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.119737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:35.120218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.120218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:35.120218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:35.120218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:35.120218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.120218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:35.120218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:35.120218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:35.120218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:35.120218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.120218 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:35.120564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:35.120564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:35.120564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.120564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:35.120564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:35.120564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:35.120564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:35.120564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:35.120564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:35.120564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:35.120564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:35.120564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:35.120564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:35.120564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:35.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:35.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:35.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.121758 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:35.122246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:35.122781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:35.122781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:35.122781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.122781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:35.127577 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:35.127813 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:35.127932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:35.128099 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:35.128346 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:35.128650 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:35.128800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.129256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:35.129256 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:35.129256 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:35.129256 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:35.129256 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:35.129256 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:35.129256 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.129256 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:35.130119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.130119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:35.130119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:35.130119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:35.130119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.130119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:35.130119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:35.130119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.130119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:35.130119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:35.130119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:35.130119 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.130516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:35.130516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:35.130516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:35.130516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:35.130516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:35.130516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:35.130516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:35.130516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:35.130516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:35.130516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:35.130516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:35.130516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:35.130516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:35.130858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.130858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:35.131102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.131102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:35.131102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:35.131102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:35.131102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:35.131102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:35.131102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.131102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:35.131102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:35.131102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.131102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:35.131102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:35.131102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.131102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:35.131102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:35.131102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:35.131573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:35.132086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:35.132086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:35.132086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:39.878052 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:39.878704 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:39.878843 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:39.879760 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:39.909922 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:39.910105 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:39.911234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:39.911234 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:39.911234 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:39.911234 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:39.911234 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:39.911234 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:39.911234 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:39.911234 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:39.913674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.032 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:39.913674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:39.913674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:39.913674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:39.913674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:39.913674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:39.913674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:39.913674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:39.913674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:39.913674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:39.913674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:39.913674 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:39.914013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:39.914013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:39.914013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:39.914013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:39.914013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:39.914013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:39.914013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:39.914013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:39.914013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:39.914013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:39.914013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:39.914013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:39.914013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:39.914321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:39.914321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:39.915508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:39.915508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:39.915508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:39.915508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:39.915508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:39.915508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:39.915508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:39.915508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:39.915508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:39.915508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:39.915508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:39.915508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:39.915508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:39.915508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:39.915508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:39.915508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:39.915921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:39.916352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:39.916352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:39.916352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:40.100971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:40.101765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:40.101966 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:40.103204 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:40.103611 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:40.103896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.104973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:40.104973 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:40.104973 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:40.104973 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:40.104973 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:40.104973 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:40.104973 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.104973 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:40.106646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.106646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:40.106646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:40.106646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:40.106646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.106646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:40.106646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:40.106646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.106646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:40.106646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:40.106646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:40.106646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.106916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:40.106916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:40.106916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:40.106916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:40.106916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:40.106916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:40.106916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:40.106916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:40.106916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:40.106916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:40.106916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:40.106916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:40.106916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:40.107164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.107164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:40.108276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.108276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:40.108276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:40.108276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:40.108276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:40.108276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:40.108276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.108276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:40.108276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:40.108276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.108276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:40.108276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:40.108276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.108276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:40.108276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:40.108276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:40.108629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:40.108982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:40.108982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.108982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:40.111632 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:40.111972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:40.112086 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:40.112208 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:56:40.112683 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:40.112930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.113651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:40.113651 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:40.113651 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:40.113651 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:40.113651 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:40.113651 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:40.113651 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.113651 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:40.114481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.114481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:40.114481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:40.114481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:40.114481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.114481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:40.114481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:40.114481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:40.114481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.114481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:40.114481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:40.114481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:40.114481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:40.114481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:40.114481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:40.114836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:40.114836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:40.114836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:40.114836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:40.114836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:40.114836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:40.114836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:40.114836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.114836 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:40.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:40.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:40.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:40.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:40.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:40.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:56:40.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:40.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:40.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:40.115669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:40.115669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:40.115669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.115669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:40.115669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:40.115669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:40.115669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:40.115669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:40.115669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:40.115669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:40.115669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:40.115669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:40.115669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:40.115669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:40.115977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:40.115977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:40.115977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.115977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:40.117222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.117222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:40.117222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:40.117222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:40.117222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:40.117222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:40.117222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.117222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:40.117222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:40.117222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.117222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:40.117222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:40.117222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.117222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:40.117222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:40.117222 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:40.117586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:40.117995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:40.117995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:40.117995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:40.117995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:40.117995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:40.117995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.117995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:40.117995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:40.117995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:40.117995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:40.118204 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:40.118514 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:40.118772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.119272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:40.119272 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:40.119272 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:40.119272 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:40.119272 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:40.119272 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:40.119272 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.119272 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:40.120045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.120045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:40.120045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:40.120045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:40.120045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.120045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:40.120045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:40.120045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:40.120045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.120045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:40.120045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:40.120045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:40.120045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:40.120045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:40.120045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:40.120328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:40.120328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:40.120328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:40.120328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:40.120328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:40.120328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:40.120328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:40.120328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.120328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:40.121226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.121226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:40.121226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:40.121226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:40.121226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.121226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:40.121226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:40.121226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:40.121226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:40.121226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.121226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:40.121492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:40.121492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:40.121492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.121492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:40.121492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:40.121492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:40.121492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:40.121492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:40.121492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:40.121492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:40.121492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:40.121492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:40.121492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:40.121492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:40.121777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:40.121777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:40.121777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.121777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.122052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:40.122431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:40.122778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:40.122778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:40.122778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.122778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:40.127961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:40.128720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:40.128778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:40.128884 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:40.129395 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:40.129797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:40.130020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.130802 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:40.130802 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:40.130802 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:40.130802 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:40.130802 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:40.130802 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:40.130802 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.130802 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:40.131884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.131884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:40.131884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:40.131884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:40.131884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.131884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:40.131884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:40.131884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.131884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:40.131884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:40.131884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:40.131884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.132165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:40.132165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:40.132165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:40.132165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:40.132165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:40.132165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:40.132165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:40.132165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:40.132165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:40.132165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:40.132165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:40.132165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:40.132165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:40.132444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.132444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:40.133057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.133057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:40.133057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:40.133057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:40.133057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:40.133057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:40.133057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.133057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:40.133057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:40.133057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.133057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:40.133057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:40.133057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.133057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:40.133057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:40.133057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:40.133397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:40.133787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:40.133787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:40.133787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:44.878764 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:44.879477 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:44.879477 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:44.880247 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:44.912985 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:44.913336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:44.914545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:44.914545 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:44.914545 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:44.914545 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:44.914545 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:44.914545 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:44.914545 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:44.914545 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:44.915015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:44.915015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:44.915015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:44.915015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:44.915015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:44.915015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:44.915015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:44.915015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:44.915015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:44.915015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:44.915015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:44.915015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:44.915682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:44.915682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:44.915682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:44.915682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:44.915682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:44.915682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:44.915682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:44.915682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:44.915682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:44.915682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:44.915682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:44.915682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:44.915682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:44.916301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:44.916301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:44.916301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:44.916301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:44.916301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:44.916301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:44.916301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:44.916301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:44.916301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:44.916301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:44.916301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:44.916301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:44.916301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:44.916301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:44.916301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:44.917155 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:44.918960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:44.918960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:44.918960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:44.918960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:44.918960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:44.918960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:45.101793 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:45.102178 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:45.102473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:45.103378 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:45.103645 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:45.103868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.104561 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:45.104561 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:45.104561 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:45.104561 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:45.104561 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:45.104561 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:45.104561 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.104561 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:45.105926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.105926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:45.105926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:45.105926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:45.105926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.105926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:45.105926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:45.105926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.105926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:45.105926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:45.105926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:45.105926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.106575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:45.106575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:45.106575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:45.106575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:45.106575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:45.106575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:45.106575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:45.106575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:45.106575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:45.106575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:45.106575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:45.106575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:45.106575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:45.107157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.107157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:45.107558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.107558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:45.107558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:45.107558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:45.107558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:45.107558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:45.107558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.107558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:45.107558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:45.107558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.107558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:45.107558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:45.107558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.107558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:45.107558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:45.107558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:45.108110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:45.108650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:45.108650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.108650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:45.112079 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:45.112394 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:45.112499 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:45.112628 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:56:45.112982 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:45.113186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.113731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:45.113731 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:45.113731 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:45.113731 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:45.113731 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:45.113731 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:45.113731 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.113731 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:45.114540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.114540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:45.114540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:45.114540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:45.114540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.114540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:45.114540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:45.114540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:45.114540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.114540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:45.114540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:45.114540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:45.114540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:45.114540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:45.114540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:45.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:45.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:45.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:45.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:45.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:45.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:45.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:45.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:45.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:45.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:45.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:45.115340 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.116047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:45.116047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:45.116047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:56:45.116047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:45.116047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:45.116047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.116047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:45.116047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:45.116047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:45.116047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.116047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:45.116047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:45.116047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:45.116686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:45.116686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:45.116686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:45.116686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:45.116686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:45.116686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:45.116686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:45.116686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:45.116686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:45.116686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:45.116686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.116686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:45.117262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.117262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:45.117262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:45.117262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:45.117262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:45.117262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:45.117262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.117262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:45.117262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:45.117262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.117262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:45.117262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:45.117262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.117262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:45.117262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:45.117262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:45.118097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:45.119021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:45.119021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:45.119021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:45.119021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:45.119021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:45.119021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.119021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:45.119021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:45.119021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:45.119021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:45.119518 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:45.119518 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:45.119518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.119671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:45.119671 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:45.119671 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:45.119671 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:45.119671 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:45.119671 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:45.119671 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.119671 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:45.120389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.120389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:45.120389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:45.120389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:45.120389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.120389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:45.120389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:45.120389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:45.120389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.120389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:45.120389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:45.120389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:45.120389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:45.120389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:45.120389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:45.121054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:45.121054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:45.121054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:45.121054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:45.121054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:45.121054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:45.121054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:45.121054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.121054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:45.121494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.121494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:45.121494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:45.121494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:45.121494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.121494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:45.121494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:45.121494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:45.121494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:45.121494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.121494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:45.122036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:45.122036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:45.122036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.122036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:45.122036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:45.122036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:45.122036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:45.122036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:45.122036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:45.122036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:45.122036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:45.122036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:45.122036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:45.122036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:45.122839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:45.122839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:45.122839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.122839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:45.122839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.122839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:45.122839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:45.122839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:45.122839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:45.122839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:45.122839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.122839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:45.122839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:45.122839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:45.123145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:45.123558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:45.123558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:45.123558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:45.123558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:45.123558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:45.123558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:45.123558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:45.123558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:45.123558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:45.123558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.123558 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:45.128771 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:45.129073 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:45.129194 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:45.129347 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:45.129723 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:45.129971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:45.130123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.131074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:45.131074 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:45.131074 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:45.131074 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:45.131074 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:45.131074 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:45.131074 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.131074 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:45.131910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.131910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:45.131910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:45.131910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:45.131910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.131910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:45.131910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:45.131910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.131910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:45.131910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:45.131910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:45.131910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.132526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:45.132526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:45.132526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:45.132526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:45.132526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:45.132526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:45.132526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:45.132526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:45.132526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:45.132526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:45.132526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:45.132526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:45.132526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:45.133131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.133131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:45.133131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.133131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:45.133131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:45.133131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:45.133131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:45.133131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:45.133131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.133131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:45.133131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:45.133131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.133131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:45.133131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:45.133131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:45.133853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:45.134794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:45.134794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:45.134794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:45.134794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:45.134794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:45.134794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:49.879510 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:49.880153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:49.880399 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:49.881707 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:49.916151 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:49.916476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:49.917167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:49.917167 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:49.917167 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:49.917167 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:49.917167 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:49.917167 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:49.917167 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:49.917167 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:49.918135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:49.918135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:49.918135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:49.918135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:49.918135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:49.918135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:49.918135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:49.918135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:49.918135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:49.918135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:49.918135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:49.918135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:49.918728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:49.918728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:49.918728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:49.918728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:49.918728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:49.918728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:49.918728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:49.918728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:49.918728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:49.918728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:49.918728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:49.918728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:49.918728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:49.919400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:49.919400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:49.919400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:49.919400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:49.919400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:49.919400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:49.919400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:49.919400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:49.919400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:49.919400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:49.919400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:49.919400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:49.919400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:49.919400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:49.919400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:49.920121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:49.921135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:49.921135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:49.921135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:49.921135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:49.921135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:49.921135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:50.102452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:50.103029 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:50.103289 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:50.104535 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:50.104891 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:50.105122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.106038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:50.106038 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:50.106038 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:50.106038 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:50.106038 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:50.106038 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:50.106038 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.106038 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:50.107566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.107566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:50.107566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:50.107566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:50.107566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.107566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:50.107566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:50.107566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.107566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:50.107566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:50.107566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:50.107566 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.108107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:50.108107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:50.108107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:50.108107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:50.108107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:50.108107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:50.108107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:50.108107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:50.108107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:50.108107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:50.108107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:50.108107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:50.108107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:50.108738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.108738 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:50.109189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.109189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:50.109189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:50.109189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:50.109189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:50.109189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:50.109189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.109189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:50.109189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:50.109189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.109189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:50.109189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:50.109189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.109189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:50.109189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:50.109189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:50.110021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:50.111084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:50.111084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.111084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:50.112568 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:50.113028 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:50.113198 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:50.113392 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:56:50.113888 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:50.114236 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.115003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:50.115003 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:50.115003 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:50.115003 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:50.115003 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:50.115003 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:50.115003 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.115003 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:50.116319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.116319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:50.116319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:50.116319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:50.116319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.116319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:50.116319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:50.116319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:50.116319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.116319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:50.116319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:50.116319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:50.116319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:50.116319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:50.116319 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:50.117020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:50.117020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:50.117020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:50.117020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:50.117020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:50.117020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:50.117020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:50.117020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.117020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:50.117725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.117725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:50.117725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:50.117725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:50.117725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.117725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:50.117725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:50.117725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:56:50.117725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:50.117725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:50.117725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.117725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:50.118063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:50.118063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:50.118063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.118063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:50.118063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:50.118063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:50.118063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:50.118063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:50.118063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:50.118063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:50.118063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:50.118063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:50.118063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:50.118063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:50.118440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:50.118440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:50.118440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.118440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:50.119689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.119689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:50.119689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:50.119689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:50.119689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:50.119689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:50.119689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.119689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:50.119689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:50.119689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.119689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:50.119689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:50.119689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.119689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:50.119689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:50.119689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:50.120140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:50.120721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:50.120721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:50.120721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:50.120721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:50.120721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:50.120721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.120721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:50.120721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:50.120721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:50.120721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:50.120993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:50.121188 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:50.121584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.122292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:50.122292 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:50.122292 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:50.122292 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:50.122292 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:50.122292 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:50.122292 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.122292 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:50.123087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.123087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:50.123087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:50.123087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:50.123087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.123087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:50.123087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:50.123087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:50.123087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.123087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:50.123087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:50.123087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:50.123087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:50.123087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:50.123087 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:50.123507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:50.123507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:50.123507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:50.123507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:50.123507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:50.123507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:50.123507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:50.123507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.123507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:50.123922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.123922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:50.123922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:50.123922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:50.123922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.123922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:50.123922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:50.123922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:50.123922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:50.123922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.123922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:50.124224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:50.124224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:50.124224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.124224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:50.124224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:50.124224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:50.124224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:50.124224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:50.124224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:50.124224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:50.124224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:50.124224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:50.124224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:50.124224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:50.124613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:50.124613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:50.124613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.124613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.124999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:50.125449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:50.125942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:50.125942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:50.125942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.125942 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:50.129207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:50.129505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:50.129661 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:50.129762 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:50.130170 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:50.130551 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:50.130766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.131474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:50.131474 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:50.131474 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:50.131474 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:50.131474 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:50.131474 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:50.131474 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.131474 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:50.132259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.132259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:50.132259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:50.132259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:50.132259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.132259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:50.132259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:50.132259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.132259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:50.132259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:50.132259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:50.132259 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.132589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:50.132589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:50.132589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:50.132589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:50.132589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:50.132589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:50.132589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:50.132589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:50.132589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:50.132589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:50.132589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:50.132589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:50.132589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:50.132946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.132946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:50.133204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.133204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:50.133204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:50.133204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:50.133204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:50.133204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:50.133204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.133204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:50.133204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:50.133204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.133204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:50.133204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:50.133204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.133204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:50.133204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:50.133204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:50.133669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:50.134320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:50.134320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:50.134320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:54.880293 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:54.881081 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:54.881081 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:54.882255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:54.885103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:56:54.920084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:54.920322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:54.920885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:54.920885 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:54.920885 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:54.920885 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:54.920885 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:54.920885 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:54.920885 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:54.920885 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:54.921704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:54.921704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:54.921704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:54.921704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:54.921704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:54.921704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:54.921704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:54.921704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:54.921704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:54.921704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:54.921704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:54.921704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:54.922042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:54.922042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:54.922042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:54.922042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:54.922042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:54.922042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:54.922042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:54.922042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:54.922042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:54.922042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:54.922042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:54.922042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:54.922042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:54.922383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:54.922383 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:54.923206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:54.923206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:54.923206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:54.923206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:54.923206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:54.923206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:54.923206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:54.923206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:54.923206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:54.923206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:54.923206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:54.923206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:54.923206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:54.923206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:54.923206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:54.923206 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:54.923694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:54.924257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:54.924257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:54.924257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:55.103048 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:55.103585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:55.103716 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:55.104822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:55.105215 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:55.105871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.106790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:55.106790 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:55.106790 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:55.106790 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:55.106790 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:55.106790 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:55.106790 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.106790 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:55.108226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.108226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:55.108226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:55.108226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:55.108226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.108226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:55.108226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:55.108226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.108226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:55.108226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:55.108226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:55.108226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.108844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:55.108844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:55.108844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:55.108844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:55.108844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:55.108844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:55.108844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:55.108844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:55.108844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:55.108844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:55.108844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:55.108844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:55.108844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:55.109306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.109306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:55.110296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.110296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:55.110296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:55.110296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:55.110296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:55.110296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:55.110296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.110296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:55.110296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:55.110296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.110296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:55.110296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:55.110296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.110296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:55.110296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:55.110296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:55.111015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:55.111678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:55.111678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.111678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:55.112923 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:55.113322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:55.113322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:55.113322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:56:55.114656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:55.114973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.117280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:55.117280 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:55.117280 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:55.117280 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:55.117280 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:55.117280 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:55.117280 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.117280 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:55.118066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.118066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:55.118066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:55.118066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:55.118066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.118066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:55.118066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:55.118066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:55.118066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.118066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:55.118066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:55.118066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:55.118066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:55.118066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:55.118066 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:55.118776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:55.118776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:55.118776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:55.118776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:55.118776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:55.118776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:55.118776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:55.118776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.118776 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:55.119246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.119246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:55.119246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:55.119246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:55.119246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.119246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:55.119246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:55.119246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:56:55.119246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:55.119246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:55.119246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.119246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:55.119667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:55.119667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:55.119667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.119667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:55.119667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:55.119667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:55.119667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:55.119667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:55.119667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:55.119667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:55.119667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:55.119667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:55.119667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:55.119667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:55.120052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:55.120052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:55.120052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.120052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:55.120052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.120052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:55.120052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:55.120052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:55.120052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:55.120052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:55.120052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.120052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:55.120052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:55.120052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:55.120473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:55.121006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:55.121006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:55.121006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:55.121006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:55.121006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:55.121006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:55.121006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:55.121006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:55.121006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:55.121006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:55.121006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.121006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:55.121006 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:55.121006 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:55.121405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:55.121405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:55.121727 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:55.122054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.122779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:55.122779 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:55.122779 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:55.122779 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:55.122779 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:55.122779 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:55.122779 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.122779 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:55.123538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.123538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:56:55.123538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:55.123538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:55.123538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.123538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:55.123538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:55.123538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:55.123538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.123538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:56:55.123538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:55.123538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:56:55.123538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:55.123538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:56:55.123538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:56:55.124015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:55.124015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:56:55.124015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:55.124015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:56:55.124015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:56:55.124015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:55.124015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:56:55.124015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.124015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:56:55.124541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.124541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:55.124541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:55.124541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:55.124541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.124541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:55.124541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:55.124541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:55.124541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:55.124541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.124541 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:55.124882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:55.124882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:55.124882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.124882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:55.124882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:55.124882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:55.124882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:55.124882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:55.124882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:55.124882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:55.124882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:55.124882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:55.124882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:55.124882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:55.125246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:55.125246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:55.125246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.125246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.125759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:55.126264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:55.126870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:55.126870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:55.126870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.126870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:55.129532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:55.129728 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:55.129839 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:55.129991 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:55.130497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:55.130710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:55.130898 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.131471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:55.131471 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:55.131471 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:55.131471 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:55.131471 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:55.131471 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:55.131471 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.131471 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:55.132323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.132323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:55.132323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:55.132323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:55.132323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.132323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:55.132323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:55.132323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.132323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:55.132323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:55.132323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:55.132323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.132707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:55.132707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:55.132707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:55.132707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:55.132707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:55.132707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:55.132707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:55.132707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:55.132707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:55.132707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:55.132707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:55.132707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:55.132707 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:55.133044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.133044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:55.133323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.133323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:55.133323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:55.133323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:55.133323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:55.133323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:55.133323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.133323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:55.133323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:55.133323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.133323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:55.133323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:55.133323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.133323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:55.133323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:55.133323 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:55.133781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:55.134315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:55.134315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:55.134315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:56:59.880981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:56:59.882159 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:56:59.882229 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:56:59.883856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:56:59.920175 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:56:59.920583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:59.921396 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:56:59.921396 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:59.921396 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:56:59.921396 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:56:59.921396 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:59.921396 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:56:59.921396 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:59.921396 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:56:59.922220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:59.922220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:56:59.922220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:59.922220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:56:59.922220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:59.922220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:59.922220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:59.922220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:59.922220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:59.922220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:59.922220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:59.922220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:59.923000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:56:59.923000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:59.923000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:56:59.923000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:59.923000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:56:59.923000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:56:59.923000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:59.923000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:56:59.923000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:59.923000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:56:59.923000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:56:59.923000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:59.923000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:56:59.923638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:59.923638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:56:59.924018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:59.924018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:56:59.924018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:56:59.924018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:56:59.924018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:56:59.924018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:56:59.924018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:59.924018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:56:59.924018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:56:59.924018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:59.924018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:56:59.924018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:56:59.924018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:56:59.924018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:56:59.924018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:56:59.924018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:56:59.925959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:56:59.927605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:56:59.927605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:56:59.927605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:00.103717 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:00.104259 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:00.104499 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:00.106120 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:00.106567 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:00.106828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.107931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:00.107931 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:00.107931 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:00.107931 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:00.107931 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:00.107931 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:00.107931 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.107931 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:00.109631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.109631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:00.109631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:00.109631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:00.109631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.109631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:00.109631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:00.109631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.109631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:00.109631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:00.109631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:00.109631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.110182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:00.110182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:00.110182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:00.110182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:00.110182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:00.110182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:00.110182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:00.110182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:00.110182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:00.110182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:00.110182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:00.110182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:00.110182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:00.110608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.110608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:00.111267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.111267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:00.111267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:00.111267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:00.111267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:00.111267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:00.111267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.111267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:00.111267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:00.111267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.111267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:00.111267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:00.111267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.111267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:00.111267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:00.111267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:00.111771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:00.112296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:00.112296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.112296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:00.113280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:00.113703 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:00.113913 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:00.114097 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:57:00.114675 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:00.115031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.116079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:00.116079 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:00.116079 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:00.116079 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:00.116079 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:00.116079 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:00.116079 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.116079 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:00.117917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.117917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:00.117917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:00.117917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:00.117917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.117917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:00.117917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:00.117917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:00.117917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.117917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:00.117917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:00.117917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:00.117917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:00.117917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:00.117917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:00.119662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:00.119662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:00.119662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:00.119662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:00.119662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:00.119662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:00.119662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:00.119662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.119662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:00.119662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.119662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:00.119662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:00.119662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:00.119662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:00.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:00.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:57:00.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:00.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:00.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:00.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:00.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:00.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:00.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:00.120940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:00.121996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:00.121996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:00.121996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:00.121996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:00.121996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:00.121996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:00.121996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:00.121996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:00.121996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:00.121996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:00.121996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.121996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:00.122638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.122638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:00.122638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:00.122638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:00.122638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:00.122638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:00.122638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.122638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:00.122638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:00.122638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.122638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:00.122638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:00.122638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.122638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:00.122638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:00.122638 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:00.123597 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:00.124454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:00.124454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:00.124454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:00.124454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:00.124454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:00.124454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.124454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:00.124454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:00.124454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:00.124454 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:00.124813 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:00.124813 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:00.124813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.124813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:00.124813 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:00.124813 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:00.124813 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:00.124813 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:00.124813 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:00.124813 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.124813 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:00.124813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:00.125299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:00.126284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:00.126284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:00.126284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:00.126284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:00.126284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.126284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:00.126284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.126284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:00.126284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:00.126284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:00.126284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.126284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:00.126284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:00.127278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:00.127278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:00.127278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.127278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:00.127278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:00.127278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:00.127278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.127278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:00.127278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:00.127278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:00.127278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:00.127278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:00.127278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:00.127972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:00.127972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:00.127972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:00.127972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:00.127972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:00.127972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:00.127972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:00.127972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.127972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:00.127972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.127972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:00.127972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.128920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.129825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:00.130340 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:00.130340 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:00.130340 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:00.130748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:00.130935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:00.131319 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:00.131535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.132266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:00.132266 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:00.132266 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:00.132266 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:00.132266 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:00.132266 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:00.132266 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.132266 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:00.133158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.133158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:00.133158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:00.133158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:00.133158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.133158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:00.133158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:00.133158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.133158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:00.133158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:00.133158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:00.133158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.134077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:00.134077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:00.134077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:00.134077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:00.134077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:00.134077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:00.134077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:00.134077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:00.134077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:00.134077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:00.134077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:00.134077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:00.134077 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:00.134865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.134865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:00.134865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.134865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:00.134865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:00.134865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:00.134865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:00.134865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:00.134865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.134865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:00.134865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:00.134865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.134865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:00.134865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:00.134865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:00.135613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:00.136177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:00.136177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:00.136177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:00.136177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:00.136177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:00.136177 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:04.881808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:04.882702 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:04.882702 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:04.884001 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:04.916344 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:04.916779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:04.917653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:04.917653 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:04.917653 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:04.917653 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:04.917653 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:04.917653 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:04.917653 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:04.917653 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:04.918679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:04.918679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:04.918679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:04.918679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:04.918679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:04.918679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:04.918679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:04.918679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:04.918679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:04.918679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:04.918679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:04.918679 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:04.919309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:04.919309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:04.919309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:04.919309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:04.919309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:04.919309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:04.919309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:04.919309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:04.919309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:04.919309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:04.919309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:04.919309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:04.919309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:04.920645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:04.920645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:04.920645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:04.920645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:04.920645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:04.920645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:04.920645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:04.920645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:04.920645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:04.920645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:04.920645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:04.920645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:04.920645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:04.920645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:04.920645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:04.921853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:04.923309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:04.923309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:04.923309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:04.923309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:04.923309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:04.923309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:05.104336 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:05.105109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:05.105296 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:05.106395 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:05.106774 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:05.107028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.108073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:05.108073 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:05.108073 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:05.108073 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:05.108073 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:05.108073 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:05.108073 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.108073 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:05.109698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.109698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:05.109698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:05.109698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:05.109698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.109698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:05.109698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:05.109698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.109698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:05.109698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:05.109698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:05.109698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.110274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:05.110274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:05.110274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:05.110274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:05.110274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:05.110274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:05.110274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:05.110274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:05.110274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:05.110274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:05.110274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:05.110274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:05.110274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:05.110950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.110950 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:05.111214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.111214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:05.111214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:05.111214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:05.111214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:05.111214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:05.111214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.111214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:05.111214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:05.111214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.111214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:05.111214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:05.111214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.111214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:05.111214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:05.111214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:05.111739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:05.112433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:05.112433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.112433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:05.113747 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:05.114158 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:05.114231 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:05.114343 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:57:05.114924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:05.115103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.115628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:05.115628 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:05.115628 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:05.115628 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:05.115628 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:05.115628 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:05.115628 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.115628 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:05.116354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.116354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:05.116354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:05.116354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:05.116354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.116354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:05.116354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:05.116354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:05.116354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.116354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:05.116354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:05.116354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:05.116354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:05.116354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:05.116354 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:05.117298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:05.117298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:05.117298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:05.117298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:05.117298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:05.117298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:05.117298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:05.117298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.117298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:05.117298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.117298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:05.117298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:05.117298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:05.117298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.118065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:05.118065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:05.118065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:57:05.118065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:05.118065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:05.118065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.118065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:05.118065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:05.118065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:05.118065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.118065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:05.118065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:05.118065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:05.118816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:05.118816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:05.118816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:05.118816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:05.118816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:05.118816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:05.118816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:05.118816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:05.118816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:05.118816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:05.118816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.118816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:05.119517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.119517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:05.119517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:05.119517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:05.119517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:05.119517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:05.119517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.119517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:05.119517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:05.119517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.119517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:05.119517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:05.119517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.119517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:05.119517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:05.119517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:05.120079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:05.120794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:05.120794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:05.120794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:05.120794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:05.120794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:05.120794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.120794 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:05.122043 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:05.122339 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:05.122449 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:05.122586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:05.122949 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:05.123162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.123710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:05.123710 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:05.123710 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:05.123710 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:05.123710 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:05.123710 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:05.123710 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.123710 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:05.124434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.124434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:05.124434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:05.124434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:05.124434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.124434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:05.124434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:05.124434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:05.124434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.124434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:05.124434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:05.124434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:05.124434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:05.124434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:05.124434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:05.124862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:05.124862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:05.124862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:05.124862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:05.124862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:05.124862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:05.124862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:05.124862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.124862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:05.125276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.125276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:05.125276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:05.125276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:05.125276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.125276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:05.125276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:05.125276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:05.125276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:05.125276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.125276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:05.125616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:05.125616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:05.125616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.125616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:05.125616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:05.125616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:05.125616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:05.125616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:05.125616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:05.125616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:05.125616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:05.125616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:05.125616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:05.125616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:05.126030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:05.126030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:05.126030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.126030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.126384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:05.127038 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:05.127755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:05.127755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:05.127755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.127755 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:05.130279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:05.131024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:05.131141 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:05.131286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:05.131626 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:05.131908 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:05.132015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.132741 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:05.132741 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:05.132741 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:05.132741 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:05.132741 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:05.132741 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:05.132741 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.132741 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:05.133625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.133625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:05.133625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:05.133625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:05.133625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.133625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:05.133625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:05.133625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.133625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:05.133625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:05.133625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:05.133625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.134081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:05.134081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:05.134081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:05.134081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:05.134081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:05.134081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:05.134081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:05.134081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:05.134081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:05.134081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:05.134081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:05.134081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:05.134081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:05.134642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.134642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:05.134642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.134642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:05.134642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:05.134642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:05.134642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:05.134642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:05.134642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.134642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:05.134642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:05.134642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.134642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:05.134642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:05.134642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:05.135245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:05.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:05.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:05.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:05.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:05.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:05.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:09.882546 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:09.883450 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:09.883600 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:09.885024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:09.925655 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:09.926150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:09.927252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:09.927252 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:09.927252 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:09.927252 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:09.927252 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:09.927252 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:09.927252 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:09.927252 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:09.928439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.044 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:09.928439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:09.928439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:09.928439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:09.928439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:09.928439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:09.928439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:09.928439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:09.928439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:09.928439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:09.928439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:09.928439 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:09.929194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:09.929194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:09.929194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:09.929194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:09.929194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:09.929194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:09.929194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:09.929194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:09.929194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:09.929194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:09.929194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:09.929194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:09.929194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:09.929949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:09.929949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:09.929949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:09.929949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:09.929949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:09.929949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:09.929949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:09.929949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:09.929949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:09.929949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:09.929949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:09.929949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:09.929949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:09.929949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:09.929949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:09.930768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:09.931650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:09.931650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:09.931650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:09.931650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:09.931650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:09.931650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:10.105150 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:10.105731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:10.105845 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:10.107277 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:10.107733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:10.107965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.108981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:10.108981 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:10.108981 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:10.108981 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:10.108981 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:10.108981 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:10.108981 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.108981 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:10.110158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.110158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:10.110158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:10.110158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:10.110158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.110158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:10.110158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:10.110158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.110158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:10.110158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:10.110158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:10.110158 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.110764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:10.110764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:10.110764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:10.110764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:10.110764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:10.110764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:10.110764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:10.110764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:10.110764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:10.110764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:10.110764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:10.110764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:10.110764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:10.111322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.111322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:10.111322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.111322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:10.111322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:10.111322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:10.111322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:10.111322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:10.111322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.111322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:10.111322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:10.111322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.111322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:10.111322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:10.111322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:10.112047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:10.113067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:10.113067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:10.113067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:10.113067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:10.113067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.113067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:10.114276 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:10.114581 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:10.114696 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:10.114805 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:57:10.115589 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:10.115990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.117180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:10.117180 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:10.117180 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:10.117180 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:10.117180 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:10.117180 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:10.117180 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.117180 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:10.117975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.117975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:10.117975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:10.117975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:10.117975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.117975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:10.117975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:10.117975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:10.117975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.117975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:10.117975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:10.117975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:10.117975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:10.117975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:10.117975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:10.118944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:10.118944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:10.118944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:10.118944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:10.118944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:10.118944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:10.118944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:10.118944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.118944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:10.118944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.118944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:10.118944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:10.118944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:10.118944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.119648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:10.119648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:10.119648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:57:10.119648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:10.119648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:10.119648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.119648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:10.119648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:10.119648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:10.119648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.119648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:10.119648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:10.119648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:10.120270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:10.120270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:10.120270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:10.120270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:10.120270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:10.120270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:10.120270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:10.120270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:10.120270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:10.120270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:10.120270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.120270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:10.120777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.120777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:10.120777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:10.120777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:10.120777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:10.120777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:10.120777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.120777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:10.120777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:10.120777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.120777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:10.120777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:10.120777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.120777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:10.120777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:10.120777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:10.121516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:10.122281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:10.122281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:10.122281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:10.122281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:10.122281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:10.122281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.122281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:10.122615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:10.122809 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:10.122893 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:10.123035 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:10.123676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:10.124041 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.124820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:10.124820 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:10.124820 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:10.124820 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:10.124820 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:10.124820 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:10.124820 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.124820 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:10.125663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.125663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:10.125663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:10.125663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:10.125663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.125663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:10.125663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:10.125663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:10.125663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.125663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:10.125663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:10.125663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:10.125663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:10.125663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:10.125663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:10.126107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:10.126107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:10.126107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:10.126107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:10.126107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:10.126107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:10.126107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:10.126107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.126107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:10.126345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.126345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:10.126345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:10.126345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:10.126345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.126345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:10.126345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:10.126345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:10.126345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:10.126345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.126345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:10.126701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:10.126701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:10.126701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.126701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:10.126701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:10.126701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:10.126701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:10.126701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:10.126701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:10.126701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:10.126701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:10.126701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:10.126701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:10.126701 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:10.127124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:10.127124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:10.127124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.127124 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.127413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:10.127935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:10.128515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:10.128515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:10.128515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.128515 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:10.130924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:10.131213 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:10.131295 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:10.131458 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:10.132806 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:10.132806 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:10.132806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.133360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:10.133360 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:10.133360 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:10.133360 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:10.133360 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:10.133360 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:10.133360 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.133360 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:10.134345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.134345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:10.134345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:10.134345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:10.134345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.134345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:10.134345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:10.134345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.134345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:10.134345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:10.134345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:10.134345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.134768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:10.134768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:10.134768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:10.134768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:10.134768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:10.134768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:10.134768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:10.134768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:10.134768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:10.134768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:10.134768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:10.134768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:10.134768 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:10.135163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.135163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:10.135329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.135329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:10.135329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:10.135329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:10.135329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:10.135329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:10.135329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.135329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:10.135329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:10.135329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.135329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:10.135329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:10.135329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.135329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:10.135329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:10.135329 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:10.135841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:10.136458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:10.136458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:10.136458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:14.883303 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:14.884441 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:14.884441 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:14.884772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:14.915882 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:14.916213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:14.917021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:14.917021 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:14.917021 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:14.917021 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:14.917021 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:14.917021 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:14.917021 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:14.917021 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:14.917810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:14.917810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:14.917810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:14.917810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:14.917810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:14.917810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:14.917810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:14.917810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:14.917810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:14.917810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:14.917810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:14.917810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:14.918527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:14.918527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:14.918527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:14.918527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:14.918527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:14.918527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:14.918527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:14.918527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:14.918527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:14.918527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:14.918527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:14.918527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:14.918527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:14.919225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:14.919225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:14.919225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:14.919225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:14.919225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:14.919225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:14.919225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:14.919225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:14.919225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:14.919225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:14.919225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:14.919225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:14.919225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:14.919225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:14.919225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:14.920212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:14.921229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:14.921229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:14.921229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:14.921229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:14.921229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:14.921229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:15.108016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:15.108016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:15.108016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:15.108016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:15.108016 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:15.108470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.108849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:15.108849 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:15.108849 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:15.108849 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:15.108849 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:15.108849 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:15.108849 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.108849 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:15.109928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.109928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:15.109928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:15.109928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:15.109928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.109928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:15.109928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:15.109928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.109928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:15.109928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:15.109928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:15.109928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.110317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:15.110317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:15.110317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:15.110317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:15.110317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:15.110317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:15.110317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:15.110317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:15.110317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:15.110317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:15.110317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:15.110317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:15.110317 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:15.110699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.110699 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:15.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:15.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:15.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:15.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:15.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:15.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:15.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:15.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:15.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:15.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:15.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:15.110993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:15.111464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:15.112201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:15.112201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.112201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:15.114607 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:15.114913 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:15.115045 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:15.115155 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:57:15.115882 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:15.116151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.116895 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:15.116895 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:15.116895 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:15.116895 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:15.116895 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:15.116895 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:15.116895 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.116895 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:15.117696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.117696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:15.117696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:15.117696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:15.117696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.117696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:15.117696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:15.117696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:15.117696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.117696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:15.117696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:15.117696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:15.117696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:15.117696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:15.117696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:15.118224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:15.118224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:15.118224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:15.118224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:15.118224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:15.118224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:15.118224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:15.118224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.118224 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:15.118654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.118654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:15.118654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:15.118654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:15.118654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.118654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:15.118654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:15.118654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:57:15.118654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:15.118654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:15.118654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.118654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:15.119068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:15.119068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:15.119068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.119068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:15.119068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:15.119068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:15.119068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:15.119068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:15.119068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:15.119068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:15.119068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:15.119068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:15.119068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:15.119068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:15.119610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:15.119610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:15.119610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.119610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:15.120049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.120049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:15.120049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:15.120049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:15.120049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:15.120049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:15.120049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.120049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:15.120049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:15.120049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.120049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:15.120049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:15.120049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.120049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:15.120049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:15.120049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:15.120619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:15.121165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:15.121165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:15.121165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:15.121165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:15.121165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:15.121165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.121165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:15.122908 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:15.123265 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:15.123354 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:15.123521 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:15.124200 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:15.124608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.125290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:15.125290 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:15.125290 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:15.125290 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:15.125290 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:15.125290 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:15.125290 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.125290 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:15.126108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.126108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:15.126108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:15.126108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:15.126108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.126108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:15.126108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:15.126108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:15.126108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.126108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:15.126108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:15.126108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:15.126108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:15.126108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:15.126108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:15.126714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:15.126714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:15.126714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:15.126714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:15.126714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:15.126714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:15.126714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:15.126714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.126714 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:15.127054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.127054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:15.127054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:15.127054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:15.127054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.127054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:15.127054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:15.127054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:15.127054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:15.127054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.127054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:15.127580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:15.127580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:15.127580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.127580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:15.127580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:15.127580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:15.127580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:15.127580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:15.127580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:15.127580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:15.127580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:15.127580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:15.127580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:15.127580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:15.128161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:15.128161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:15.128161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.128161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:15.128161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.128161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:15.128161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:15.128161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:15.128161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:15.128161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:15.128161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.128161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:15.128161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:15.128161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:15.128844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:15.129782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:15.129782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:15.129782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:15.129782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:15.129782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:15.129782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:15.129782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:15.129782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:15.129782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:15.129782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.129782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:15.131399 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:15.131717 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:15.131808 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:15.131969 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:15.132619 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:15.132902 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:15.133098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.133831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:15.133831 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:15.133831 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:15.133831 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:15.133831 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:15.133831 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:15.133831 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.133831 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:15.134657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.134657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:15.134657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:15.134657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:15.134657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.134657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:15.134657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:15.134657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.134657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:15.134657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:15.134657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:15.134657 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.135284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:15.135284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:15.135284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:15.135284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:15.135284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:15.135284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:15.135284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:15.135284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:15.135284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:15.135284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:15.135284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:15.135284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:15.135284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:15.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:15.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:15.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:15.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:15.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:15.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:15.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:15.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:15.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:15.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:15.135863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:15.136634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:15.137529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:15.137529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:15.137529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:15.137529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:15.137529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:15.137529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:19.883877 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:19.884681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:19.884681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:19.885062 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:19.914643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:19.915152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:19.916348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:19.916348 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:19.916348 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:19.916348 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:19.916348 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:19.916348 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:19.916348 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:19.916348 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:19.917210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.032 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:19.917210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:19.917210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:19.917210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:19.917210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:19.917210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:19.917210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:19.917210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:19.917210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:19.917210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:19.917210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:19.917210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:19.917762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:19.917762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:19.917762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:19.917762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:19.917762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:19.917762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:19.917762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:19.917762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:19.917762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:19.917762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:19.917762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:19.917762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:19.917762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:19.918289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:19.918289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:19.918289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:19.918289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:19.918289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:19.918289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:19.918289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:19.918289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:19.918289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:19.918289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:19.918289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:19.918289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:19.918289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:19.918289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:19.918289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:19.918737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:19.920219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:19.920219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:19.920219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:19.920219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:19.920219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:19.920219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:20.106429 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:20.106911 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:20.107105 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:20.108294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:20.108720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:20.108971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.109970 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:20.109970 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:20.109970 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:20.109970 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:20.109970 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:20.109970 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:20.109970 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.109970 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:20.111180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.111180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:20.111180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:20.111180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:20.111180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.111180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:20.111180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:20.111180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.111180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:20.111180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:20.111180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:20.111180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.111795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:20.111795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:20.111795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:20.111795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:20.111795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:20.111795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:20.111795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:20.111795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:20.111795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:20.111795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:20.111795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:20.111795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:20.111795 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:20.112387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.112387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:20.112387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.112387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:20.112387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:20.112387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:20.112387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:20.112387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:20.112387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.112387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:20.112387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:20.112387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.112387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:20.112387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:20.112387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:20.113060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:20.113997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:20.113997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:20.113997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:20.113997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:20.113997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.113997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:20.115598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:20.115598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:20.115598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:20.115831 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:57:20.116154 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:20.116431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.117004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:20.117004 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:20.117004 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:20.117004 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:20.117004 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:20.117004 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:20.117004 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.117004 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:20.117830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.117830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:20.117830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:20.117830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:20.117830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.117830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:20.117830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:20.117830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:20.117830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.117830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:20.117830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:20.117830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:20.117830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:20.117830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:20.117830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:20.118773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:20.118773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:20.118773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:20.118773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:20.118773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:20.118773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:20.118773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:20.118773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.118773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:20.118773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.118773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:20.118773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:20.118773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:20.118773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.119759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:20.119759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:20.119759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:57:20.119759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:20.119759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:20.119759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.119759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:20.119759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:20.119759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:20.119759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.119759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:20.119759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:20.119759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:20.120589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:20.120589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:20.120589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:20.120589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:20.120589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:20.120589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:20.120589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:20.120589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:20.120589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:20.120589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:20.120589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.120589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:20.121654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.121654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:20.121654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:20.121654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:20.121654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:20.121654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:20.121654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.121654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:20.121654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:20.121654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.121654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:20.121654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:20.121654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.121654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:20.121654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:20.121654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:20.122664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:20.123123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:20.123123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:20.123123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:20.123123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:20.123123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:20.123123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.123123 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:20.123630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:20.123630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:20.123814 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:20.123934 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:20.124420 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:20.124834 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.125382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:20.125382 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:20.125382 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:20.125382 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:20.125382 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:20.125382 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:20.125382 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.125382 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:20.126085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.126085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:20.126085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:20.126085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:20.126085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.126085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:20.126085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:20.126085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:20.126085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.126085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:20.126085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:20.126085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:20.126085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:20.126085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:20.126085 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:20.126853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:20.126853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:20.126853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:20.126853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:20.126853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:20.126853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:20.126853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:20.126853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.126853 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:20.127067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.127067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:20.127067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:20.127067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:20.127067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.127067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:20.127067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:20.127067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:20.127067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:20.127067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.127067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:20.127288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:20.127288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:20.127288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.127288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:20.127288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:20.127288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:20.127288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:20.127288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:20.127288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:20.127288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:20.127288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:20.127288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:20.127288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:20.127288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:20.127539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:20.127539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:20.127539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.127539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.128086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:20.128534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:20.128937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:20.128937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:20.128937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.128937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:20.131828 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:20.132072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:20.132225 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:20.132360 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:20.132781 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:20.133169 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:20.133594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.134288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:20.134288 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:20.134288 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:20.134288 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:20.134288 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:20.134288 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:20.134288 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.134288 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:20.135029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.135029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:20.135029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:20.135029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:20.135029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.135029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:20.135029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:20.135029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.135029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:20.135029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:20.135029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:20.135029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:20.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:20.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:20.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:20.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:20.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:20.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:20.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:20.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:20.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:20.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:20.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:20.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:20.136068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.136068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:20.136068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.136068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:20.136068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:20.136068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:20.136068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:20.136068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:20.136068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.136068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:20.136068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:20.136068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.136068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:20.136068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:20.136068 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:20.136611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:20.137240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:20.137240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:20.137240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:20.137240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:20.137240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:20.137240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:24.884520 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:24.885512 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:24.885512 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:24.886638 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:24.920354 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:24.920920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:24.922063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:24.922063 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:24.922063 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:24.922063 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:24.922063 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:24.922063 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:24.922063 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:24.922063 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:24.922964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:24.922964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:24.922964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:24.922964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:24.922964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:24.922964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:24.922964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:24.922964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:24.922964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:24.922964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:24.922964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:24.922964 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:24.923808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:24.923808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:24.923808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:24.923808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:24.923808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:24.923808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:24.923808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:24.923808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:24.923808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:24.923808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:24.923808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:24.923808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:24.923808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:24.924613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:24.924613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:24.924613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:24.924613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:24.924613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:24.924613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:24.924613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:24.924613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:24.924613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:24.924613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:24.924613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:24.924613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:24.924613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:24.924613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:24.924613 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:24.925481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:24.926653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:24.926653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:24.926653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:24.926653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:24.926653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:24.926653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:25.107234 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:25.107804 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:25.108036 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:25.109297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:25.109721 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:25.110000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.111161 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:25.111161 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:25.111161 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:25.111161 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:25.111161 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:25.111161 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:25.111161 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.111161 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:25.112771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.112771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:25.112771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:25.112771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:25.112771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.112771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:25.112771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:25.112771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.112771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:25.112771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:25.112771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:25.112771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.113487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:25.113487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:25.113487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:25.113487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:25.113487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:25.113487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:25.113487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:25.113487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:25.113487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:25.113487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:25.113487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:25.113487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:25.113487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:25.114075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.114075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:25.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:25.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:25.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:25.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:25.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:25.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:25.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:25.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:25.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:25.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:25.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:25.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:25.115182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:25.116112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:25.116112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.116112 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:25.116112 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:25.116112 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:25.116112 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:25.116112 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:57:25.116943 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:25.116943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.117580 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:25.117580 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:25.117580 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:25.117580 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:25.117580 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:25.117580 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:25.117580 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.117580 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:25.118344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.118344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:25.118344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:25.118344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:25.118344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.118344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:25.118344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:25.118344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:25.118344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.118344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:25.118344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:25.118344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:25.118344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:25.118344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:25.118344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:25.118894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:25.118894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:25.118894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:25.118894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:25.118894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:25.118894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:25.118894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:25.118894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.118894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:25.119221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.119221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:25.119221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:25.119221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:25.119221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.119221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:25.119221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:25.119221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:57:25.119221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:25.119221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:25.119221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.119221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:25.119632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:25.119632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:25.119632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.119632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:25.119632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:25.119632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:25.119632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:25.119632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:25.119632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:25.119632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:25.119632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:25.119632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:25.119632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:25.119632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:25.120005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:25.120005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:25.120005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.120005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:25.120246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.120246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:25.120246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:25.120246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:25.120246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:25.120246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:25.120246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.120246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:25.120246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:25.120246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.120246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:25.120246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:25.120246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.120246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:25.120246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:25.120246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:25.120726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:25.121194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:25.121194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:25.121194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:25.121194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:25.121194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:25.121194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.121194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:25.123702 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:25.123916 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:25.124025 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:25.124145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:25.124794 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:25.125168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.125946 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:25.125946 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:25.125946 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:25.125946 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:25.125946 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:25.125946 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:25.125946 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.125946 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:25.126764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.126764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:25.126764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:25.126764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:25.126764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.126764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:25.126764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:25.126764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:25.126764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.126764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:25.126764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:25.126764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:25.126764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:25.126764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:25.126764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:25.127166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:25.127166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:25.127166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:25.127166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:25.127166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:25.127166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:25.127166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:25.127166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.127166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:25.127921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.127921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:25.127921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:25.127921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:25.127921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.127921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:25.127921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:25.127921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:25.127921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:25.127921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.127921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:25.130180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:25.130180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:25.130180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.130180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:25.130180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:25.130180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:25.130180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:25.130180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:25.130180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:25.130180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:25.130180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:25.130180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:25.130180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:25.130180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:25.130627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:25.130627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:25.130627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.130627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:25.130627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.130627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:25.130627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:25.130627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:25.130627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:25.130627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:25.130627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.130627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:25.130627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:25.130627 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:25.131037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:25.131779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:25.131779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:25.131779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:25.131779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:25.131779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:25.131779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:25.131779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:25.131779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:25.131779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:25.131779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.131779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:25.132235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:25.132856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:25.132856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:25.132856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:25.133384 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:25.133752 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:25.133972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.134732 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:25.134732 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:25.134732 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:25.134732 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:25.134732 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:25.134732 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:25.134732 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.134732 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:25.135598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.135598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:25.135598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:25.135598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:25.135598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.135598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:25.135598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:25.135598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.135598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:25.135598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:25.135598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:25.135598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.135999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:25.135999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:25.135999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:25.135999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:25.135999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:25.135999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:25.135999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:25.135999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:25.135999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:25.135999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:25.135999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:25.135999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:25.135999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:25.137083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.137083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:25.137083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.137083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:25.137083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:25.137083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:25.137083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:25.137083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:25.137083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.137083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:25.137083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:25.137083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.137083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:25.137083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:25.137083 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:25.137526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:25.138043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:25.138043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:25.138043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:25.138043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:25.138043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:25.138043 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:29.885344 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:29.886467 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:29.886672 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:29.888095 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:29.926895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:29.927267 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:29.928526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:29.928526 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:29.928526 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:29.928526 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:29.928526 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:29.928526 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:29.928526 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:29.928526 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:29.929588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:29.929588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:29.929588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:29.929588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:29.929588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:29.929588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:29.929588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:29.929588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:29.929588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:29.929588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:29.929588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:29.929588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:29.930064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:29.930064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:29.930064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:29.930064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:29.930064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:29.930064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:29.930064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:29.930064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:29.930064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:29.930064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:29.930064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:29.930064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:29.930064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:29.930578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:29.930578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:29.930578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:29.930578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:29.930578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:29.930578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:29.930578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:29.930578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:29.930578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:29.930578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:29.930578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:29.930578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:29.930578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:29.930578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:29.930578 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:29.931115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:29.931740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:29.931740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:29.931740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:29.931740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:29.931740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:29.931740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:30.108059 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:30.108991 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:30.109208 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:30.111919 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:30.111919 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:30.111919 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.113031 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:30.113031 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:30.113031 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:30.113031 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:30.113031 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:30.113031 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:30.113031 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.113031 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:30.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:30.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:30.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:30.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:30.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:30.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:30.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:30.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:30.114448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.114835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:30.114835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:30.114835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:30.114835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:30.114835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:30.114835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:30.114835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:30.114835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:30.114835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:30.114835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:30.114835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:30.114835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:30.114835 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:30.115187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.115187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:30.115697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.115697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:30.115697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:30.115697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:30.115697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:30.115697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:30.115697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.115697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:30.115697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:30.115697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.115697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:30.115697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:30.115697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.115697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:30.115697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:30.115697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:30.116169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:30.116740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:30.116740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.116740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:30.116740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:30.116740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:30.116740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:30.116962 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:57:30.117661 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:30.117985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.118875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:30.118875 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:30.118875 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:30.118875 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:30.118875 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:30.118875 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:30.118875 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.118875 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:30.120676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.120676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:30.120676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:30.120676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:30.120676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.120676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:30.120676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:30.120676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:30.120676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.120676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:30.120676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:30.120676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:30.120676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:30.120676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:30.120676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:30.121197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:30.121197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:30.121197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:30.121197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:30.121197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:30.121197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:30.121197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:30.121197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.121197 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:30.122605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.122605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:30.122605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:30.122605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:30.122605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.122605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:30.122605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:30.122605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:57:30.122605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:30.122605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:30.122605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.122605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:30.122999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:30.122999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:30.122999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.122999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:30.122999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:30.122999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:30.122999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:30.122999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:30.122999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:30.122999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:30.122999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:30.122999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:30.122999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:30.122999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:30.123547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:30.123547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:30.123547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.123547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:30.124495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.124495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:30.124495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:30.124495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:30.124495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:30.124495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:30.124495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.124495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:30.124495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:30.124495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.124495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:30.124495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:30.124495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.124495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:30.124495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:30.124495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:30.124949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:30.125524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:30.125524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:30.125524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:30.125524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:30.125524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:30.125524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.125524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:30.125524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:30.125524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:30.125524 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:30.125826 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:30.126586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:30.126911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.127663 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:30.127663 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:30.127663 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:30.127663 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:30.127663 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:30.127663 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:30.127663 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.127663 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:30.128522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.128522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:30.128522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:30.128522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:30.128522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.128522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:30.128522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:30.128522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:30.128522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.128522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:30.128522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:30.128522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:30.128522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:30.128522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:30.128522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:30.128912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:30.128912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:30.128912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:30.128912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:30.128912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:30.128912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:30.128912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:30.128912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.128912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:30.129574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.129574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:30.129574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:30.129574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:30.129574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.129574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:30.129574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:30.129574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:30.129574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:30.129574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.129574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:30.129912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:30.129912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:30.129912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.129912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:30.129912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:30.129912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:30.129912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:30.129912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:30.129912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:30.129912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:30.129912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:30.129912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:30.129912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:30.129912 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:30.130297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:30.130297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:30.130297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.130297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.131210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:30.131724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:30.132230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:30.132230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:30.132230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.132230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:30.132815 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:30.133177 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:30.133299 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:30.133518 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:30.133923 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:30.134206 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:30.134391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.135003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:30.135003 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:30.135003 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:30.135003 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:30.135003 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:30.135003 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:30.135003 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.135003 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:30.136024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.136024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:30.136024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:30.136024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:30.136024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.136024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:30.136024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:30.136024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.136024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:30.136024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:30.136024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:30.136024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.136416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:30.136416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:30.136416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:30.136416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:30.136416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:30.136416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:30.136416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:30.136416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:30.136416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:30.136416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:30.136416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:30.136416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:30.136416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:30.136812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.136812 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:30.137219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.137219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:30.137219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:30.137219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:30.137219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:30.137219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:30.137219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.137219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:30.137219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:30.137219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.137219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:30.137219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:30.137219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.137219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:30.137219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:30.137219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:30.137676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:30.138327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:30.138327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:30.138327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:34.886444 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:34.887537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:34.887737 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:34.889229 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:34.930328 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:34.930821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:34.932301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:34.932301 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:34.932301 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:34.932301 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:34.932301 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:34.932301 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:34.932301 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:34.932301 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:34.933521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.045 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:34.933521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:34.933521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:34.933521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:34.933521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:34.933521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:34.933521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:34.933521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:34.933521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:34.933521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:34.933521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:34.933521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:34.933879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:34.933879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:34.933879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:34.933879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:34.933879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:34.933879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:34.933879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:34.933879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:34.933879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:34.933879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:34.933879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:34.933879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:34.933879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:34.934252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:34.934252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:34.934972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:34.934972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:34.934972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:34.934972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:34.934972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:34.934972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:34.934972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:34.934972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:34.934972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:34.934972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:34.934972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:34.934972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:34.934972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:34.934972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:34.934972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:34.934972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:34.935865 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:34.936487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:34.936487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:34.936487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:35.108907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:35.109429 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:35.109616 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:35.110747 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:35.111105 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:35.111384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.112345 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:35.112345 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:35.112345 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:35.112345 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:35.112345 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:35.112345 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:35.112345 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.112345 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:35.114015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.114015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:35.114015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:35.114015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:35.114015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.114015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:35.114015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:35.114015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.114015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:35.114015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:35.114015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:35.114015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.114655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:35.114655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:35.114655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:35.114655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:35.114655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:35.114655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:35.114655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:35.114655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:35.114655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:35.114655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:35.114655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:35.114655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:35.114655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:35.115280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.115280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:35.115815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.115815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:35.115815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:35.115815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:35.115815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:35.115815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:35.115815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.115815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:35.115815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:35.115815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.115815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:35.115815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:35.115815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.115815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:35.115815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:35.115815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:35.116631 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:35.117557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:35.117557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.117557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:35.117557 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:35.117557 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:35.117557 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:35.117557 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:57:35.117932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:35.118106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.118893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:35.118893 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:35.118893 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:35.118893 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:35.118893 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:35.118893 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:35.118893 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.118893 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:35.119975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.119975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:35.119975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:35.119975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:35.119975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.119975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:35.119975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:35.119975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:35.119975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.119975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:35.119975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:35.119975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:35.119975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:35.119975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:35.119975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:35.120719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:35.120719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:35.120719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:35.120719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:35.120719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:35.120719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:35.120719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:35.120719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.120719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:35.121337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.121337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:35.121337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:35.121337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:35.121337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.121337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:35.121337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:35.121337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:57:35.121337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:35.121337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:35.121337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.121337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:35.121930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:35.121930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:35.121930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.121930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:35.121930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:35.121930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:35.121930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:35.121930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:35.121930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:35.121930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:35.121930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:35.121930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:35.121930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:35.121930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:35.122593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:35.122593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:35.122593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.122593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:35.122593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.122593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:35.122593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:35.122593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:35.122593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:35.122593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:35.122593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.122593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:35.122593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:35.122593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:35.123217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:35.124269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:35.124269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:35.124269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:35.124269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:35.124269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:35.124269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:35.124269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:35.124269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:35.124269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:35.124269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:35.124269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.124269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:35.125180 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:35.125358 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:35.125498 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:35.125624 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:35.126091 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:35.126467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.127110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:35.127110 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:35.127110 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:35.127110 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:35.127110 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:35.127110 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:35.127110 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.127110 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:35.128135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.128135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:35.128135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:35.128135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:35.128135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.128135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:35.128135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:35.128135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:35.128135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.128135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:35.128135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:35.128135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:35.128135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:35.128135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:35.128135 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:35.128671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:35.128671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:35.128671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:35.128671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:35.128671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:35.128671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:35.128671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:35.128671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.128671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:35.129023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.129023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:35.129023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:35.129023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:35.129023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.129023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:35.129023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:35.129023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:35.129023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:35.129023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.129023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:35.129387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:35.129387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:35.129387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.129387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:35.129387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:35.129387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:35.129387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:35.129387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:35.129387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:35.129387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:35.129387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:35.129387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:35.129387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:35.129387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:35.129803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:35.129803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:35.129803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.129803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.130030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:35.130590 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:35.131091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:35.131091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:35.131091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.131091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:35.133150 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:35.133326 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:35.133465 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:35.133606 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:35.134038 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:35.134379 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:35.134621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.135336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:35.135336 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:35.135336 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:35.135336 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:35.135336 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:35.135336 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:35.135336 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.135336 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:35.136241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.136241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:35.136241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:35.136241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:35.136241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.136241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:35.136241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:35.136241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.136241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:35.136241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:35.136241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:35.136241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.136702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:35.136702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:35.136702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:35.136702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:35.136702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:35.136702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:35.136702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:35.136702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:35.136702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:35.136702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:35.136702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:35.136702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:35.136702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:35.137461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.137461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:35.137461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.137461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:35.137461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:35.137461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:35.137461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:35.137461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:35.137461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.137461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:35.137461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:35.137461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.137461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:35.137461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:35.137461 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:35.137931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:35.138510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:35.138510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:35.138510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:35.138510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:35.138510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:35.138510 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:39.887452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:39.888104 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:39.888104 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:39.889305 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:39.920843 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:39.921272 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:39.922171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:39.922171 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:39.922171 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:39.922171 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:39.922171 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:39.922171 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:39.922171 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:39.922171 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:39.922968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:39.922968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:39.922968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:39.922968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:39.922968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:39.922968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:39.922968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:39.922968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:39.922968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:39.922968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:39.922968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:39.922968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:39.923951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:39.923951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:39.923951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:39.923951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:39.923951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:39.923951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:39.923951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:39.923951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:39.923951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:39.923951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:39.923951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:39.923951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:39.923951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:39.925490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:39.925490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:39.925490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:39.925490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:39.925490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:39.925490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:39.925490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:39.925490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:39.925490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:39.925490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:39.925490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:39.925490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:39.925490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:39.925490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:39.925490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:39.926771 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:39.927697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:39.927697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:39.927697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:39.927697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:39.927697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:39.927697 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:40.109880 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:40.110634 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:40.110944 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:40.112280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:40.112668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:40.112917 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.113920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:40.113920 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:40.113920 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:40.113920 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:40.113920 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:40.113920 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:40.113920 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.113920 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:40.115046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.115046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:40.115046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:40.115046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:40.115046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.115046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:40.115046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:40.115046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.115046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:40.115046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:40.115046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:40.115046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.115753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:40.115753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:40.115753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:40.115753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:40.115753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:40.115753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:40.115753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:40.115753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:40.115753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:40.115753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:40.115753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:40.115753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:40.115753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:40.116399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.116399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:40.116399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.116399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:40.116399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:40.116399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:40.116399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:40.116399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:40.116399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.116399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:40.116399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:40.116399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.116399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:40.116399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:40.116399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:40.117201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:40.118149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:40.118149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:40.118149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:40.118149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:40.118149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.118149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:40.118149 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:40.118149 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:40.118149 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:40.118149 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:57:40.118748 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:40.118748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.119012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:40.119012 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:40.119012 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:40.119012 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:40.119012 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:40.119012 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:40.119012 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.119012 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:40.119874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.119874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:40.119874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:40.119874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:40.119874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.119874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:40.119874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:40.119874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:40.119874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.119874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:40.119874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:40.119874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:40.119874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:40.119874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:40.119874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:40.120718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:40.120718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:40.120718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:40.120718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:40.120718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:40.120718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:40.120718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:40.120718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.120718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:40.121219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.121219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:40.121219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:40.121219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:40.121219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.121219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:40.121219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:40.121219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:57:40.121219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:40.121219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:40.121219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.121219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:40.121887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:40.121887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:40.121887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.121887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:40.121887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:40.121887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:40.121887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:40.121887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:40.121887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:40.121887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:40.121887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:40.121887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:40.121887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:40.121887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:40.122565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:40.122565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:40.122565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.122565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:40.122762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.122762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:40.122762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:40.122762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:40.122762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:40.122762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:40.122762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.122762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:40.122762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:40.122762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.122762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:40.122762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:40.122762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.122762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:40.122762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:40.122762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:40.123841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:40.124726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:40.124726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:40.124726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:40.124726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:40.124726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:40.124726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.124726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:40.125734 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:40.125835 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:40.126040 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:40.126251 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:40.126785 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:40.127144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.127944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:40.127944 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:40.127944 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:40.127944 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:40.127944 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:40.127944 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:40.127944 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.127944 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:40.128989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.128989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:40.128989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:40.128989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:40.128989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.128989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:40.128989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:40.128989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:40.128989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.128989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:40.128989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:40.128989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:40.128989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:40.128989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:40.128989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:40.129310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:40.129310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:40.129310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:40.129310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:40.129310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:40.129310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:40.129310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:40.129310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.129310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:40.130034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.130034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:40.130034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:40.130034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:40.130034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.130034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:40.130034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:40.130034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:40.130034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:40.130034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.130034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:40.130295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:40.130295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:40.130295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.130295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:40.130295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:40.130295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:40.130295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:40.130295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:40.130295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:40.130295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:40.130295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:40.130295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:40.130295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:40.130295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:40.130587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:40.130587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:40.130587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.130587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.131431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:40.131797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:40.132163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:40.132163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:40.132163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.132163 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:40.133480 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:40.133756 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:40.133936 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:40.134166 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:40.134695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:40.135055 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:40.135309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.136225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:40.136225 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:40.136225 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:40.136225 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:40.136225 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:40.136225 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:40.136225 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.136225 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:40.137849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.137849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:40.137849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:40.137849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:40.137849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.137849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:40.137849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:40.137849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.137849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:40.137849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:40.137849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:40.137849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.138233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:40.138233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:40.138233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:40.138233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:40.138233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:40.138233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:40.138233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:40.138233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:40.138233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:40.138233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:40.138233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:40.138233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:40.138233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:40.138592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.138592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:40.138820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.138820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:40.138820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:40.138820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:40.138820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:40.138820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:40.138820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.138820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:40.138820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:40.138820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.138820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:40.138820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:40.138820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.138820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:40.138820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:40.138820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:40.139285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:40.139817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:40.139817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:40.139817 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:44.888023 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:44.888860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:44.888860 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:44.889850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:44.923983 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:44.924348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:44.925115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:44.925115 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:44.925115 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:44.925115 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:44.925115 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:44.925115 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:44.925115 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:44.925115 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:44.925777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:44.925777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:44.925777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:44.925777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:44.925777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:44.925777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:44.925777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:44.925777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:44.925777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:44.925777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:44.925777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:44.925777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:44.926159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:44.926159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:44.926159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:44.926159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:44.926159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:44.926159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:44.926159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:44.926159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:44.926159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:44.926159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:44.926159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:44.926159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:44.926159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:44.926521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:44.926521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:44.926521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:44.926521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:44.926521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:44.926521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:44.926521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:44.926521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:44.926521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:44.926521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:44.926521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:44.926521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:44.926521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:44.926521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:44.926521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:44.926937 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:44.927455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:44.927455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:44.927455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:44.927455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:44.927455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:44.927455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:45.110925 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:45.111241 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:45.111484 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:45.113575 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:45.113960 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:45.114106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.115438 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:45.115438 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:45.115438 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:45.115438 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:45.115438 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:45.115438 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:45.115438 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.115438 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:45.117587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.117587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:45.117587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:45.117587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:45.117587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.117587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:45.117587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:45.117587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.117587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:45.117587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:45.117587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:45.117587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.118261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:45.118261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:45.118261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:45.118261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:45.118261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:45.118261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:45.118261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:45.118261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:45.118261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:45.118261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:45.118261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:45.118261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:45.118261 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:45.118928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.118928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:45.119408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.119408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:45.119408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:45.119408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:45.119408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:45.119408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:45.119408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.119408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:45.119408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:45.119408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.119408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:45.119408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:45.119408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.119408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:45.119408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:45.119408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:45.119999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:45.120560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:45.120560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.120560 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:45.120560 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:45.120560 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:45.120560 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:45.120560 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:57:45.120560 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:45.120870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.121625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:45.121625 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:45.121625 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:45.121625 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:45.121625 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:45.121625 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:45.121625 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.121625 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:45.122512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.122512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:45.122512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:45.122512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:45.122512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.122512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:45.122512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:45.122512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:45.122512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.122512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:45.122512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:45.122512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:45.122512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:45.122512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:45.122512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:45.123011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:45.123011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:45.123011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:45.123011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:45.123011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:45.123011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:45.123011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:45.123011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.123011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:45.123344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.123344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:45.123344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:45.123344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:45.123344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.123344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:45.123344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:45.123344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:57:45.123344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:45.123344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:45.123344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.123344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:45.123744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:45.123744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:45.123744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.123744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:45.123744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:45.123744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:45.123744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:45.123744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:45.123744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:45.123744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:45.123744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:45.123744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:45.123744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:45.123744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:45.124141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:45.124141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:45.124141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.124141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:45.124393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.124393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:45.124393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:45.124393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:45.124393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:45.124393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:45.124393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.124393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:45.124393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:45.124393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.124393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:45.124393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:45.124393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.124393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:45.124393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:45.124393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:45.124860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:45.125405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:45.125405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:45.125405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:45.125405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:45.125405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:45.125405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.125405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:45.125797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:45.125947 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:45.126011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:45.126150 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:45.126704 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:45.127082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.127864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:45.127864 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:45.127864 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:45.127864 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:45.127864 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:45.127864 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:45.127864 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.127864 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:45.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:45.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:45.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:45.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:45.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:45.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:45.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:45.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:45.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:45.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:45.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:45.128449 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:45.128877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:45.128877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:45.128877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:45.128877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:45.128877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:45.128877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:45.128877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:45.128877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.128877 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:45.129147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.129147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:45.129147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:45.129147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:45.129147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.129147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:45.129147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:45.129147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:45.129147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:45.129147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.129147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:45.129500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:45.129500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:45.129500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.129500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:45.129500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:45.129500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:45.129500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:45.129500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:45.129500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:45.129500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:45.129500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:45.129500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:45.129500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:45.129500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:45.129888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:45.129888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:45.129888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.129888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:45.129888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.129888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:45.129888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:45.129888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:45.129888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:45.129888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:45.129888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.129888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:45.129888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:45.129888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:45.130290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:45.130914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:45.130914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:45.130914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:45.130914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:45.130914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:45.130914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:45.130914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:45.130914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:45.130914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:45.130914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.130914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:45.133731 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:45.133877 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:45.133933 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:45.134088 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:45.134609 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:45.134970 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:45.135210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.136046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:45.136046 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:45.136046 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:45.136046 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:45.136046 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:45.136046 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:45.136046 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.136046 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:45.137138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.137138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:45.137138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:45.137138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:45.137138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.137138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:45.137138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:45.137138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.137138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:45.137138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:45.137138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:45.137138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.137521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:45.137521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:45.137521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:45.137521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:45.137521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:45.137521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:45.137521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:45.137521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:45.137521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:45.137521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:45.137521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:45.137521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:45.137521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:45.137883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.137883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:45.138694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.138694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:45.138694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:45.138694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:45.138694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:45.138694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:45.138694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.138694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:45.138694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:45.138694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.138694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:45.138694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:45.138694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.138694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:45.138694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:45.138694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:45.139146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:45.139665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:45.139665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:45.139665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:49.889178 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:49.890115 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:49.890115 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:49.891048 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:49.936683 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:49.936683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:49.937353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:49.937353 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:49.937353 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:49.937353 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:49.937353 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:49.937353 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:49.937353 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:49.937353 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:49.938670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.048 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:49.938670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:49.938670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:49.938670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:49.938670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:49.938670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:49.938670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:49.938670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:49.938670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:49.938670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:49.938670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:49.938670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:49.939750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:49.939750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:49.939750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:49.939750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:49.939750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:49.939750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:49.939750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:49.939750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:49.939750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:49.939750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:49.939750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:49.939750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:49.939750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:49.940180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:49.940180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:49.940180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:49.940180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:49.940180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:49.940180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:49.940180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:49.940180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:49.940180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:49.940180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:49.940180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:49.940180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:49.940180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:49.940180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:49.940180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:49.940700 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:49.941335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:49.941335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:49.941335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:49.941335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:49.941335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:49.941335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:50.111690 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:50.112275 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:50.112537 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:50.113972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:50.114373 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:50.114760 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.115750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:50.115750 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:50.115750 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:50.115750 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:50.115750 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:50.115750 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:50.115750 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.115750 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:50.116975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.116975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:50.116975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:50.116975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:50.116975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.116975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:50.116975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:50.116975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.116975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:50.116975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:50.116975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:50.116975 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.117408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:50.117408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:50.117408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:50.117408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:50.117408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:50.117408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:50.117408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:50.117408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:50.117408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:50.117408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:50.117408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:50.117408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:50.117408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:50.117769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.117769 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:50.118099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.118099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:50.118099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:50.118099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:50.118099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:50.118099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:50.118099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.118099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:50.118099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:50.118099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.118099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:50.118099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:50.118099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.118099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:50.118099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:50.118099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:50.118636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:50.119146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:50.119146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.119146 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:50.119739 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:50.119939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:50.120047 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:50.120168 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:57:50.120720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:50.121064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.121830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:50.121830 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:50.121830 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:50.121830 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:50.121830 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:50.121830 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:50.121830 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.121830 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:50.122644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.122644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:50.122644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:50.122644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:50.122644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.122644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:50.122644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:50.122644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:50.122644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.122644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:50.122644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:50.122644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:50.122644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:50.122644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:50.122644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:50.123157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:50.123157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:50.123157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:50.123157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:50.123157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:50.123157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:50.123157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:50.123157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.123157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:50.123483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.123483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:50.123483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:50.123483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:50.123483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.123483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:50.123483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:50.123483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:57:50.123483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:50.123483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:50.123483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.123483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:50.123866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:50.123866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:50.123866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.123866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:50.123866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:50.123866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:50.123866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:50.123866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:50.123866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:50.123866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:50.123866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:50.123866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:50.123866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:50.123866 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:50.124279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:50.124279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:50.124279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.124279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:50.124476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.124476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:50.124476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:50.124476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:50.124476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:50.124476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:50.124476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.124476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:50.124476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:50.124476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.124476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:50.124476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:50.124476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.124476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:50.124476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:50.124476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:50.125016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:50.125559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:50.125559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:50.125559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:50.125559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:50.125559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:50.125559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.125559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:50.126031 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:50.126213 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:50.126322 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:50.126473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:50.126972 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:50.127391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.128353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:50.128353 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:50.128353 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:50.128353 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:50.128353 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:50.128353 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:50.128353 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.128353 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:50.129169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.129169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:50.129169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:50.129169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:50.129169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.129169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:50.129169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:50.129169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:50.129169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.129169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:50.129169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:50.129169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:50.129169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:50.129169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:50.129169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:50.129642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:50.129642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:50.129642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:50.129642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:50.129642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:50.129642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:50.129642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:50.129642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.129642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:50.130062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.130062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:50.130062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:50.130062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:50.130062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.130062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:50.130062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:50.130062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:50.130062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:50.130062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.130062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:50.130478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:50.130478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:50.130478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.130478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:50.130478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:50.130478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:50.130478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:50.130478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:50.130478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:50.130478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:50.130478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:50.130478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:50.130478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:50.130478 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:50.130885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:50.130885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:50.130885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.130885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.131117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:50.131643 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:50.132153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:50.132153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:50.132153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.132153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:50.133961 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:50.134144 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:50.134253 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:50.134452 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:50.134907 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:50.135291 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:50.135735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.136334 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:50.136334 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:50.136334 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:50.136334 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:50.136334 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:50.136334 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:50.136334 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.136334 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:50.137225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.137225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:50.137225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:50.137225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:50.137225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.137225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:50.137225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:50.137225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.137225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:50.137225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:50.137225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:50.137225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.137625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:50.137625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:50.137625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:50.137625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:50.137625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:50.137625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:50.137625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:50.137625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:50.137625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:50.137625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:50.137625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:50.137625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:50.137625 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:50.137983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.137983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:50.138196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.138196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:50.138196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:50.138196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:50.138196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:50.138196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:50.138196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.138196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:50.138196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:50.138196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.138196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:50.138196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:50.138196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.138196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:50.138196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:50.138196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:50.138704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:50.139273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:50.139273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:50.139273 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:54.889845 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:54.890574 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:54.890574 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:54.892197 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:54.895660 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:57:54.933258 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:54.933258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:54.933607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:54.933607 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:54.933607 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:54.933607 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:54.933607 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:54.933607 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:54.933607 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:54.933607 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:54.934868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:54.934868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:54.934868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:54.934868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:54.934868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:54.934868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:54.934868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:54.934868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:54.934868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:54.934868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:54.934868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:54.934868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:54.935264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:54.935264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:54.935264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:54.935264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:54.935264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:54.935264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:54.935264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:54.935264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:54.935264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:54.935264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:54.935264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:54.935264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:54.935264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:54.935696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:54.935696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:54.936060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:54.936060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:54.936060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:54.936060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:54.936060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:54.936060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:54.936060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:54.936060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:54.936060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:54.936060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:54.936060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:54.936060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:54.936060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:54.936060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:54.936060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:54.936060 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:54.936731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:54.937229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:54.937229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:54.937229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:55.112675 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:55.113127 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:55.113309 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:55.116476 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:55.116476 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:55.116476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.116806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:55.116806 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:55.116806 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:55.116806 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:55.116806 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:55.116806 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:55.116806 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.116806 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:55.118447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.118447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:55.118447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:55.118447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:55.118447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.118447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:55.118447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:55.118447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.118447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:55.118447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:55.118447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:55.118447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.119166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:55.119166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:55.119166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:55.119166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:55.119166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:55.119166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:55.119166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:55.119166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:55.119166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:55.119166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:55.119166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:55.119166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:55.119166 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:55.119882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.119882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:55.120256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.120256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:55.120256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:55.120256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:55.120256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:55.120256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:55.120256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.120256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:55.120256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:55.120256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.120256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:55.120256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:55.120256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.120256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:55.120256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:55.120256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:55.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:55.122160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:55.122160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.122160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:55.122160 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:55.122160 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:55.122160 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:55.122160 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:57:55.123811 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:55.123811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.124026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:55.124026 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:55.124026 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:55.124026 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:55.124026 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:55.124026 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:55.124026 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.124026 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:55.125067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.125067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:55.125067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:55.125067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:55.125067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.125067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:55.125067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:55.125067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:55.125067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.125067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:55.125067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:55.125067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:55.125067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:55.125067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:55.125067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:55.125521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:55.125521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:55.125521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:55.125521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:55.125521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:55.125521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:55.125521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:55.125521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.125521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:55.126598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.126598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:55.126598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:55.126598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:55.126598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.126598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:55.126598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:55.126598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:57:55.126598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:55.126598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:55.126598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.126598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:55.127037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:55.127037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:55.127037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.127037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:55.127037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:55.127037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:55.127037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:55.127037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:55.127037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:55.127037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:55.127037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:55.127037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:55.127037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:55.127037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:55.127458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:55.127458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:55.127458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.127458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:55.127458 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:55.128202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.128202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:55.128202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:55.128202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:55.128202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:55.128202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:55.128202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.128202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:55.128202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:55.128202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.128202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:55.128202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:55.128202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.128202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:55.128202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:55.128202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:55.128661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:55.129113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:55.129113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:55.129113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:55.129113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:55.129113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:55.129113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.129113 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:55.129113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:55.129113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:55.129113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:55.130257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:55.130735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.131920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:55.131920 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:55.131920 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:55.131920 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:55.131920 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:55.131920 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:55.131920 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.131920 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:55.132793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.132793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:57:55.132793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:55.132793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:55.132793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.132793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:55.132793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:55.132793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:55.132793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.132793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:57:55.132793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:55.132793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:57:55.132793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:55.132793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:57:55.132793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:57:55.133258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:55.133258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:57:55.133258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:55.133258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:57:55.133258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:57:55.133258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:55.133258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:57:55.133258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.133258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:57:55.133599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.133599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:55.133599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:55.133599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:55.133599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.133599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:55.133599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:55.133599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:55.133599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:55.133599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.133599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:55.134122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:55.134122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:55.134122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.134122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:55.134122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:55.134122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:55.134122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:55.134122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:55.134122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:55.134122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:55.134122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:55.134122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:55.134122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:55.134122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:55.135058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:55.135058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:55.135058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.135058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:55.135058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.135058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:55.135058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:55.135058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:55.135058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:55.135058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:55.135058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.135058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:55.135058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:55.135058 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:55.135559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:55.135885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:55.135885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:55.135885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:55.135885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:55.135885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:55.135885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:55.135885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:55.135885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:55.135885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:55.135885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.135885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:55.135885 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:55.135885 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:55.136130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:55.136130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:55.136130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:55.136130 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:55.136221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.136869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:55.136869 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:55.136869 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:55.136869 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:55.136869 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:55.136869 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:55.136869 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.136869 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:55.137509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.137509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:55.137509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:55.137509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:55.137509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.137509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:55.137509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:55.137509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.137509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:55.137509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:55.137509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:55.137509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.137781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:55.137781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:55.137781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:55.137781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:55.137781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:55.137781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:55.137781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:55.137781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:55.137781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:55.137781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:55.137781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:55.137781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:55.137781 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:55.138010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.138010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:55.138356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.138356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:55.138356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:55.138356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:55.138356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:55.138356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:55.138356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.138356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:55.138356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:55.138356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.138356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:55.138356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:55.138356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.138356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:55.138356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:55.138356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:55.138993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:55.139552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:55.139552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:55.139552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:57:59.890704 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:57:59.891699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:57:59.891699 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:57:59.892717 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:57:59.925940 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:57:59.926358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:59.927349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:57:59.927349 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:59.927349 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:57:59.927349 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:57:59.927349 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:59.927349 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:57:59.927349 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:59.927349 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:57:59.928174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:59.928174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:57:59.928174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:59.928174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:57:59.928174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:59.928174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:59.928174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:59.928174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:59.928174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:59.928174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:59.928174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:59.928174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:59.928653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:57:59.928653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:59.928653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:57:59.928653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:59.928653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:57:59.928653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:57:59.928653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:59.928653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:57:59.928653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:59.928653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:57:59.928653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:57:59.928653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:59.928653 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:57:59.929104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:59.929104 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:57:59.929551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:59.929551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:57:59.929551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:57:59.929551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:57:59.929551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:57:59.929551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:57:59.929551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:59.929551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:57:59.929551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:57:59.929551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:59.929551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:57:59.929551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:57:59.929551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:57:59.929551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:57:59.929551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:57:59.929551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:57:59.930152 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:57:59.930841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:57:59.930841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:57:59.930841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:00.113310 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:00.114263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:00.114493 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:00.116312 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:00.116670 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:00.116846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.117665 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:00.117665 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:00.117665 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:00.117665 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:00.117665 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:00.117665 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:00.117665 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.117665 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:00.119542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.119542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:00.119542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:00.119542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:00.119542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.119542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:00.119542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:00.119542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.119542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:00.119542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:00.119542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:00.119542 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.120182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:00.120182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:00.120182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:00.120182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:00.120182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:00.120182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:00.120182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:00.120182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:00.120182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:00.120182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:00.120182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:00.120182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:00.120182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:00.120872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.120872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:00.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:00.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:00.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:00.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:00.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:00.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:00.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:00.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:00.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:00.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:00.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:00.121150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:00.121914 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:00.122818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:00.122818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.122818 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:00.122818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:00.122818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:00.122818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:00.122818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:58:00.122818 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:00.123296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.123455 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:00.123455 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:00.123455 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:00.123455 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:00.123455 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:00.123455 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:00.123455 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.123455 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:00.124212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.124212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:00.124212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:00.124212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:00.124212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.124212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:00.124212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:00.124212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:00.124212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.124212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:00.124212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:00.124212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:00.124212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:00.124212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:00.124212 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:00.125090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:00.125090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:00.125090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:00.125090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:00.125090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:00.125090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:00.125090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:00.125090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.125090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:00.125090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.125090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:00.125090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:00.125090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:00.125090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.125841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:00.125841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:00.125841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:58:00.125841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:00.125841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:00.125841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.125841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:00.125841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:00.125841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:00.125841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.125841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:00.125841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:00.125841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:00.126520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:00.126520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:00.126520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:00.126520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:00.126520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:00.126520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:00.126520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:00.126520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:00.126520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:00.126520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:00.126520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.126520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:00.127151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.127151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:00.127151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:00.127151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:00.127151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:00.127151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:00.127151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.127151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:00.127151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:00.127151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.127151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:00.127151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:00.127151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.127151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:00.127151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:00.127151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:00.128067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:00.128632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:00.128632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:00.128632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:00.128632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:00.128632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:00.128632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.128632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:00.128632 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:00.128893 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:00.129010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:00.129139 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:00.129694 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:00.130080 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.130939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:00.130939 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:00.130939 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:00.130939 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:00.130939 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:00.130939 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:00.130939 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.130939 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:00.131726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.131726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:00.131726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:00.131726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:00.131726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.131726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:00.131726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:00.131726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:00.131726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.131726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:00.131726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:00.131726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:00.131726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:00.131726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:00.131726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:00.132183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:00.132183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:00.132183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:00.132183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:00.132183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:00.132183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:00.132183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:00.132183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.132183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:00.132587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.132587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:00.132587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:00.132587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:00.132587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.132587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:00.132587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:00.132587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:00.132587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:00.132587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.132587 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:00.132965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:00.132965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:00.132965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.132965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:00.132965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:00.132965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:00.132965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:00.132965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:00.132965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:00.132965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:00.132965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:00.132965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:00.132965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:00.132965 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:00.133356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:00.133356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:00.133356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.133356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.133621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:00.134129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:00.134687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:00.134687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:00.134687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.134687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:00.135097 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:00.135502 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:00.135502 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:00.135656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:00.136992 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:00.137283 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:00.137488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.138201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:00.138201 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:00.138201 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:00.138201 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:00.138201 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:00.138201 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:00.138201 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.138201 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:00.139067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.139067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:00.139067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:00.139067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:00.139067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.139067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:00.139067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:00.139067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.139067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:00.139067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:00.139067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:00.139067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.139524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:00.139524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:00.139524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:00.139524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:00.139524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:00.139524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:00.139524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:00.139524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:00.139524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:00.139524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:00.139524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:00.139524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:00.139524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:00.139891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.139891 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:00.140037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.140037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:00.140037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:00.140037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:00.140037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:00.140037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:00.140037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.140037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:00.140037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:00.140037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.140037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:00.140037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:00.140037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.140037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:00.140037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:00.140037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:00.140546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:00.141179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:00.141179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:00.141179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:04.891429 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:04.892496 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:04.892796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:04.894290 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:04.938791 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:04.939258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:04.940030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:04.940030 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:04.940030 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:04.940030 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:04.940030 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:04.940030 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:04.940030 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:04.940030 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:04.941062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.047 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:04.941062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:04.941062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:04.941062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:04.941062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:04.941062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:04.941062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:04.941062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:04.941062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:04.941062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:04.941062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:04.941062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:04.942260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:04.942260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:04.942260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:04.942260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:04.942260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:04.942260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:04.942260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:04.942260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:04.942260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:04.942260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:04.942260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:04.942260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:04.942260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:04.942875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:04.942875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:04.942875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:04.942875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:04.942875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:04.942875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:04.942875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:04.942875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:04.942875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:04.942875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:04.942875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:04.942875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:04.942875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:04.942875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:04.942875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:04.943415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:04.943985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:04.943985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:04.943985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:04.943985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:04.943985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:04.943985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:05.123656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:05.123656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:05.123656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:05.123656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:05.124932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:05.124932 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:05.124932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.125454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:05.125454 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:05.125454 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:05.125454 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:05.125454 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:05.125454 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:05.125454 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.125454 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:05.126253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.126253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:05.126253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:05.126253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:05.126253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.126253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:05.126253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:05.126253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.126253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:05.126253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:05.126253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:05.126253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.126595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:05.126595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:05.126595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:05.126595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:05.126595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:05.126595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:05.126595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:05.126595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:05.126595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:05.126595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:05.126595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:05.126595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:05.126595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:05.126890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.126890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:05.127064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.127064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:05.127064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:05.127064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:05.127064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:05.127064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:05.127064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.127064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:05.127064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:05.127064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.127064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:05.127064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:05.127064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.127064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:05.127064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:05.127064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:05.127529 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:05.127959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:05.127959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.127959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:05.127959 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:05.127959 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:05.127959 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:58:05.129087 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:05.130984 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:05.131453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.132072 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:05.132072 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:05.132072 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:05.132072 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:05.132072 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:05.132072 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:05.132072 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.132072 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:05.132711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.132711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:05.132711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:05.132711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:05.132711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.132711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:05.132711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:05.132711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:05.132711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.132711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:05.132711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:05.132711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:05.132711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:05.132711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:05.132711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:05.133279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:05.133279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:05.133279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:05.133279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:05.133279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:05.133279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:05.133279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:05.133279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.133279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:05.133692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.133692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:05.133692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:05.133692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:05.133692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.133692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:05.133692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:05.133692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:58:05.133692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:05.133692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:05.133692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.133692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:05.134298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:05.134298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:05.134298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.134298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:05.134298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:05.134298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:05.134298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:05.134298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:05.134298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:05.134298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:05.134298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:05.134298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:05.134298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:05.134298 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:05.134800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:05.134800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:05.134800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.134800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:05.134800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.134800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:05.134800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:05.134800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:05.134800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:05.134800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:05.134800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.134800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:05.134800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:05.134800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:05.135276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:05.135915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:05.135915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:05.135915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:05.135915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:05.135915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:05.135915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:05.135915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:05.135915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:05.135915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:05.135915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:05.135915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.135915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:05.135915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:05.135915 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:05.136405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:05.136405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:05.136405 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:05.136405 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.137233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:05.137233 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:05.137233 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:05.137233 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:05.137233 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:05.137233 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:05.137233 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.137233 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:05.138005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.138005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:05.138005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:05.138005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:05.138005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.138005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:05.138005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:05.138005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:05.138005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.138005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:05.138005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:05.138005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:05.138005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:05.138005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:05.138005 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:05.138538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:05.138538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:05.138538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:05.138538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:05.138538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:05.138538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:05.138538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:05.138538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.138538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:05.138926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.138926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:05.138926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:05.138926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:05.138926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.138926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:05.138926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:05.138926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:05.138926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:05.138926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.138926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:05.139283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:05.139283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:05.139283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.139283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:05.139283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:05.139283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:05.139283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:05.139283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:05.139283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:05.139283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:05.139283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:05.139283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:05.139283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:05.139283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:05.139761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:05.139761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:05.139761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.139761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.140036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:05.140640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:05.141253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:05.141253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:05.141253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.141253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:05.141253 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:05.141253 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:05.141253 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:05.141253 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:05.141713 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:05.141713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.142573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:05.142573 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:05.142573 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:05.142573 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:05.142573 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:05.142573 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:05.142573 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.142573 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:05.143481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.143481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:05.143481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:05.143481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:05.143481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.143481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:05.143481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:05.143481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.143481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:05.143481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:05.143481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:05.143481 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.143936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:05.143936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:05.143936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:05.143936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:05.143936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:05.143936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:05.143936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:05.143936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:05.143936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:05.143936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:05.143936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:05.143936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:05.143936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:05.144335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.144335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:05.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:05.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:05.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:05.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:05.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:05.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:05.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:05.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:05.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:05.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:05.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:05.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:05.145416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:05.145973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:05.145973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:05.145973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:09.892518 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:09.894015 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:09.894015 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:09.896022 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:09.928003 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:09.929447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:09.929685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:09.929685 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:09.929685 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:09.929685 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:09.929685 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:09.929685 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:09.929685 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:09.929685 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:09.930521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:09.930521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:09.930521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:09.930521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:09.930521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:09.930521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:09.930521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:09.930521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:09.930521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:09.930521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:09.930521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:09.930521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:09.931193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:09.931193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:09.931193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:09.931193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:09.931193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:09.931193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:09.931193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:09.931193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:09.931193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:09.931193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:09.931193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:09.931193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:09.931193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:09.931869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:09.931869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:09.931869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:09.931869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:09.931869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:09.931869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:09.931869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:09.931869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:09.931869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:09.931869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:09.931869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:09.931869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:09.931869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:09.931869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:09.931869 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:09.932646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:09.933730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:09.933730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:09.933730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:09.933730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:09.933730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:09.933730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:10.123288 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:10.124075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:10.124266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:10.126634 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:10.126634 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:10.126634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.127694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:10.127694 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:10.127694 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:10.127694 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:10.127694 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:10.127694 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:10.127694 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.127694 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:10.129546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.129546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:10.129546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:10.129546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:10.129546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.129546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:10.129546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:10.129546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.129546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:10.129546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:10.129546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:10.129546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.130681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:10.130681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:10.130681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:10.130681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:10.130681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:10.130681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:10.130681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:10.130681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:10.130681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:10.130681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:10.130681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:10.130681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:10.130681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:10.131388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.131388 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:10.131388 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:10.131999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.131999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:10.131999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:10.131999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:10.131999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:10.131999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:10.131999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.131999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:10.131999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:10.131999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.131999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:10.131999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:10.131999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.131999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:10.131999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:10.131999 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:10.133534 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:10.134425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:10.134425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.134425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:10.134425 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:10.134425 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:10.134425 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:58:10.134425 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:10.134425 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.134882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:10.134882 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:10.134882 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:10.134882 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:10.134882 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:10.134882 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:10.134882 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.134882 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:10.135234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.135234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:10.135234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:10.135234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:10.135234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.135234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:10.135234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:10.135234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:10.135234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.135234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:10.135234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:10.135234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:10.135234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:10.135234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:10.135234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:10.136047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:10.136047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:10.136047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:10.136047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:10.136047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:10.136047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:10.136047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:10.136047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.136047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:10.136047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.136047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:10.136047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:10.136047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:10.136047 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.136778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:10.136778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:10.136778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:58:10.136778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:10.136778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:10.136778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.136778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:10.136778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:10.136778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:10.136778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.136778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:10.136778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:10.136778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:10.137616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:10.137616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:10.137616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:10.137616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:10.137616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:10.137616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:10.137616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:10.137616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:10.137616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:10.137616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:10.137616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.137616 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:10.138153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.138153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:10.138153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:10.138153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:10.138153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:10.138153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:10.138153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.138153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:10.138153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:10.138153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.138153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:10.138153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:10.138153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.138153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:10.138153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:10.138153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:10.138916 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:10.139757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:10.139757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:10.139757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:10.139757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:10.139757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:10.139757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.139757 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:10.139757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:10.139757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:10.139757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:10.140274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:10.140274 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:10.140274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.140274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:10.140274 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:10.140274 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:10.140274 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:10.140274 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:10.140274 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:10.140274 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.140274 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:10.140274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:10.140850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:10.141669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:10.141669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:10.141669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:10.141669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:10.141669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.141669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:10.141669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.141669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:10.141669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:10.141669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:10.141669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.141669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:10.141669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:10.142311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:10.142311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:10.142311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.142311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:10.142311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:10.142311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:10.142311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.142311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:10.142311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:10.142311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:10.142311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:10.142311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:10.142311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:10.143117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:10.143117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:10.143117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:10.143117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:10.143117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:10.143117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:10.143117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:10.143117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.143117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:10.143117 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.143494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:10.143862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:10.144263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:10.144263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:10.144263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.144263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:10.144263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:10.144263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:10.144263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:10.144263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:10.144495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:10.144495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.145026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:10.145026 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:10.145026 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:10.145026 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:10.145026 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:10.145026 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:10.145026 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.145026 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:10.145892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.145892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:10.145892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:10.145892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:10.145892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.145892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:10.145892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:10.145892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.145892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:10.145892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:10.145892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:10.145892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.146174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:10.146174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:10.146174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:10.146174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:10.146174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:10.146174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:10.146174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:10.146174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:10.146174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:10.146174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:10.146174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:10.146174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:10.146174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:10.146493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.146493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:10.146887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.146887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:10.146887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:10.146887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:10.146887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:10.146887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:10.146887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.146887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:10.146887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:10.146887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.146887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:10.146887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:10.146887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.146887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:10.146887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:10.146887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:10.147237 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:10.147751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:10.147751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:10.147751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:14.893235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:14.894134 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:14.894134 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:14.894895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:14.930814 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:14.931391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:14.932844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:14.932844 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:14.932844 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:14.932844 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:14.932844 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:14.932844 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:14.932844 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:14.932844 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:14.933360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:14.933360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:14.933360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:14.933360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:14.933360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:14.933360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:14.933360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:14.933360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:14.933360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:14.933360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:14.933360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:14.933360 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:14.934837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:14.934837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:14.934837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:14.934837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:14.934837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:14.934837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:14.934837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:14.934837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:14.934837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:14.934837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:14.934837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:14.934837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:14.934837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:14.935533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:14.935533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:14.935533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:14.935533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:14.935533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:14.935533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:14.935533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:14.935533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:14.935533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:14.935533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:14.935533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:14.935533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:14.935533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:14.935533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:14.935533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:14.936508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:14.937159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:14.937159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:14.937159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:14.937159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:14.937159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:14.937159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:15.124172 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:15.124814 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:15.125011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:15.126421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:15.126876 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:15.127150 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.128245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:15.128245 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:15.128245 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:15.128245 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:15.128245 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:15.128245 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:15.128245 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.128245 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:15.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:15.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:15.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:15.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:15.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:15.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:15.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:15.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:15.129277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.129808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:15.129808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:15.129808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:15.129808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:15.129808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:15.129808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:15.129808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:15.129808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:15.129808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:15.129808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:15.129808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:15.129808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:15.129808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:15.130337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.130337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:15.130337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.130337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:15.130337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:15.130337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:15.130337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:15.130337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:15.130337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.130337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:15.130337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:15.130337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.130337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:15.130337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:15.130337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:15.130972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:15.131716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:15.131716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:15.131716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:15.131716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:15.131716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.131716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:15.132981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:15.132981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:15.132981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:15.132981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:58:15.133586 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:15.133977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.134847 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:15.134847 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:15.134847 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:15.134847 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:15.134847 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:15.134847 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:15.134847 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.134847 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:15.135709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.135709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:15.135709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:15.135709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:15.135709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.135709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:15.135709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:15.135709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:15.135709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.135709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:15.135709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:15.135709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:15.135709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:15.135709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:15.135709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:15.137244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:15.137244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:15.137244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:15.137244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:15.137244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:15.137244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:15.137244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:15.137244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.137244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:15.137244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.137244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:15.137244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:15.137244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:15.137244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.138240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:15.138240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:15.138240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:58:15.138240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:15.138240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:15.138240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.138240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:15.138240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:15.138240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:15.138240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.138240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:15.138240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:15.138240 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:15.138960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:15.138960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:15.138960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:15.138960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:15.138960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:15.138960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:15.138960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:15.138960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:15.138960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:15.138960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:15.138960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.138960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:15.139271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.139271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:15.139271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:15.139271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:15.139271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:15.139271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:15.139271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.139271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:15.139271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:15.139271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.139271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:15.139271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:15.139271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.139271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:15.139271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:15.139271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:15.139686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:15.140196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:15.140196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:15.140196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:15.140196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:15.140196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:15.140196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.140196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:15.140196 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:15.140196 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:15.140196 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:15.141093 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:15.141093 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:15.141093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.141093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:15.141093 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:15.141093 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:15.141093 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:15.141093 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:15.141093 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:15.141093 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.141093 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:15.141093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:15.141605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:15.142434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:15.142434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:15.142434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:15.142434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:15.142434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.142434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:15.142434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.142434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:15.142434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:15.142434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:15.142434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.142434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:15.142434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:15.143162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:15.143162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:15.143162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.143162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:15.143162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:15.143162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:15.143162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.143162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:15.143162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:15.143162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:15.143162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:15.143162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:15.143162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:15.144040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:15.144040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:15.144040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:15.144040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:15.144040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:15.144040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:15.144040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:15.144040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.144040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:15.144040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.144040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:15.144040 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.144492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.144990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:15.145757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:15.145757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:15.145757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:15.145757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:15.145757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:15.145757 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:15.146011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.146011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:15.146011 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:15.146011 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:15.146011 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:15.146011 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:15.146011 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:15.146011 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.146011 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:15.146238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.146238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:15.146238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:15.146238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:15.146238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.146238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:15.146238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:15.146238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.146238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:15.146238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:15.146238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:15.146238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.146551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:15.146551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:15.146551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:15.146551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:15.146551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:15.146551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:15.146551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:15.146551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:15.146551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:15.146551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:15.146551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:15.146551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:15.146551 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:15.146931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.146931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:15.147211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.147211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:15.147211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:15.147211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:15.147211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:15.147211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:15.147211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.147211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:15.147211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:15.147211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.147211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:15.147211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:15.147211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.147211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:15.147211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:15.147211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:15.147694 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:15.148214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:15.148214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:15.148214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:19.894146 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:19.895280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:19.895280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:19.896568 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:19.932919 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:19.933263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:19.934024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:19.934024 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:19.934024 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:19.934024 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:19.934024 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:19.934024 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:19.934024 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:19.934024 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:19.934888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:19.934888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:19.934888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:19.934888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:19.934888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:19.934888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:19.934888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:19.934888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:19.934888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:19.934888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:19.934888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:19.934888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:19.935611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:19.935611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:19.935611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:19.935611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:19.935611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:19.935611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:19.935611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:19.935611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:19.935611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:19.935611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:19.935611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:19.935611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:19.935611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:19.936321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:19.936321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:19.936321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:19.936321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:19.936321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:19.936321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:19.936321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:19.936321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:19.936321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:19.936321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:19.936321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:19.936321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:19.936321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:19.936321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:19.936321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:19.937195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:19.938168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:19.938168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:19.938168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:19.938168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:19.938168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:19.938168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:20.124890 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:20.125807 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:20.125954 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:20.126994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:20.127287 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:20.127424 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.128290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:20.128290 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:20.128290 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:20.128290 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:20.128290 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:20.128290 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:20.128290 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.128290 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:20.130870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.130870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:20.130870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:20.130870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:20.130870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.130870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:20.130870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:20.130870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.130870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:20.130870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:20.130870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:20.130870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.131321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:20.131321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:20.131321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:20.131321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:20.131321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:20.131321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:20.131321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:20.131321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:20.131321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:20.131321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:20.131321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:20.131321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:20.131321 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:20.131763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.131763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:20.131763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.131763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:20.131763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:20.131763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:20.131763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:20.131763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:20.131763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.131763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:20.131763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:20.131763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.131763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:20.131763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:20.131763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:20.132187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:20.132807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:20.132807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:20.132807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:20.132807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:20.132807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.132807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:20.132973 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:20.133207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:20.133456 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:20.133456 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:58:20.133995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:20.134296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.135174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:20.135174 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:20.135174 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:20.135174 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:20.135174 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:20.135174 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:20.135174 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.135174 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:20.137172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.137172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:20.137172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:20.137172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:20.137172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.137172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:20.137172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:20.137172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:20.137172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.137172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:20.137172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:20.137172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:20.137172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:20.137172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:20.137172 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:20.137913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:20.137913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:20.137913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:20.137913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:20.137913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:20.137913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:20.137913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:20.137913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.137913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:20.139012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.139012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:20.139012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:20.139012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:20.139012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.139012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:20.139012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:20.139012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:58:20.139012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:20.139012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:20.139012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.139012 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:20.139557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:20.139557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:20.139557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.139557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:20.139557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:20.139557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:20.139557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:20.139557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:20.139557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:20.139557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:20.139557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:20.139557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:20.139557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:20.139557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:20.140071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:20.140071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:20.140071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.140071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:20.140071 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:20.141752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.141752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:20.141752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:20.141752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:20.141752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:20.141752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:20.141752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.141752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:20.141752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:20.141752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.141752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:20.141752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:20.141752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.141752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:20.141752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:20.141752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:20.142238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:20.142910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:20.142910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:20.142910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:20.142910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:20.142910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:20.142910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.142910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:20.142910 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:20.142910 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:20.142910 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:20.143295 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:20.143295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.143676 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:20.144299 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:20.144299 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:20.144299 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:20.144299 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:20.144299 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:20.144299 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:20.144299 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.144299 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:20.144840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.144840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:20.144840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:20.144840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:20.144840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.144840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:20.144840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:20.144840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:20.144840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.144840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:20.144840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:20.144840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:20.144840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:20.144840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:20.144840 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:20.145279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:20.145279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:20.145279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:20.145279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:20.145279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:20.145279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:20.145279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:20.145279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.145279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:20.145548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.145548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:20.145548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:20.145548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:20.145548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.145548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:20.145548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:20.145548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:20.145548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:20.145548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.145548 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:20.145921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:20.145921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:20.145921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.145921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:20.145921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:20.145921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:20.145921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:20.145921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:20.145921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:20.145921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:20.145921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:20.145921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:20.145921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:20.145921 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:20.146588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:20.146588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:20.146588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.146588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.146930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:20.147454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:20.147956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:20.147956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:20.147956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.147956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:20.147956 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:20.147956 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:20.147956 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:20.147956 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:20.148227 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:20.148227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.148536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:20.148536 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:20.148536 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:20.148536 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:20.148536 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:20.148536 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:20.148536 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.148536 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:20.149171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.149171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:20.149171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:20.149171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:20.149171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.149171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:20.149171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:20.149171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.149171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:20.149171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:20.149171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:20.149171 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.149565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:20.149565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:20.149565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:20.149565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:20.149565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:20.149565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:20.149565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:20.149565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:20.149565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:20.149565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:20.149565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:20.149565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:20.149565 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:20.149966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.149966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:20.150037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.150037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:20.150037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:20.150037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:20.150037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:20.150037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:20.150037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.150037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:20.150037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:20.150037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.150037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:20.150037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:20.150037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.150037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:20.150037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:20.150037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:20.150532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:20.151095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:20.151095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:20.151095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:24.895202 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:24.896165 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:24.896239 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:24.897826 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:24.934404 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:24.934633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:24.935773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:24.935773 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:24.935773 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:24.935773 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:24.935773 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:24.935773 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:24.935773 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:24.935773 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:24.937649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:24.937649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:24.937649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:24.937649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:24.937649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:24.937649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:24.937649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:24.937649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:24.937649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:24.937649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:24.937649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:24.937649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:24.938512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:24.938512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:24.938512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:24.938512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:24.938512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:24.938512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:24.938512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:24.938512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:24.938512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:24.938512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:24.938512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:24.938512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:24.938512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:24.939436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:24.939436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:24.939436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:24.939436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:24.939436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:24.939436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:24.939436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:24.939436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:24.939436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:24.939436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:24.939436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:24.939436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:24.939436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:24.939436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:24.939436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:24.941655 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:24.942283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:24.942283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:24.942283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:24.942283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:24.942283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:24.942283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:25.125902 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:25.126654 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:25.126864 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:25.128111 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:25.128594 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:25.129046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.129880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:25.129880 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:25.129880 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:25.129880 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:25.129880 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:25.129880 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:25.129880 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.129880 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:25.131581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.131581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:25.131581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:25.131581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:25.131581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.131581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:25.131581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:25.131581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.131581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:25.131581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:25.131581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:25.131581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.132223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:25.132223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:25.132223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:25.132223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:25.132223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:25.132223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:25.132223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:25.132223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:25.132223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:25.132223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:25.132223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:25.132223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:25.132223 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:25.132871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.132871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:25.133909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.133909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:25.133909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:25.133909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:25.133909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:25.133909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:25.133909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.133909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:25.133909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:25.133909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.133909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:25.133909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:25.133909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.133909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:25.133909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:25.133909 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:25.134749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:25.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:25.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:25.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:25.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:25.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:25.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:58:25.135615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:25.136051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.136584 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:25.136584 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:25.136584 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:25.136584 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:25.136584 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:25.136584 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:25.136584 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.136584 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:25.137740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.137740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:25.137740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:25.137740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:25.137740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.137740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:25.137740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:25.137740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:25.137740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.137740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:25.137740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:25.137740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:25.137740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:25.137740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:25.137740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:25.138320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:25.138320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:25.138320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:25.138320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:25.138320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:25.138320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:25.138320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:25.138320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.138320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:25.138320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.138320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:25.138320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:25.138320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:25.138320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.138765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:25.138765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:25.138765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:58:25.138765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:25.138765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:25.138765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.138765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:25.138765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:25.138765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:25.138765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.138765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:25.138765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:25.138765 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:25.139133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:25.139133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:25.139133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:25.139133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:25.139133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:25.139133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:25.139133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:25.139133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:25.139133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:25.139133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:25.139133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.139133 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:25.139472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.139472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:25.139472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:25.139472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:25.139472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:25.139472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:25.139472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.139472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:25.139472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:25.139472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.139472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:25.139472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:25.139472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.139472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:25.139472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:25.139472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:25.140016 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:25.140894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:25.140894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:25.140894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:25.140894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:25.140894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:25.140894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.140894 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:25.142254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:25.142645 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:25.142760 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:25.142909 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:25.143280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:25.143545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.144096 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:25.144096 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:25.144096 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:25.144096 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:25.144096 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:25.144096 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:25.144096 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.144096 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:25.144908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.144908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:25.144908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:25.144908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:25.144908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.144908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:25.144908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:25.144908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:25.144908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.144908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:25.144908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:25.144908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:25.144908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:25.144908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:25.144908 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:25.145471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:25.145471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:25.145471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:25.145471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:25.145471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:25.145471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:25.145471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:25.145471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.145471 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:25.145759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.145759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:25.145759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:25.145759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:25.145759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.145759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:25.145759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:25.145759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:25.145759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:25.145759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.145759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:25.146110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:25.146110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:25.146110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.146110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:25.146110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:25.146110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:25.146110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:25.146110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:25.146110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:25.146110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:25.146110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:25.146110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:25.146110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:25.146110 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:25.146516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:25.146516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:25.146516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.146516 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.146825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:25.147332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:25.147885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:25.147885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:25.147885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.147885 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:25.147885 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:25.147885 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:25.148084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:25.148084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:25.148462 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:25.148709 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:25.148863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.149409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:25.149409 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:25.149409 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:25.149409 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:25.149409 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:25.149409 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:25.149409 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.149409 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:25.150262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.150262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:25.150262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:25.150262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:25.150262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.150262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:25.150262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:25.150262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.150262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:25.150262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:25.150262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:25.150262 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.150634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:25.150634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:25.150634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:25.150634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:25.150634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:25.150634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:25.150634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:25.150634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:25.150634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:25.150634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:25.150634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:25.150634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:25.150634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:25.150978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.150978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:25.151227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.151227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:25.151227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:25.151227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:25.151227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:25.151227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:25.151227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.151227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:25.151227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:25.151227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.151227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:25.151227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:25.151227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.151227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:25.151227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:25.151227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:25.151753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:25.152337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:25.152337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:25.152337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:29.895933 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:29.897210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:29.897210 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:29.897790 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:29.940126 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:29.940327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:29.940986 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:29.940986 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:29.940986 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:29.940986 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:29.940986 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:29.940986 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:29.940986 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:29.940986 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:29.941992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.044 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:29.941992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:29.941992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:29.941992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:29.941992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:29.941992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:29.941992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:29.941992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:29.941992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:29.941992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:29.941992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:29.941992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:29.942739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:29.942739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:29.942739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:29.942739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:29.942739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:29.942739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:29.942739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:29.942739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:29.942739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:29.942739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:29.942739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:29.942739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:29.942739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:29.943487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:29.943487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:29.943487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:29.943487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:29.943487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:29.943487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:29.943487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:29.943487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:29.943487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:29.943487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:29.943487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:29.943487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:29.943487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:29.943487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:29.943487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:29.944588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:29.945452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:29.945452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:29.945452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:29.945452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:29.945452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:29.945452 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:30.126778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:30.127945 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:30.128174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:30.129778 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:30.130253 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:30.130546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.131654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:30.131654 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:30.131654 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:30.131654 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:30.131654 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:30.131654 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:30.131654 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.131654 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:30.133661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.133661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:30.133661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:30.133661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:30.133661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.133661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:30.133661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:30.133661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.133661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:30.133661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:30.133661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:30.133661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.134348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:30.134348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:30.134348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:30.134348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:30.134348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:30.134348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:30.134348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:30.134348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:30.134348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:30.134348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:30.134348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:30.134348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:30.134348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:30.134997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.134997 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:30.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:30.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:30.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:30.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:30.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:30.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:30.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:30.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:30.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:30.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:30.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:30.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:30.136844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:30.137990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:30.137990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.137990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:30.137990 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:30.137990 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:30.137990 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:30.137990 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:58:30.137990 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:30.138603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.138603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:30.138603 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:30.138603 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:30.138603 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:30.138603 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:30.138603 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:30.138603 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.138603 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:30.139281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.139281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:30.139281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:30.139281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:30.139281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.139281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:30.139281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:30.139281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:30.139281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.139281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:30.139281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:30.139281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:30.139281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:30.139281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:30.139281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:30.140316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:30.140316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:30.140316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:30.140316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:30.140316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:30.140316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:30.140316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:30.140316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.140316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:30.140316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.140316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:30.140316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:30.140316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:30.140316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.140973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:30.140973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:30.140973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:58:30.140973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:30.140973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:30.140973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.140973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:30.140973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:30.140973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:30.140973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.140973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:30.140973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:30.140973 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:30.141394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:30.141394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:30.141394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:30.141394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:30.141394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:30.141394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:30.141394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:30.141394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:30.141394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:30.141394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:30.141394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.141394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:30.141733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.141733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:30.141733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:30.141733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:30.141733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:30.141733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:30.141733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.141733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:30.141733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:30.141733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.141733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:30.141733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:30.141733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.141733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:30.141733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:30.141733 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:30.142189 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:30.142837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:30.142837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:30.142837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:30.142837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:30.142837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:30.142837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.142837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:30.142837 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:30.143174 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:30.143246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:30.143324 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:30.143849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:30.144429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.145079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:30.145079 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:30.145079 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:30.145079 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:30.145079 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:30.145079 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:30.145079 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.145079 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:30.145887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.145887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:30.145887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:30.145887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:30.145887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.145887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:30.145887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:30.145887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:30.145887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.145887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:30.145887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:30.145887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:30.145887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:30.145887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:30.145887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:30.146408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:30.146408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:30.146408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:30.146408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:30.146408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:30.146408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:30.146408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:30.146408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.146408 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:30.146752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.146752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:30.146752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:30.146752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:30.146752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.146752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:30.146752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:30.146752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:30.146752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:30.146752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.146752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:30.147176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:30.147176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:30.147176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.147176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:30.147176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:30.147176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:30.147176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:30.147176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:30.147176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:30.147176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:30.147176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:30.147176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:30.147176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:30.147176 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:30.147615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:30.147615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:30.147615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.147615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.148183 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:30.148830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:30.149427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:30.149427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:30.149427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.149427 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:30.149427 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:30.149427 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:30.149427 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:30.149427 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:30.149733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:30.149970 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:30.150199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.150972 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:30.150972 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:30.150972 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:30.150972 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:30.150972 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:30.150972 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:30.150972 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.150972 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:30.151827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.151827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:30.151827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:30.151827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:30.151827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.151827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:30.151827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:30.151827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.151827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:30.151827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:30.151827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:30.151827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.152208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:30.152208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:30.152208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:30.152208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:30.152208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:30.152208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:30.152208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:30.152208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:30.152208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:30.152208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:30.152208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:30.152208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:30.152208 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:30.152649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.152649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:30.152804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.152804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:30.152804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:30.152804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:30.152804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:30.152804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:30.152804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.152804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:30.152804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:30.152804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.152804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:30.152804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:30.152804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.152804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:30.152804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:30.152804 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:30.153288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:30.153874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:30.153874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:30.153874 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:34.896859 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:34.898022 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:34.898022 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:34.899286 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:34.937572 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:34.938042 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:34.938822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:34.938822 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:34.938822 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:34.938822 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:34.938822 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:34.938822 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:34.938822 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:34.938822 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:34.939821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:34.939821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:34.939821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:34.939821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:34.939821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:34.939821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:34.939821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:34.939821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:34.939821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:34.939821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:34.939821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:34.939821 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:34.941074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:34.941074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:34.941074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:34.941074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:34.941074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:34.941074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:34.941074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:34.941074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:34.941074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:34.941074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:34.941074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:34.941074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:34.941074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:34.941703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:34.941703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:34.941703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:34.941703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:34.941703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:34.941703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:34.941703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:34.941703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:34.941703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:34.941703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:34.941703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:34.941703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:34.941703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:34.941703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:34.941703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:34.942451 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:34.943292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:34.943292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:34.943292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:34.943292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:34.943292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:34.943292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:35.128191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:35.128921 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:35.129045 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:35.130306 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:35.130764 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:35.131067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.132165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:35.132165 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:35.132165 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:35.132165 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:35.132165 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:35.132165 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:35.132165 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.132165 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:35.133981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.133981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:35.133981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:35.133981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:35.133981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.133981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:35.133981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:35.133981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.133981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:35.133981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:35.133981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:35.133981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.134660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:35.134660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:35.134660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:35.134660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:35.134660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:35.134660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:35.134660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:35.134660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:35.134660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:35.134660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:35.134660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:35.134660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:35.134660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:35.135310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.135310 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:35.135632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.135632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:35.135632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:35.135632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:35.135632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:35.135632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:35.135632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.135632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:35.135632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:35.135632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.135632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:35.135632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:35.135632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.135632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:35.135632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:35.135632 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:35.136470 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:35.137445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:35.137445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.137445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:35.137445 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:35.137445 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:35.137445 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:35.137445 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:58:35.137954 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:35.138287 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.139120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:35.139120 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:35.139120 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:35.139120 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:35.139120 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:35.139120 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:35.139120 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.139120 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:35.140067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.140067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:35.140067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:35.140067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:35.140067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.140067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:35.140067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:35.140067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:35.140067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.140067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:35.140067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:35.140067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:35.140067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:35.140067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:35.140067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:35.140628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:35.140628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:35.140628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:35.140628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:35.140628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:35.140628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:35.140628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:35.140628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.140628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:35.140928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.140928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:35.140928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:35.140928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:35.140928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.140928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:35.140928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:35.140928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:58:35.140928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:35.140928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:35.140928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.140928 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:35.141336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:35.141336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:35.141336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.141336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:35.141336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:35.141336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:35.141336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:35.141336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:35.141336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:35.141336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:35.141336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:35.141336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:35.141336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:35.141336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:35.141751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:35.141751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:35.141751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.141751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:35.141872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.141872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:35.141872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:35.141872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:35.141872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:35.141872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:35.141872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.141872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:35.141872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:35.141872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.141872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:35.141872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:35.141872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.141872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:35.141872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:35.141872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:35.142335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:35.142884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:35.142884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:35.142884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:35.142884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:35.142884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:35.142884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.142884 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:35.143236 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:35.143552 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:35.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:35.143780 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:35.144145 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:35.144379 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.144978 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:35.144978 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:35.144978 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:35.144978 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:35.144978 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:35.144978 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:35.144978 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.144978 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:35.145752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.145752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:35.145752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:35.145752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:35.145752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.145752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:35.145752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:35.145752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:35.145752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.145752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:35.145752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:35.145752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:35.145752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:35.145752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:35.145752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:35.146198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:35.146198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:35.146198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:35.146198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:35.146198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:35.146198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:35.146198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:35.146198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.146198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:35.146614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.146614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:35.146614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:35.146614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:35.146614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.146614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:35.146614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:35.146614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:35.146614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:35.146614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.146614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:35.146980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:35.146980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:35.146980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.146980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:35.146980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:35.146980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:35.146980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:35.146980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:35.146980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:35.146980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:35.146980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:35.146980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:35.146980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:35.146980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:35.147435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:35.147435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:35.147435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.147435 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.147666 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:35.148215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:35.148873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:35.148873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:35.148873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.148873 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:35.149076 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:35.149401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:35.149525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:35.149675 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:35.150027 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:35.150342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:35.150609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.151343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:35.151343 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:35.151343 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:35.151343 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:35.151343 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:35.151343 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:35.151343 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.151343 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:35.152190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.152190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:35.152190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:35.152190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:35.152190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.152190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:35.152190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:35.152190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.152190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:35.152190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:35.152190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:35.152190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.152607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:35.152607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:35.152607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:35.152607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:35.152607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:35.152607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:35.152607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:35.152607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:35.152607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:35.152607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:35.152607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:35.152607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:35.152607 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:35.153108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.153108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:35.153179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.153179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:35.153179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:35.153179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:35.153179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:35.153179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:35.153179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.153179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:35.153179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:35.153179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.153179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:35.153179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:35.153179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.153179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:35.153179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:35.153179 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:35.153672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:35.154199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:35.154199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:35.154199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:39.897935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:39.899070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:39.899070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:39.900185 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:39.936170 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:39.936713 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:39.937828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:39.937828 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:39.937828 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:39.937828 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:39.937828 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:39.937828 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:39.937828 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:39.937828 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:39.938996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:39.938996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:39.938996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:39.938996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:39.938996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:39.938996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:39.938996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:39.938996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:39.938996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:39.938996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:39.938996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:39.938996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:39.939661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:39.939661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:39.939661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:39.939661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:39.939661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:39.939661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:39.939661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:39.939661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:39.939661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:39.939661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:39.939661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:39.939661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:39.939661 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:39.940182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:39.940182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:39.941474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:39.941474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:39.941474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:39.941474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:39.941474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:39.941474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:39.941474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:39.941474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:39.941474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:39.941474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:39.941474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:39.941474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:39.941474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:39.941474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:39.941474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:39.941474 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:39.942156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:39.942961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:39.942961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:39.942961 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:40.129104 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:40.129877 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:40.130049 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:40.131195 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:40.131473 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:40.133324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.133324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:40.133324 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:40.133324 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:40.133324 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:40.133324 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:40.133324 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:40.133324 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.133324 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:40.133923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.133923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:40.133923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:40.133923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:40.133923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.133923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:40.133923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:40.133923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.133923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:40.133923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:40.133923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:40.133923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.134725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:40.134725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:40.134725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:40.134725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:40.134725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:40.134725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:40.134725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:40.134725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:40.134725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:40.134725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:40.134725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:40.134725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:40.134725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:40.135303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.135303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:40.135303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.135303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:40.135303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:40.135303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:40.135303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:40.135303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:40.135303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.135303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:40.135303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:40.135303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.135303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:40.135303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:40.135303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:40.135995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:40.139115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:40.139115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:40.139115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:40.139115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:40.139115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.139115 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:40.139115 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:40.139115 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:40.139115 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:40.139115 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:58:40.140260 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:40.140260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.140260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:40.140260 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:40.140260 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:40.140260 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:40.140260 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:40.140260 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:40.140260 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.140260 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:40.140260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.140260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:40.140260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:40.140260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:40.141846 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:40.143282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.143282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:40.143282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.143282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:40.143282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:40.143282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:40.143282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.143282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:40.143282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:40.143282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:58:40.143282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:40.143282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:40.143915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.143915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:40.143915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:40.143915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:40.143915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.143915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:40.143915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:40.143915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:40.143915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:40.143915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:40.143915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:40.143915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:40.143915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:40.143915 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:40.144349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:40.144349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:40.144349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:40.144349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:40.144349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.144349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:40.144349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.144349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:40.144349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:40.144349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:40.144349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:40.144349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:40.144349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.144349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.144629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:40.144971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:40.144971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:40.144971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:40.144971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:40.144971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:40.144971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:40.144971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:40.144971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:40.144971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:40.144971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:40.144971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:40.144971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:40.144971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.144971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:40.144971 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:40.145254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:40.145254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:40.145254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:40.145254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:40.145254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.145254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:40.145254 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:40.145254 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:40.145254 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:40.147046 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:40.147046 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:40.147046 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.147046 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:40.147046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.147046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:40.147046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:40.147046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:40.147046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.147046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:40.147046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:40.147046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:40.147046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.147046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:40.147046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:40.147046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:40.147391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:40.147391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:40.147391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:40.147391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:40.147391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:40.147391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:40.147391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:40.147391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:40.147391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:40.147391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:40.147391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.147391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:40.147391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.147391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:40.147678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:40.147678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:40.147678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.147678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:40.147678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:40.147678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:40.147678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:40.147678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.147678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:40.147678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:40.147678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:40.147678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.147678 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:40.147974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:40.147974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:40.147974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:40.147974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:40.147974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:40.147974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:40.147974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:40.147974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:40.147974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:40.147974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:40.147974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:40.147974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:40.147974 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:40.148235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:40.148591 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:40.148947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:40.148947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:40.148947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:40.148947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.148947 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:40.149605 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:40.149816 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:40.149938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:40.150075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:40.150583 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:40.150941 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:40.151173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.151932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:40.151932 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:40.151932 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:40.151932 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:40.151932 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:40.151932 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:40.151932 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.151932 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:40.152790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.152790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:40.152790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:40.152790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:40.152790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.152790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:40.152790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:40.152790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.152790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:40.152790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:40.152790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:40.152790 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.153167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:40.153167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:40.153167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:40.153167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:40.153167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:40.153167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:40.153167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:40.153167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:40.153167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:40.153167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:40.153167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:40.153167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:40.153167 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:40.153523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.153523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:40.153985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.153985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:40.153985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:40.153985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:40.153985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:40.153985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:40.153985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.153985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:40.153985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:40.153985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.153985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:40.153985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:40.153985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.153985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:40.153985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:40.153985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:40.154422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:40.154911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:40.154911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:40.154911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:44.898698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:44.899411 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:44.899799 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:44.901056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:44.934248 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:44.934540 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:44.935351 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:44.935351 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:44.935351 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:44.935351 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:44.935351 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:44.935351 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:44.935351 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:44.935351 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:44.936215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:44.936215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:44.936215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:44.936215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:44.936215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:44.936215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:44.936215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:44.936215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:44.936215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:44.936215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:44.936215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:44.936215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:44.936831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:44.936831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:44.936831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:44.936831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:44.936831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:44.936831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:44.936831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:44.936831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:44.936831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:44.936831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:44.936831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:44.936831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:44.936831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:44.937403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:44.937403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:44.937403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:44.937403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:44.937403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:44.937403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:44.937403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:44.937403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:44.937403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:44.937403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:44.937403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:44.937403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:44.937403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:44.937403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:44.937403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:44.938081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:44.938981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:44.938981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:44.938981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:44.938981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:44.938981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:44.938981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:45.130058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:45.130850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:45.131106 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:45.132252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:45.132408 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:45.132671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.133695 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:45.133695 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:45.133695 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:45.133695 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:45.133695 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:45.133695 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:45.133695 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.133695 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:45.135511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.135511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:45.135511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:45.135511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:45.135511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.135511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:45.135511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:45.135511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.135511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:45.135511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:45.135511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:45.135511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.136008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:45.136008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:45.136008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:45.136008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:45.136008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:45.136008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:45.136008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:45.136008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:45.136008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:45.136008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:45.136008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:45.136008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:45.136008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:45.136410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.136410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:45.136410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.136410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:45.136410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:45.136410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:45.136410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:45.136410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:45.136410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.136410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:45.136410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:45.136410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.136410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:45.136410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:45.136410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:45.136879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:45.137511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:45.137511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:45.137511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:45.137511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:45.137511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.137511 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:45.137926 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:45.138202 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:45.138311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:45.138456 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:58:45.138858 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:45.139137 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.139749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:45.139749 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:45.139749 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:45.139749 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:45.139749 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:45.139749 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:45.139749 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.139749 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:45.140514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.140514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:45.140514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:45.140514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:45.140514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.140514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:45.140514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:45.140514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:45.140514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.140514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:45.140514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:45.140514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:45.140514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:45.140514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:45.140514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:45.140977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:45.140977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:45.140977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:45.140977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:45.140977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:45.140977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:45.140977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:45.140977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.140977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:45.141811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.141811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:45.141811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:45.141811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:45.141811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.141811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:45.141811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:45.141811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:58:45.141811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:45.141811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:45.141811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.141811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:45.142225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:45.142225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:45.142225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.142225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:45.142225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:45.142225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:45.142225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:45.142225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:45.142225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:45.142225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:45.142225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:45.142225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:45.142225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:45.142225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:45.142660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:45.142660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:45.142660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.142660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:45.142969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.142969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:45.142969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:45.142969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:45.142969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:45.142969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:45.142969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.142969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:45.142969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:45.142969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.142969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:45.142969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:45.142969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.142969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:45.142969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:45.142969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:45.143417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:45.143889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:45.143889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:45.143889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:45.143889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:45.143889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:45.143889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.143889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:45.144193 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:45.144523 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:45.144630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:45.144756 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:45.145051 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:45.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.145824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:45.145824 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:45.145824 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:45.145824 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:45.145824 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:45.145824 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:45.145824 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.145824 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:45.146850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.146850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:45.146850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:45.146850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:45.146850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.146850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:45.146850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:45.146850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:45.146850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.146850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:45.146850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:45.146850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:45.146850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:45.146850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:45.146850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:45.147409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:45.147409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:45.147409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:45.147409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:45.147409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:45.147409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:45.147409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:45.147409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.147409 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:45.148067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.148067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:45.148067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:45.148067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:45.148067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.148067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:45.148067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:45.148067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:45.148067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:45.148067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.148067 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:45.148416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:45.148416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:45.148416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.148416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:45.148416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:45.148416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:45.148416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:45.148416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:45.148416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:45.148416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:45.148416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:45.148416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:45.148416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:45.148416 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:45.148913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:45.148913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:45.148913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.148913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.149571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:45.150078 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:45.150740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:45.150740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:45.150740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.150740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:45.150740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:45.150740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:45.150740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:45.150740 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:45.151026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:45.151026 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:45.151108 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.151505 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:45.151505 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:45.151505 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:45.151505 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:45.151505 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:45.151505 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:45.151505 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.151505 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:45.152280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.152280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:45.152280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:45.152280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:45.152280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.152280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:45.152280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:45.152280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.152280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:45.152280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:45.152280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:45.152280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.152668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:45.152668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:45.152668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:45.152668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:45.152668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:45.152668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:45.152668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:45.152668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:45.152668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:45.152668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:45.152668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:45.152668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:45.152668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:45.153055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.153055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:45.153347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.153347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:45.153347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:45.153347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:45.153347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:45.153347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:45.153347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.153347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:45.153347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:45.153347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.153347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:45.153347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:45.153347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.153347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:45.153347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:45.153347 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:45.153787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:45.154339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:45.154339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:45.154339 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:49.899415 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:49.900205 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:49.900205 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:49.901426 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:49.938856 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:49.939417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:49.940046 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:49.940046 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:49.940046 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:49.940046 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:49.940046 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:49.940046 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:49.940046 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:49.940046 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:49.941117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:49.941117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:49.941117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:49.941117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:49.941117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:49.941117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:49.941117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:49.941117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:49.941117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:49.941117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:49.941117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:49.941117 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:49.942332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:49.942332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:49.942332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:49.942332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:49.942332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:49.942332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:49.942332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:49.942332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:49.942332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:49.942332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:49.942332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:49.942332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:49.942332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:49.943335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:49.943335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:49.943335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:49.943335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:49.943335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:49.943335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:49.943335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:49.943335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:49.943335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:49.943335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:49.943335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:49.943335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:49.943335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:49.943335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:49.943335 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:49.944219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:49.945210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:49.945210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:49.945210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:49.945210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:49.945210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:49.945210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:50.130746 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:50.131152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:50.131432 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:50.132635 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:50.132952 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:50.133188 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.134140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:50.134140 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:50.134140 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:50.134140 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:50.134140 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:50.134140 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:50.134140 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.134140 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:50.135672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.135672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:50.135672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:50.135672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:50.135672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.135672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:50.135672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:50.135672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.135672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:50.135672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:50.135672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:50.135672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.136322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:50.136322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:50.136322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:50.136322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:50.136322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:50.136322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:50.136322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:50.136322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:50.136322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:50.136322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:50.136322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:50.136322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:50.136322 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:50.136931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.136931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:50.137476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.137476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:50.137476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:50.137476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:50.137476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:50.137476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:50.137476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.137476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:50.137476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:50.137476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.137476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:50.137476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:50.137476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.137476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:50.137476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:50.137476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:50.138204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:50.139010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:50.139010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.139010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:50.139010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:50.139010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:50.139010 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:50.139533 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:58:50.139631 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:50.139881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.140559 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:50.140559 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:50.140559 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:50.140559 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:50.140559 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:50.140559 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:50.140559 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.140559 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:50.141280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.141280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:50.141280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:50.141280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:50.141280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.141280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:50.141280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:50.141280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:50.141280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.141280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:50.141280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:50.141280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:50.141280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:50.141280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:50.141280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:50.142890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:50.142890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:50.142890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:50.142890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:50.142890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:50.142890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:50.142890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:50.142890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.142890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:50.142890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.142890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:50.142890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:50.142890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:50.142890 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.144139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:50.144139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:50.144139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:58:50.144139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:50.144139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:50.144139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.144139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:50.144139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:50.144139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:50.144139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.144139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:50.144139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:50.144139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:50.144538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:50.144538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:50.144538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:50.144538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:50.144538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:50.144538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:50.144538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:50.144538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:50.144538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:50.144538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:50.144538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.144538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:50.144829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.144829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:50.144829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:50.144829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:50.144829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:50.144829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:50.144829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.144829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:50.144829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:50.144829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.144829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:50.144829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:50.144829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.144829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:50.144829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:50.144829 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:50.145214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:50.145711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:50.145711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:50.145711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:50.145711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:50.145711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:50.145711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.145711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:50.145711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:50.145711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:50.145711 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:50.145992 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:50.145992 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:50.145992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.146093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:50.146093 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:50.146093 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:50.146093 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:50.146093 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:50.146093 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:50.146093 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.146093 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:50.146880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.146880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:50.146880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:50.146880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:50.146880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.146880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:50.146880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:50.146880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:50.146880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.146880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:50.146880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:50.146880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:50.146880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:50.146880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:50.146880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:50.147264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:50.147264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:50.147264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:50.147264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:50.147264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:50.147264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:50.147264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:50.147264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.147264 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:50.147820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.147820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:50.147820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:50.147820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:50.147820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.147820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:50.147820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:50.147820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:50.147820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:50.147820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.147820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:50.148141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:50.148141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:50.148141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.148141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:50.148141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:50.148141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:50.148141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:50.148141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:50.148141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:50.148141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:50.148141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:50.148141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:50.148141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:50.148141 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:50.148514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:50.148514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:50.148514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.148514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.148903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:50.149346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:50.149911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:50.149911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:50.149911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.149911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:50.150197 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:50.150384 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:50.150505 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:50.150656 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:50.151000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:50.151433 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:50.151676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.152432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:50.152432 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:50.152432 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:50.152432 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:50.152432 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:50.152432 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:50.152432 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.152432 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:50.153221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.153221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:50.153221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:50.153221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:50.153221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.153221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:50.153221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:50.153221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.153221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:50.153221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:50.153221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:50.153221 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.153722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:50.153722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:50.153722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:50.153722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:50.153722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:50.153722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:50.153722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:50.153722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:50.153722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:50.153722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:50.153722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:50.153722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:50.153722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:50.154190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.154190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:50.154190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.154190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:50.154190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:50.154190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:50.154190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:50.154190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:50.154190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.154190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:50.154190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:50.154190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.154190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:50.154190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:50.154190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:50.154753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:50.155483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:50.155483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:50.155483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:50.155483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:50.155483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:50.155483 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:54.900449 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:54.901351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:54.901351 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:54.904085 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:54.906428 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:58:54.940314 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:54.940796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:54.941562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:54.941562 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:54.941562 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:54.941562 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:54.941562 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:54.941562 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:54.941562 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:54.941562 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:54.942654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:54.942654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:54.942654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:54.942654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:54.942654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:54.942654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:54.942654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:54.942654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:54.942654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:54.942654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:54.942654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:54.942654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:54.946492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:54.946492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:54.946492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:54.946492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:54.946492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:54.946492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:54.946492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:54.946492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:54.946492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:54.946492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:54.946492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:54.946492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:54.946492 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:54.947410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:54.947410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:54.947410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:54.947410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:54.947410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:54.947410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:54.947410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:54.947410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:54.947410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:54.947410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:54.947410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:54.947410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:54.947410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:54.947410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:54.947410 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:54.947977 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:54.948763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:54.948763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:54.948763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:54.948763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:54.948763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:54.948763 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:55.131626 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:55.132585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:55.132793 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:55.133854 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:55.134176 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:55.134490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.135480 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:55.135480 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:55.135480 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:55.135480 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:55.135480 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:55.135480 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:55.135480 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.135480 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:55.136954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.136954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:55.136954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:55.136954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:55.136954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.136954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:55.136954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:55.136954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.136954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:55.136954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:55.136954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:55.136954 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.137910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:55.137910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:55.137910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:55.137910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:55.137910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:55.137910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:55.137910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:55.137910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:55.137910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:55.137910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:55.137910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:55.137910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:55.137910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:55.138805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.138805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:55.138805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.138805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:55.138805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:55.138805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:55.138805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:55.138805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:55.138805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.138805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:55.138805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:55.138805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.138805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:55.138805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:55.138805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:55.140239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:55.140939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:55.140939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:55.140939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:55.140939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:55.140939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.140939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:55.140939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:55.140939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:55.140939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:55.140939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:58:55.141293 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:55.141293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.141293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:55.141293 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:55.141293 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:55.141293 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:55.141293 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:55.141293 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:55.141293 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.141293 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:55.141620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.141620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:55.141620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:55.141620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:55.141620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.141620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:55.141620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:55.141620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:55.141620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.141620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:55.141620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:55.141620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:55.141620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:55.141620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:55.141620 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:55.142076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:55.142076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:55.142076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:55.142076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:55.142076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:55.142076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:55.142076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:55.142076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.142076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:55.142386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.142386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:55.142386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:55.142386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:55.142386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.142386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:55.142386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:55.142386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:58:55.142386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:55.142386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:55.142386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.142386 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:55.142786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:55.142786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:55.142786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.142786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:55.142786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:55.142786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:55.142786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:55.142786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:55.142786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:55.142786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:55.142786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:55.142786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:55.142786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:55.142786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:55.143209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:55.143209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:55.143209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.143209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:55.143209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.143209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:55.143209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:55.143209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:55.143209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:55.143209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:55.143209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.143209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:55.143209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:55.143209 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:55.143640 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:55.144186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:55.144186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:55.144186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:55.144186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:55.144186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:55.144186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:55.144186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:55.144186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:55.144186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:55.144186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:55.144186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.144186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:55.144895 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:55.145227 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:55.145336 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:55.145485 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:55.145849 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:55.146149 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.146642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:55.146642 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:55.146642 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:55.146642 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:55.146642 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:55.146642 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:55.146642 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.146642 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:55.147352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.147352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:58:55.147352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:55.147352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:55.147352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.147352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:55.147352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:55.147352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:55.147352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.147352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:58:55.147352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:55.147352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:58:55.147352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:55.147352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:58:55.147352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:58:55.147849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:55.147849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:58:55.147849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:55.147849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:58:55.147849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:58:55.147849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:55.147849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:58:55.147849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.147849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:58:55.148201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.148201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:55.148201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:55.148201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:55.148201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.148201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:55.148201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:55.148201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:55.148201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:55.148201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.148201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:55.148603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:55.148603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:55.148603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.148603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:55.148603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:55.148603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:55.148603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:55.148603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:55.148603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:55.148603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:55.148603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:55.148603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:55.148603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:55.148603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:55.149054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:55.149054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:55.149054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.149054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.149274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:55.149930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:55.150596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:55.150596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:55.150596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.150596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:55.150596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:55.150891 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:55.150992 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:55.151155 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:55.151453 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:55.151631 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:55.151743 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.152210 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:55.152210 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:55.152210 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:55.152210 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:55.152210 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:55.152210 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:55.152210 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.152210 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:55.153086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.153086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:55.153086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:55.153086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:55.153086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.153086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:55.153086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:55.153086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.153086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:55.153086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:55.153086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:55.153086 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.153525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:55.153525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:55.153525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:55.153525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:55.153525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:55.153525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:55.153525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:55.153525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:55.153525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:55.153525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:55.153525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:55.153525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:55.153525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:55.153941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.153941 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:55.154014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.154014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:55.154014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:55.154014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:55.154014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:55.154014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:55.154014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.154014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:55.154014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:55.154014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.154014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:55.154014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:55.154014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.154014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:55.154014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:55.154014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:55.154513 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:55.155065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:55.155065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:55.155065 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:58:59.901041 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:58:59.901995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:58:59.901995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:58:59.902641 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:58:59.939951 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:58:59.940453 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:59.941753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:58:59.941753 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:59.941753 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:58:59.941753 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:58:59.941753 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:59.941753 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:58:59.941753 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:59.941753 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:58:59.942609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:59.942609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:58:59.942609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:59.942609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:58:59.942609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:59.942609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:59.942609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:59.942609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:59.942609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:59.942609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:59.942609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:59.942609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:59.943466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:58:59.943466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:59.943466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:58:59.943466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:59.943466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:58:59.943466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:58:59.943466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:59.943466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:58:59.943466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:59.943466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:58:59.943466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:58:59.943466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:59.943466 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:58:59.944182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:59.944182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:58:59.944182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:59.944182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:58:59.944182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:58:59.944182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:58:59.944182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:58:59.944182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:58:59.944182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:59.944182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:58:59.944182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:58:59.944182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:59.944182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:58:59.944182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:58:59.944182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:58:59.945093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:58:59.946235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:58:59.946235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:58:59.946235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:58:59.946235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:58:59.946235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:58:59.946235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:00.132557 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:00.133398 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:00.133495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:00.134720 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:00.135139 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:00.135448 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.136496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:00.136496 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:00.136496 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:00.136496 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:00.136496 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:00.136496 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:00.136496 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.136496 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:00.137610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.137610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:00.137610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:00.137610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:00.137610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.137610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:00.137610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:00.137610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.137610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:00.137610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:00.137610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:00.137610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.138281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:00.138281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:00.138281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:00.138281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:00.138281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:00.138281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:00.138281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:00.138281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:00.138281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:00.138281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:00.138281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:00.138281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:00.138281 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:00.138913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.138913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:00.138913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.138913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:00.138913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:00.138913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:00.138913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:00.138913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:00.138913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.138913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:00.138913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:00.138913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.138913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:00.138913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:00.138913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:00.139696 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:00.140601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:00.140601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:00.140601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:00.140601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:00.140601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.140601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:00.140601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:00.140601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:00.140601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:00.140601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:59:00.141131 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:00.141131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.142035 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:00.142035 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:00.142035 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:00.142035 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:00.142035 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:00.142035 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:00.142035 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.142035 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:00.142801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.142801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:00.142801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:00.142801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:00.142801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.142801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:00.142801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:00.142801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:00.142801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.142801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:00.142801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:00.142801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:00.142801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:00.142801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:00.142801 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:00.143651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:00.143651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:00.143651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:00.143651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:00.143651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:00.143651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:00.143651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:00.143651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.143651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:00.143651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.143651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:00.143651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:00.143651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:00.143651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.144397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:00.144397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:00.144397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:59:00.144397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:00.144397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:00.144397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.144397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:00.144397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:00.144397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:00.144397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.144397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:00.144397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:00.144397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:00.145044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:00.145044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:00.145044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:00.145044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:00.145044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:00.145044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:00.145044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:00.145044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:00.145044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:00.145044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:00.145044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.145044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:00.145719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.145719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:00.145719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:00.145719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:00.145719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:00.145719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:00.145719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.145719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:00.145719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:00.145719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.145719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:00.145719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:00.145719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.145719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:00.145719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:00.145719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:00.146391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:00.146809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:00.146809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:00.146809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:00.146809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:00.146809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:00.146809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.146809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:00.146809 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:00.146809 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:00.146809 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:00.147048 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:00.147254 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:00.147598 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.148258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:00.148258 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:00.148258 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:00.148258 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:00.148258 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:00.148258 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:00.148258 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.148258 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:00.149705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.149705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:00.149705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:00.149705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:00.149705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.149705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:00.149705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:00.149705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:00.149705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.149705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:00.149705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:00.149705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:00.149705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:00.149705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:00.149705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:00.150018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:00.150018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:00.150018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:00.150018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:00.150018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:00.150018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:00.150018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:00.150018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.150018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:00.151246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.151246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:00.151246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:00.151246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:00.151246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.151246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:00.151246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:00.151246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:00.151246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:00.151246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.151246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:00.151549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:00.151549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:00.151549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.151549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:00.151549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:00.151549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:00.151549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:00.151549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:00.151549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:00.151549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:00.151549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:00.151549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:00.151549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:00.151549 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:00.151822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:00.151822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:00.151822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.151822 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:00.151822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.153752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:00.154164 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:00.154556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:00.154556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:00.154556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.154556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:00.154556 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:00.154556 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:00.154695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:00.155000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:00.155222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:00.155378 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.155956 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:00.155956 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:00.155956 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:00.155956 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:00.155956 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:00.155956 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:00.155956 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.155956 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:00.157213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.157213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:00.157213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:00.157213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:00.157213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.157213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:00.157213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:00.157213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.157213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:00.157213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:00.157213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:00.157213 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.157651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:00.157651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:00.157651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:00.157651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:00.157651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:00.157651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:00.157651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:00.157651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:00.157651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:00.157651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:00.157651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:00.157651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:00.157651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:00.158026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.158026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:00.158026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.158026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:00.158026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:00.158026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:00.158026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:00.158026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:00.158026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.158026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:00.158026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:00.158026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.158026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:00.158026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:00.158026 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:00.158506 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:00.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:00.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:00.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:00.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:00.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:00.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:04.902020 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:04.903124 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:04.903440 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:04.904948 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:04.945593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:04.946023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:04.946893 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:04.946893 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:04.946893 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:04.946893 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:04.946893 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:04.946893 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:04.946893 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:04.946893 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:04.947820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:04.947820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:04.947820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:04.947820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:04.947820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:04.947820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:04.947820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:04.947820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:04.947820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:04.947820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:04.947820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:04.947820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:04.948458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:04.948458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:04.948458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:04.948458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:04.948458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:04.948458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:04.948458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:04.948458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:04.948458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:04.948458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:04.948458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:04.948458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:04.948458 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:04.949045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:04.949045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:04.949045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:04.949045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:04.949045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:04.949045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:04.949045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:04.949045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:04.949045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:04.949045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:04.949045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:04.949045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:04.949045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:04.949045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:04.949045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:04.949704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:04.950581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:04.950581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:04.950581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:04.950581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:04.950581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:04.950581 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:05.133670 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:05.134655 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:05.134862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:05.136396 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:05.136855 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:05.137126 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.138392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:05.138392 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:05.138392 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:05.138392 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:05.138392 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:05.138392 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:05.138392 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.138392 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:05.140098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.140098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:05.140098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:05.140098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:05.140098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.140098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:05.140098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:05.140098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.140098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:05.140098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:05.140098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:05.140098 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.140691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:05.140691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:05.140691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:05.140691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:05.140691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:05.140691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:05.140691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:05.140691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:05.140691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:05.140691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:05.140691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:05.140691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:05.140691 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:05.141232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.141232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:05.141232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:05.142766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.142766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:05.142766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:05.142766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:05.142766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:05.142766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:05.142766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.142766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:05.142766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:05.142766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.142766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:05.142766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:05.142766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.142766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:05.142766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:05.142766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:05.143485 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:05.144288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:05.144288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.144288 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:05.144288 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:05.144288 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:05.144288 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:59:05.144288 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:05.144646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.145274 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:05.145274 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:05.145274 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:05.145274 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:05.145274 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:05.145274 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:05.145274 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.145274 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:05.146063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.146063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:05.146063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:05.146063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:05.146063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.146063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:05.146063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:05.146063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:05.146063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.146063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:05.146063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:05.146063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:05.146063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:05.146063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:05.146063 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:05.146735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:05.146735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:05.146735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:05.146735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:05.146735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:05.146735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:05.146735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:05.146735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.146735 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:05.146735 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:05.147778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.147778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:05.147778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:05.147778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:05.147778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.147778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:05.147778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:05.147778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:59:05.147778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:05.147778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:05.147778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.147778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:05.148509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:05.148509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:05.148509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.148509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:05.148509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:05.148509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:05.148509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:05.148509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:05.148509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:05.148509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:05.148509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:05.148509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:05.148509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:05.148509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:05.149091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:05.149091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:05.149091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.149091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:05.149271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.149271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:05.149271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:05.149271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:05.149271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:05.149271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:05.149271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.149271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:05.149271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:05.149271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.149271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:05.149271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:05.149271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.149271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:05.149271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:05.149271 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:05.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:05.150888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:05.150888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:05.150888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:05.150888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:05.150888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:05.150888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.150888 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:05.150888 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:05.150888 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:05.150888 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:05.151429 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:05.151429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.151429 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:05.151429 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:05.151429 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:05.151429 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:05.151429 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:05.151429 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:05.151429 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.151429 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:05.152203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.152203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:05.152203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:05.152203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:05.152203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.152203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:05.152203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:05.152203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:05.152203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.152203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:05.152203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:05.152203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:05.152203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:05.152203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:05.152203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:05.152500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:05.152500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:05.152500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:05.152500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:05.152500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:05.152500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:05.152500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:05.152500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.152500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:05.153220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.153220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:05.153220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:05.153220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:05.153220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.153220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:05.153220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:05.153220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:05.153220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:05.153220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.153220 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:05.153454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:05.153454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:05.153454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.153454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:05.153454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:05.153454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:05.153454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:05.153454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:05.153454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:05.153454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:05.153454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:05.153454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:05.153454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:05.153454 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:05.153698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:05.153698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:05.153698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.153698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.154545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:05.154872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:05.155235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:05.155235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:05.155235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.155235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:05.155235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:05.155235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:05.155362 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:05.155503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:05.155967 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:05.156313 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:05.156577 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.157297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:05.157297 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:05.157297 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:05.157297 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:05.157297 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:05.157297 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:05.157297 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.157297 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:05.158147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.158147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:05.158147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:05.158147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:05.158147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.158147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:05.158147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:05.158147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.158147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:05.158147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:05.158147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:05.158147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.158400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:05.158400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:05.158400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:05.158400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:05.158400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:05.158400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:05.158400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:05.158400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:05.158400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:05.158400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:05.158400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:05.158400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:05.158400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:05.158634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.158634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:05.159130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.159130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:05.159130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:05.159130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:05.159130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:05.159130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:05.159130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.159130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:05.159130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:05.159130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.159130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:05.159130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:05.159130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.159130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:05.159130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:05.159130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:05.159442 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:05.159864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:05.159864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:05.159864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:09.902877 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:09.904630 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:09.904882 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:09.906494 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:09.952139 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:09.952740 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:09.953826 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:09.953826 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:09.953826 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:09.953826 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:09.953826 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:09.953826 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:09.953826 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:09.953826 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:09.954766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.049 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:09.954766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:09.954766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:09.954766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:09.954766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:09.954766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:09.954766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:09.954766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:09.954766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:09.954766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:09.954766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:09.954766 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:09.955519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:09.955519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:09.955519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:09.955519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:09.955519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:09.955519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:09.955519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:09.955519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:09.955519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:09.955519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:09.955519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:09.955519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:09.955519 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:09.956214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:09.956214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:09.956214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:09.956214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:09.956214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:09.956214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:09.956214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:09.956214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:09.956214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:09.956214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:09.956214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:09.956214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:09.956214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:09.956214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:09.956214 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:09.957069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:09.958143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:09.958143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:09.958143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:09.958143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:09.958143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:09.958143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:10.134668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:10.135497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:10.135698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:10.137238 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:10.137692 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:10.137944 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.139011 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:10.139011 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:10.139011 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:10.139011 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:10.139011 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:10.139011 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:10.139011 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.139011 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:10.140669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.140669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:10.140669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:10.140669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:10.140669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.140669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:10.140669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:10.140669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.140669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:10.140669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:10.140669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:10.140669 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.141235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:10.141235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:10.141235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:10.141235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:10.141235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:10.141235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:10.141235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:10.141235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:10.141235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:10.141235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:10.141235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:10.141235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:10.141235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:10.141809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.141809 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:10.142336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.142336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:10.142336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:10.142336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:10.142336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:10.142336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:10.142336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.142336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:10.142336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:10.142336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.142336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:10.142336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:10.142336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.142336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:10.142336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:10.142336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:10.143023 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:10.143797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:10.143797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.143797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:10.143797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:10.143797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:10.143797 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:10.144089 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:59:10.144515 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:10.144863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.145819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:10.145819 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:10.145819 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:10.145819 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:10.145819 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:10.145819 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:10.145819 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.145819 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:10.146447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.146447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:10.146447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:10.146447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:10.146447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.146447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:10.146447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:10.146447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:10.146447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.146447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:10.146447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:10.146447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:10.146447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:10.146447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:10.146447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:10.147219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:10.147219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:10.147219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:10.147219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:10.147219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:10.147219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:10.147219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:10.147219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.147219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:10.147219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.147219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:10.147219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:10.147219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:10.147219 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.147996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:10.147996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:10.147996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:59:10.147996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:10.147996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:10.147996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.147996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:10.147996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:10.147996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:10.147996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.147996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:10.147996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:10.147996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:10.149216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:10.149216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:10.149216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:10.149216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:10.149216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:10.149216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:10.149216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:10.149216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:10.149216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:10.149216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:10.149216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.149216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:10.149687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.149687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:10.149687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:10.149687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:10.149687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:10.149687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:10.149687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.149687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:10.149687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:10.149687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.149687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:10.149687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:10.149687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.149687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:10.149687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:10.149687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:10.150127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:10.150939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:10.150939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:10.150939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:10.150939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:10.150939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:10.150939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.150939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:10.150939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:10.150939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:10.150939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:10.151284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:10.151284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:10.151284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.151725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:10.151725 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:10.151725 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:10.151725 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:10.151725 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:10.151725 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:10.151725 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.151725 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:10.152517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.152517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:10.152517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:10.152517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:10.152517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.152517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:10.152517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:10.152517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:10.152517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.152517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:10.152517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:10.152517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:10.152517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:10.152517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:10.152517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:10.152987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:10.152987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:10.152987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:10.152987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:10.152987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:10.152987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:10.152987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:10.152987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.152987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:10.153356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.153356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:10.153356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:10.153356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:10.153356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.153356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:10.153356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:10.153356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:10.153356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:10.153356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.153356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:10.153728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:10.153728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:10.153728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.153728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:10.153728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:10.153728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:10.153728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:10.153728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:10.153728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:10.153728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:10.153728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:10.153728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:10.153728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:10.153728 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:10.154185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:10.154185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:10.154185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.154185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.154440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:10.154952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:10.155532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:10.155532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:10.155532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.155532 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:10.155532 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:10.155697 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:10.155697 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:10.155830 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:10.156311 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:10.156763 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:10.156981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.157811 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:10.157811 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:10.157811 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:10.157811 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:10.157811 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:10.157811 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:10.157811 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.157811 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:10.158683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.158683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:10.158683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:10.158683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:10.158683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.158683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:10.158683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:10.158683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.158683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:10.158683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:10.158683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:10.158683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.159073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:10.159073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:10.159073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:10.159073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:10.159073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:10.159073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:10.159073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:10.159073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:10.159073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:10.159073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:10.159073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:10.159073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:10.159073 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:10.159482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.159482 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:10.159718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.159718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:10.159718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:10.159718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:10.159718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:10.159718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:10.159718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.159718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:10.159718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:10.159718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.159718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:10.159718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:10.159718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.159718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:10.159718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:10.159718 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:10.160196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:10.160880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:10.160880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:10.160880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:14.904540 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:14.905307 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:14.905307 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:14.906775 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:14.949790 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:14.950313 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:14.951296 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:14.951296 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:14.951296 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:14.951296 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:14.951296 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:14.951296 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:14.951296 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:14.951296 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:14.952531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.046 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:14.952531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:14.952531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:14.952531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:14.952531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:14.952531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:14.952531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:14.952531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:14.952531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:14.952531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:14.952531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:14.952531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:14.953936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:14.953936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:14.953936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:14.953936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:14.953936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:14.953936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:14.953936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:14.953936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:14.953936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:14.953936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:14.953936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:14.953936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:14.953936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:14.955403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:14.955403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:14.955403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:14.955403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:14.955403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:14.955403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:14.955403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:14.955403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:14.955403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:14.955403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:14.955403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:14.955403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:14.955403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:14.955403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:14.955403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:14.956242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:14.957132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:14.957132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:14.957132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:14.957132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:14.957132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:14.957132 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:15.135583 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:15.136698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:15.136873 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:15.137966 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:15.138359 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:15.138688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.140535 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:15.140535 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:15.140535 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:15.140535 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:15.140535 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:15.140535 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:15.140535 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.140535 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:15.142018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.142018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:15.142018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:15.142018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:15.142018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.142018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:15.142018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:15.142018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.142018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:15.142018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:15.142018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:15.142018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.143187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:15.143187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:15.143187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:15.143187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:15.143187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:15.143187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:15.143187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:15.143187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:15.143187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:15.143187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:15.143187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:15.143187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:15.143187 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:15.144055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.144055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:15.144055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.144055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:15.144055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:15.144055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:15.144055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:15.144055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:15.144055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.144055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:15.144055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:15.144055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.144055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:15.144055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:15.144055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:15.144717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:15.145491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:15.145491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:15.145491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:15.145491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:15.145491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.145491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:15.145491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:15.145491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:15.145491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:15.145491 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:59:15.145987 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:15.145987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.146871 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:15.148782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:15.148782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:15.148782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:15.148782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:15.148782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:15.148782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:15.148782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:15.148782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:15.148782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:15.148782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:15.148782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:15.148782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:15.148782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.148782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:15.148782 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.150477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:15.150477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:15.150477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:15.150477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.150477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:15.150477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:15.150477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:59:15.150477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:15.150477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:15.150477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.150477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:15.150477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:15.150477 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:15.151562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.151562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:15.151562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:15.151562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:15.151562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:15.151562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:15.151562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:15.151562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:15.151562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:15.151562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:15.151562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:15.151562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:15.151562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:15.151562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:15.152808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.152808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:15.152808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.152808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:15.152808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:15.152808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:15.152808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:15.152808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:15.152808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.152808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:15.152808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:15.152808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.152808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:15.152808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:15.152808 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:15.153499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:15.154392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:15.154392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:15.154392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:15.154392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:15.154392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:15.154392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:15.154392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:15.154392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.154392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:15.154392 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:15.154392 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:15.154392 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:15.154796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:15.154796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:15.154796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.154796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:15.154796 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:15.154796 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:15.154796 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:15.154796 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:15.154796 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:15.154796 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.154796 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:15.154796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:15.155024 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:15.155344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:15.155344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:15.155344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:15.155344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:15.155344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.155344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:15.155344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.155344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:15.155344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:15.155344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:15.155344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.155344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:15.155344 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:15.155622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:15.155622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:15.155622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.155622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:15.155622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:15.155622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:15.155622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.155622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:15.155622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:15.155622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:15.155622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:15.155622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:15.155622 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:15.155859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:15.155859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:15.155859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:15.155859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:15.155859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:15.155859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:15.155859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:15.155859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.155859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:15.155859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.155859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:15.155859 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:15.156792 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:15.156792 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:15.156792 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:15.156792 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:15.167985 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:15.168500 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:15.168672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.169710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:15.169710 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:15.169710 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:15.169710 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:15.169710 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:15.169710 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:15.169710 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.169710 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:15.170404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.013 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.170404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:15.170404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:15.170404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:15.170404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.170404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:15.170404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:15.170404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.170404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:15.170404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:15.170404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:15.170404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.171343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:15.171343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:15.171343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:15.171343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:15.171343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:15.171343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:15.171343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:15.171343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:15.171343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:15.171343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:15.171343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:15.171343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:15.171343 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:15.172668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.172668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:15.172668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.172668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:15.172668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:15.172668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:15.172668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:15.172668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:15.172668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.172668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:15.172668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:15.172668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.172668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:15.172668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:15.172668 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:15.173750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:15.174828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:15.174828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:15.174828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:15.174828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:15.174828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:15.174828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:19.905256 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:19.906489 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:19.906489 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:19.907981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:19.950864 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:19.951384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:19.952497 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:19.952497 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:19.952497 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:19.952497 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:19.952497 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:19.952497 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:19.952497 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:19.952497 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:19.953686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.046 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:19.953686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:19.953686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:19.953686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:19.953686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:19.953686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:19.953686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:19.953686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:19.953686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:19.953686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:19.953686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:19.953686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:19.954447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:19.954447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:19.954447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:19.954447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:19.954447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:19.954447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:19.954447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:19.954447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:19.954447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:19.954447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:19.954447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:19.954447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:19.954447 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:19.955143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:19.955143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:19.955143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:19.955143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:19.955143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:19.955143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:19.955143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:19.955143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:19.955143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:19.955143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:19.955143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:19.955143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:19.955143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:19.955143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:19.955143 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:19.955958 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:19.956996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:19.956996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:19.956996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:19.956996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:19.956996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:19.956996 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:20.136661 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:20.137252 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:20.137525 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:20.138987 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:20.139918 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:20.139918 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.140883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:20.140883 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:20.140883 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:20.140883 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:20.140883 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:20.140883 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:20.140883 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.140883 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:20.143138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.143138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:20.143138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:20.143138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:20.143138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.143138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:20.143138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:20.143138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.143138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:20.143138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:20.143138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:20.143138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.143904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:20.143904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:20.143904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:20.143904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:20.143904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:20.143904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:20.143904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:20.143904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:20.143904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:20.143904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:20.143904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:20.143904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:20.143904 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:20.144544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.144544 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:20.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:20.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:20.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:20.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:20.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:20.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:20.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:20.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:20.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:20.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:20.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:20.145337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:20.145903 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:20.146460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:20.146460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.146460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:20.146460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:20.146460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:20.146460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:20.146460 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:59:20.146852 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:20.147127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.147813 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:20.147813 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:20.147813 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:20.147813 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:20.147813 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:20.147813 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:20.147813 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.147813 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:20.148864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.148864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:20.148864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:20.148864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:20.148864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.148864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:20.148864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:20.148864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:20.148864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.148864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:20.148864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:20.148864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:20.148864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:20.148864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:20.148864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:20.149361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:20.149361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:20.149361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:20.149361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:20.149361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:20.149361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:20.149361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:20.149361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.149361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:20.149879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.149879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:20.149879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:20.149879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:20.149879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.149879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:20.149879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:20.149879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:59:20.149879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:20.149879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:20.149879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.149879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:20.150255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:20.150255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:20.150255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.150255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:20.150255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:20.150255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:20.150255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:20.150255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:20.150255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:20.150255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:20.150255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:20.150255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:20.150255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:20.150255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:20.150659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:20.150659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:20.150659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.150659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:20.150659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.150659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:20.150659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:20.150659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:20.150659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:20.150659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:20.150659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.150659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:20.150659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:20.150659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:20.151057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:20.151636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:20.151636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:20.151636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:20.151636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:20.151636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:20.151636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:20.151636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:20.151636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:20.151636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:20.151636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:20.151636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.151636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:20.151636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:20.151636 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:20.152054 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:20.152054 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:20.152054 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:20.152054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.152436 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:20.152436 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:20.152436 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:20.152436 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:20.152436 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:20.152436 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:20.152436 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.152436 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:20.153010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.153010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:20.153010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:20.153010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:20.153010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.153010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:20.153010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:20.153010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:20.153010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.153010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:20.153010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:20.153010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:20.153010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:20.153010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:20.153010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:20.153487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:20.153487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:20.153487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:20.153487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:20.153487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:20.153487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:20.153487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:20.153487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.153487 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:20.154501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.154501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:20.154501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:20.154501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:20.154501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.154501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:20.154501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:20.154501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:20.154501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:20.154501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.154501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:20.154923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:20.154923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:20.154923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.154923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:20.154923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:20.154923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:20.154923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:20.154923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:20.154923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:20.154923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:20.154923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:20.154923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:20.154923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:20.154923 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:20.155495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:20.155495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:20.155495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.155495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:20.155495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.155495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:20.155495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:20.155495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:20.155495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:20.155495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:20.155495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.155495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:20.155495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:20.155495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:20.155971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:20.157883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:20.157883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:20.157883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:20.157883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:20.157883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:20.157883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:20.157883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:20.157883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:20.157883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:20.157883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.157883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:20.157883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:20.157883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:20.158503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:20.158503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:20.158503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:20.158503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:20.158503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.158503 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:20.158503 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:20.158503 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:20.158503 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:20.158902 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:20.158902 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:20.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:20.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:20.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:20.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:20.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:20.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:20.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:20.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:20.159413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:20.159413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.159413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:20.159413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:20.159413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:20.159413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:20.159413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:20.159413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:20.159413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:20.159413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:20.159413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:20.159413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:20.159413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:20.159413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:20.159926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:20.159926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.159926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:20.159926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.159926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:20.159926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:20.159926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:20.159926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:20.159926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:20.159926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.159926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:20.159926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:20.159926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.159926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:20.159926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:20.159926 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:20.160716 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:20.161500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:20.161500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:20.161500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:20.161500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:20.161500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:20.161500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:24.906113 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:24.906992 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:24.907118 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:24.908559 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:24.943056 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:24.946276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:24.946276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:24.946276 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:24.946276 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:24.946276 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:24.946276 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:24.946276 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:24.946276 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:24.946276 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:24.946276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:24.946276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:24.946276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:24.946276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:24.946276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:24.946276 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:24.946824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:24.946824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:24.946824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:24.946824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:24.946824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:24.946824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:24.946824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:24.946824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:24.946824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:24.946824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:24.946824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:24.946824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:24.946824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:24.946824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:24.947201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:24.947201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:24.947201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:24.947201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:24.947201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:24.947201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:24.947201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:24.947201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:24.947201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:24.947201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:24.947201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:24.947201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:24.947201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:24.947623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:24.948186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:24.948186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:24.948186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:24.948186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:24.948186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:24.948186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:24.948186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:24.948186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:24.948186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:24.948186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:24.948186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:24.948186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:25.137664 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:25.138464 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:25.138649 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:25.139822 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:25.140148 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:25.140390 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.141233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:25.141233 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:25.141233 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:25.141233 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:25.141233 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:25.141233 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:25.141233 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.141233 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:25.142931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.142931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:25.142931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:25.142931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:25.142931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.142931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:25.142931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:25.142931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.142931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:25.142931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:25.142931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:25.142931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.144121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:25.144121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:25.144121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:25.144121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:25.144121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:25.144121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:25.144121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:25.144121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:25.144121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:25.144121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:25.144121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:25.144121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:25.144121 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:25.145081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.145081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:25.145081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.145081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:25.145081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:25.145081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:25.145081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:25.145081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:25.145081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.145081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:25.145081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:25.145081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.145081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:25.145081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:25.145081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:25.146131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:25.149445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:25.149445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:25.149445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:25.149445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:25.149445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.149445 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:25.149445 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:25.149445 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:25.149445 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:25.149445 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:59:25.149810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:25.149810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:25.150019 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:25.150019 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:25.150019 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:25.150019 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:25.150019 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:25.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.150019 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:25.150806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.150806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:25.150806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:25.150806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:25.150806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.150806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:25.150806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:25.150806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:25.150806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.150806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:25.150806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:25.150806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:25.150806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:25.150806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:25.150806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:25.151349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:25.151349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:25.151349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:25.151349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:25.151349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:25.151349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:25.151349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:25.151349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.151349 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:25.151816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.151816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:25.151816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:25.151816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:25.151816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.151816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:25.151816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:25.151816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:59:25.151816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:25.151816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:25.151816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.151816 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:25.152431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:25.152431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:25.152431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.152431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:25.152431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:25.152431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:25.152431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:25.152431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:25.152431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:25.152431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:25.152431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:25.152431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:25.152431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:25.152431 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:25.153079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:25.153079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:25.153079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.153079 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:25.153079 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:25.153254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.153254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:25.153254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:25.153254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:25.153254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:25.153254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:25.153254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.153254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:25.153254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:25.153254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.153254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:25.153254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:25.153254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.153254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:25.153254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:25.153254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:25.153864 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:25.154437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:25.154437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:25.154437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:25.154437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:25.154437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:25.154437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.154437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:25.154437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:25.154437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:25.154437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:25.154787 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:25.154787 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.154987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:25.154987 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:25.154987 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:25.154987 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:25.154987 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:25.154987 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:25.154987 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.154987 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:25.155779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.155779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:25.155779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:25.155779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:25.155779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.155779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:25.155779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:25.155779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:25.155779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.155779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:25.155779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:25.155779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:25.155779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:25.155779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:25.155779 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:25.156473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:25.156473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:25.156473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:25.156473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:25.156473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:25.156473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:25.156473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:25.156473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.156473 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:25.156850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.156850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:25.156850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:25.156850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:25.156850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.156850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:25.156850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:25.156850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:25.156850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:25.156850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.156850 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:25.157140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:25.157140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:25.157140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.157140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:25.157140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:25.157140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:25.157140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:25.157140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:25.157140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:25.157140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:25.157140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:25.157140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:25.157140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:25.157140 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:25.158593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:25.158593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:25.158593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.158593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:25.158593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:25.158593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.158593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:25.158593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:25.158593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:25.158593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:25.158593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:25.158593 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.158902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:25.159279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:25.159279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:25.159279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:25.159279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:25.159279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:25.159279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:25.159279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:25.159279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:25.159279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:25.159279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:25.159279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:25.159279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:25.159279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.159279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:25.159279 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:25.160745 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:25.160745 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:25.160745 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:25.160745 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:25.160745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.160745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:25.160745 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:25.160745 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:25.160745 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:25.160944 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:25.160944 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:25.160944 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.160944 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:25.161028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.161028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:25.161028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:25.161028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:25.161028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.161028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:25.161028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:25.161028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.161028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:25.161028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:25.161028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:25.161028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.161289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:25.161289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:25.161289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:25.161289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:25.161289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:25.161289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:25.161289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:25.161289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:25.161289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:25.161289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:25.161289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:25.161289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:25.161289 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:25.161557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.161557 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:25.161943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.161943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:25.161943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:25.161943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:25.161943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:25.161943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:25.161943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.161943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:25.161943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:25.161943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.161943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:25.161943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:25.161943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.161943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:25.161943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:25.161943 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:25.162295 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:25.162683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:25.162683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:25.162683 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:29.906875 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:29.907878 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:29.908109 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:29.909262 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:29.949824 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:29.950116 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:29.951195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:29.951195 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:29.951195 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:29.951195 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:29.951195 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:29.951195 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:29.951195 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:29.951195 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:29.952993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:29.952993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:29.952993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:29.952993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:29.952993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:29.952993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:29.952993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:29.952993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:29.952993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:29.952993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:29.952993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:29.952993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:29.953320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:29.953320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:29.953320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:29.953320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:29.953320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:29.953320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:29.953320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:29.953320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:29.953320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:29.953320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:29.953320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:29.953320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:29.953320 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:29.953644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:29.953644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:29.954959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:29.954959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:29.954959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:29.954959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:29.954959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:29.954959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:29.954959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:29.954959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:29.954959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:29.954959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:29.954959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:29.954959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:29.954959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:29.954959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:29.954959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:29.954959 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:29.955387 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:29.955831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:29.955831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:29.955831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:30.138609 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:30.139237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:30.139486 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:30.140727 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:30.141158 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:30.141413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.142530 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:30.142530 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:30.142530 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:30.142530 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:30.142530 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:30.142530 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:30.142530 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.142530 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:30.144099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.144099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:30.144099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:30.144099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:30.144099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.144099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:30.144099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:30.144099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.144099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:30.144099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:30.144099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:30.144099 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.144720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:30.144720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:30.144720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:30.144720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:30.144720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:30.144720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:30.144720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:30.144720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:30.144720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:30.144720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:30.144720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:30.144720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:30.144720 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:30.145217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.145217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:30.145731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.145731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:30.145731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:30.145731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:30.145731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:30.145731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:30.145731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.145731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:30.145731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:30.145731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.145731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:30.145731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:30.145731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.145731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:30.145731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:30.145731 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:30.147450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:30.148924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:30.148924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.148924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:30.148924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:30.148924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:30.148924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:30.148924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:59:30.149526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:30.149800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.150603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:30.150603 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:30.150603 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:30.150603 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:30.150603 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:30.150603 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:30.150603 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.150603 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:30.151472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.151472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:30.151472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:30.151472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:30.151472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.151472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:30.151472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:30.151472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:30.151472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.151472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:30.151472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:30.151472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:30.151472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:30.151472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:30.151472 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:30.152215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:30.152215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:30.152215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:30.152215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:30.152215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:30.152215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:30.152215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:30.152215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.152215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:30.152215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.152215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:30.152215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:30.152215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:30.152215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.152872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:30.152872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:30.152872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:59:30.152872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:30.152872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:30.152872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.152872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:30.152872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:30.152872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:30.152872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.152872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:30.152872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:30.152872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:30.153444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:30.153444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:30.153444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:30.153444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:30.153444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:30.153444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:30.153444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:30.153444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:30.153444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:30.153444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:30.153444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.153444 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:30.153936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.153936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:30.153936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:30.153936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:30.153936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:30.153936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:30.153936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.153936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:30.153936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:30.153936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.153936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:30.153936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:30.153936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.153936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:30.153936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:30.153936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:30.155753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:30.156605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:30.156605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:30.156605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:30.156605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:30.156605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:30.156605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.156605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:30.156605 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:30.156605 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:30.156605 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:30.157075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:30.157075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:30.157075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.157075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:30.157075 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:30.157075 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:30.157075 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:30.157075 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:30.157075 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:30.157075 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.157075 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:30.157075 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:30.157634 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:30.158426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:30.158426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:30.158426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:30.158426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:30.158426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.158426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:30.158426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.158426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:30.158426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:30.158426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:30.158426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.158426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:30.158426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:30.159196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:30.159196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:30.159196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.159196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:30.159196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:30.159196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:30.159196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.159196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:30.159196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:30.159196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:30.159196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:30.159196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:30.159196 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:30.159797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:30.159797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:30.159797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:30.159797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:30.159797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:30.159797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:30.159797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:30.159797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.159797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:30.159797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.159797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:30.159797 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.160238 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.160870 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:30.161192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:30.161192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:30.161192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:30.161192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:30.161192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:30.161192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:30.161346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.162199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:30.162199 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:30.162199 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:30.162199 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:30.162199 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:30.162199 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:30.162199 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.162199 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:30.162592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.162592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:30.162592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:30.162592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:30.162592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.162592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:30.162592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:30.162592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.162592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:30.162592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:30.162592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:30.162592 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.163180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:30.163180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:30.163180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:30.163180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:30.163180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:30.163180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:30.163180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:30.163180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:30.163180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:30.163180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:30.163180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:30.163180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:30.163180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:30.163547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.163547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:30.163547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.163547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:30.163547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:30.163547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:30.163547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:30.163547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:30.163547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.163547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:30.163547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:30.163547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.163547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:30.163547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:30.163547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:30.163828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:30.164156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:30.164156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:30.164156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:30.164156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:30.164156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:30.164156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:34.907563 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:34.908733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:34.908733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:34.909459 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:34.954209 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:34.954688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:34.955658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:34.955658 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:34.955658 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:34.955658 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:34.955658 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:34.955658 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:34.955658 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:34.955658 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:34.956832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.047 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:34.956832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:34.956832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:34.956832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:34.956832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:34.956832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:34.956832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:34.956832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:34.956832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:34.956832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:34.956832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:34.956832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:34.957539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:34.957539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:34.957539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:34.957539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:34.957539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:34.957539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:34.957539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:34.957539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:34.957539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:34.957539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:34.957539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:34.957539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:34.957539 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:34.958203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:34.958203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:34.958203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:34.958203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:34.958203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:34.958203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:34.958203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:34.958203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:34.958203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:34.958203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:34.958203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:34.958203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:34.958203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:34.958203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:34.958203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:34.959215 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:34.961174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:34.961174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:34.961174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:34.961174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:34.961174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:34.961174 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:35.139564 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:35.140204 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:35.140443 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:35.141819 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:35.142179 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:35.142352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.143233 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:35.143233 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:35.143233 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:35.143233 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:35.143233 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:35.143233 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:35.143233 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.143233 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:35.144855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.144855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:35.144855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:35.144855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:35.144855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.144855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:35.144855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:35.144855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.144855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:35.144855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:35.144855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:35.144855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.145464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:35.145464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:35.145464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:35.145464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:35.145464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:35.145464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:35.145464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:35.145464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:35.145464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:35.145464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:35.145464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:35.145464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:35.145464 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:35.146021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.146021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:35.146021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.146021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:35.146021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:35.146021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:35.146021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:35.146021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:35.146021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.146021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:35.146021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:35.146021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.146021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:35.146021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:35.146021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:35.147462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:35.148303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:35.148303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:35.148303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:35.148303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:35.148303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.148303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:35.148771 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:35.149070 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:35.149162 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:35.149316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:59:35.149741 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:35.149998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.150628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:35.150628 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:35.150628 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:35.150628 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:35.150628 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:35.150628 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:35.150628 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.150628 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:35.151395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.151395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:35.151395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:35.151395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:35.151395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.151395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:35.151395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:35.151395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:35.151395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.151395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:35.151395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:35.151395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:35.151395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:35.151395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:35.151395 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:35.152301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:35.152301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:35.152301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:35.152301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:35.152301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:35.152301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:35.152301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:35.152301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.152301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:35.152301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.152301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:35.152301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:35.152301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:35.152301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.152793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:35.152793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:35.152793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:59:35.152793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:35.152793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:35.152793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.152793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:35.152793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:35.152793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:35.152793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.152793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:35.152793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:35.152793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:35.153148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:35.153148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:35.153148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:35.153148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:35.153148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:35.153148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:35.153148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:35.153148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:35.153148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:35.153148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:35.153148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.153148 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:35.153484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.153484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:35.153484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:35.153484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:35.153484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:35.153484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:35.153484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.153484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:35.153484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:35.153484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.153484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:35.153484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:35.153484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.153484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:35.153484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:35.153484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:35.153913 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:35.154417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:35.154417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:35.154417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:35.154417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:35.154417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:35.154417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.154417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:35.154417 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:35.154417 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:35.154417 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:35.154706 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:35.155359 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:35.155359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.155686 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:35.155686 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:35.155686 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:35.155686 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:35.155686 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:35.155686 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:35.155686 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.155686 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:35.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:35.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:35.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:35.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:35.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:35.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:35.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:35.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:35.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:35.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:35.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:35.156456 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:35.157979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:35.157979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:35.157979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:35.157979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:35.157979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:35.157979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:35.157979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:35.157979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.157979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:35.157979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.157979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:35.157979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:35.157979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:35.157979 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.158844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:35.158844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:35.158844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:35.158844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:35.158844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.158844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:35.158844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:35.158844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:35.158844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.158844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:35.158844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:35.158844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:35.158844 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:35.159602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:35.159602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:35.159602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:35.159602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:35.159602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:35.159602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:35.159602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:35.159602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:35.159602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:35.159602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.159602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:35.159602 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:35.160304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.161234 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:35.161869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:35.161869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:35.161869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:35.161869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:35.161869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:35.161869 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:35.162045 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.162642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:35.162642 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:35.162642 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:35.162642 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:35.162642 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:35.162642 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:35.162642 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.162642 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:35.163531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.163531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:35.163531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:35.163531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:35.163531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.163531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:35.163531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:35.163531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.163531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:35.163531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:35.163531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:35.163531 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.163784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:35.163784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:35.163784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:35.163784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:35.163784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:35.163784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:35.163784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:35.163784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:35.163784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:35.163784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:35.163784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:35.163784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:35.163784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:35.164053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.164053 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:35.164527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.164527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:35.164527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:35.164527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:35.164527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:35.164527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:35.164527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.164527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:35.164527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:35.164527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.164527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:35.164527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:35.164527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.164527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:35.164527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:35.164527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:35.165270 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:35.165837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:35.165837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:35.165837 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:39.908302 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:39.909275 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:39.909275 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:39.910695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:39.946217 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:39.946651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:39.947569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:39.947569 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:39.947569 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:39.947569 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:39.947569 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:39.947569 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:39.947569 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:39.947569 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:39.948711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:39.948711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:39.948711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:39.948711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:39.948711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:39.948711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:39.948711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:39.948711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:39.948711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:39.948711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:39.948711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:39.948711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:39.949226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:39.949226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:39.949226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:39.949226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:39.949226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:39.949226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:39.949226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:39.949226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:39.949226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:39.949226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:39.949226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:39.949226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:39.949226 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:39.949650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:39.949650 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:39.950036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:39.950036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:39.950036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:39.950036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:39.950036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:39.950036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:39.950036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:39.950036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:39.950036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:39.950036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:39.950036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:39.950036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:39.950036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:39.950036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:39.950036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:39.950036 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:39.951646 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:39.952717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:39.952717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:39.952717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:40.140413 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:40.141261 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:40.141461 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:40.142695 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:40.143033 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:40.143252 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.144180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:40.144180 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:40.144180 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:40.144180 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:40.144180 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:40.144180 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:40.144180 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.144180 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:40.145848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.145848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:40.145848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:40.145848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:40.145848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.145848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:40.145848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:40.145848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.145848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:40.145848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:40.145848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:40.145848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.146514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:40.146514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:40.146514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:40.146514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:40.146514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:40.146514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:40.146514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:40.146514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:40.146514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:40.146514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:40.146514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:40.146514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:40.146514 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:40.147050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.147050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:40.148403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.148403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:40.148403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:40.148403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:40.148403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:40.148403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:40.148403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.148403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:40.148403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:40.148403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.148403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:40.148403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:40.148403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.148403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:40.148403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:40.148403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:40.149165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:40.150989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:40.150989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.150989 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:40.150989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:40.150989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:40.150989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:40.150989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:59:40.150989 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:40.151651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.151651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:40.151651 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:40.151651 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:40.151651 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:40.151651 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:40.151651 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:40.151651 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.151651 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:40.152071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.152071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:40.152071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:40.152071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:40.152071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.152071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:40.152071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:40.152071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:40.152071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.152071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:40.152071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:40.152071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:40.152071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:40.152071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:40.152071 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:40.152907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:40.152907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:40.152907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:40.152907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:40.152907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:40.152907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:40.152907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:40.152907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.152907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:40.152907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.152907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:40.152907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:40.152907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:40.152907 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.153594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:40.153594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:40.153594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:59:40.153594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:40.153594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:40.153594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.153594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:40.153594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:40.153594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:40.153594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.153594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:40.153594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:40.153594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:40.153981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:40.153981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:40.153981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:40.153981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:40.153981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:40.153981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:40.153981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:40.153981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:40.153981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:40.153981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:40.153981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.153981 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:40.154805 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:40.155308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:40.155308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:40.155308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:40.155308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:40.155308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:40.155308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.155308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:40.155308 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:40.155308 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:40.155308 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:40.155651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:40.155651 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:40.155651 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.156518 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:40.156518 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:40.156518 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:40.156518 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:40.156518 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:40.156518 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:40.156518 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.156518 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:40.157048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.157048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:40.157048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:40.157048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:40.157048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.157048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:40.157048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:40.157048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:40.157048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.157048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:40.157048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:40.157048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:40.157048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:40.157048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:40.157048 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:40.158020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:40.158020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:40.158020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:40.158020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:40.158020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:40.158020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:40.158020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:40.158020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.158020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:40.158020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.158020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:40.158020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:40.158020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:40.158020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:40.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:40.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:40.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:40.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:40.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:40.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:40.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:40.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:40.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:40.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:40.160044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:40.160044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:40.160044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:40.160044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:40.160044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:40.160044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:40.160044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:40.160044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:40.160044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:40.160044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.160044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:40.160044 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:40.161054 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.162082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:40.162810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:40.162810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:40.162810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:40.162810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:40.162810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:40.162810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:40.163145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.163145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:40.163145 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:40.163145 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:40.163145 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:40.163145 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:40.163145 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:40.163145 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.163145 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:40.163417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.163417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:40.163417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:40.163417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:40.163417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.163417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:40.163417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:40.163417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.163417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:40.163417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:40.163417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:40.163417 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.163815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:40.163815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:40.163815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:40.163815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:40.163815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:40.163815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:40.163815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:40.163815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:40.163815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:40.163815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:40.163815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:40.163815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:40.163815 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:40.164057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.164057 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:40.164603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.164603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:40.164603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:40.164603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:40.164603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:40.164603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:40.164603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.164603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:40.164603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:40.164603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.164603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:40.164603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:40.164603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.164603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:40.164603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:40.164603 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:40.164930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:40.165304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:40.165304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:40.165304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:44.909280 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:44.910275 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:44.910425 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:44.911891 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:44.952957 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:44.953428 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:44.954609 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:44.954609 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:44.954609 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:44.954609 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:44.954609 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:44.954609 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:44.954609 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:44.954609 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:44.956059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.044 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:44.956059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:44.956059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:44.956059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:44.956059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:44.956059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:44.956059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:44.956059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:44.956059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:44.956059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:44.956059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:44.956059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:44.956422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:44.956422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:44.956422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:44.956422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:44.956422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:44.956422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:44.956422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:44.956422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:44.956422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:44.956422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:44.956422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:44.956422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:44.956422 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:44.956692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:44.956692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:44.956868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:44.956868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:44.956868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:44.956868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:44.956868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:44.956868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:44.956868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:44.956868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:44.956868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:44.956868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:44.956868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:44.956868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:44.956868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:44.956868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:44.956868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:44.956868 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:44.957202 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:44.957600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:44.957600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:44.957600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:45.141237 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:45.142730 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:45.142976 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:45.144383 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:45.144687 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:45.144905 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.146617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:45.146617 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:45.146617 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:45.146617 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:45.146617 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:45.146617 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:45.146617 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.146617 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:45.147688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.147688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:45.147688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:45.147688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:45.147688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.147688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:45.147688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:45.147688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.147688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:45.147688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:45.147688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:45.147688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.148285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:45.148285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:45.148285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:45.148285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:45.148285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:45.148285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:45.148285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:45.148285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:45.148285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:45.148285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:45.148285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:45.148285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:45.148285 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:45.149020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.149020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:45.149020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.149020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:45.149020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:45.149020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:45.149020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:45.149020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:45.149020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.149020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:45.149020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:45.149020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.149020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:45.149020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:45.149020 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:45.149702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:45.150710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:45.150710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:45.150710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:45.150710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:45.150710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.150710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:45.150710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:45.150710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:45.150710 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:45.151153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:59:45.151288 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:45.151605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.152246 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:45.152246 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:45.152246 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:45.152246 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:45.152246 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:45.152246 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:45.152246 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.152246 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:45.152827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.152827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:45.152827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:45.152827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:45.152827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.152827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:45.152827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:45.152827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:45.152827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.152827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:45.152827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:45.152827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:45.152827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:45.152827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:45.152827 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:45.153232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:45.153232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:45.153232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:45.153232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:45.153232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:45.153232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:45.153232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:45.153232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.153232 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:45.153508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.153508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:45.153508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:45.153508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:45.153508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.153508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:45.153508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:45.153508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:59:45.153508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:45.153508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:45.153508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.153508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:45.153839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:45.153839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:45.153839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.153839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:45.153839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:45.153839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:45.153839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:45.153839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:45.153839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:45.153839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:45.153839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:45.153839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:45.153839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:45.153839 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:45.154195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:45.154195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:45.154195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.154195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:45.154195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.154195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:45.154195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:45.154195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:45.154195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:45.154195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:45.154195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.154195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:45.154195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:45.154195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:45.154614 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:45.155175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:45.155175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:45.155175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:45.155175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:45.155175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:45.155175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:45.155175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:45.155175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:45.155175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:45.155175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:45.155175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.155175 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:45.155175 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:45.155175 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:45.155581 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:45.155581 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:45.155765 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:45.156092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.156725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:45.156725 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:45.156725 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:45.156725 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:45.156725 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:45.156725 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:45.156725 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.156725 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:45.157254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.157254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:45.157254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:45.157254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:45.157254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.157254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:45.157254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:45.157254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:45.157254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.157254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:45.157254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:45.157254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:45.157254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:45.157254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:45.157254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:45.157688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:45.157688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:45.157688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:45.157688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:45.157688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:45.157688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:45.157688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:45.157688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.157688 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:45.158191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.158191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:45.158191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:45.158191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:45.158191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.158191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:45.158191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:45.158191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:45.158191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:45.158191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.158191 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:45.158645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:45.158645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:45.158645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.158645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:45.158645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:45.158645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:45.158645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:45.158645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:45.158645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:45.158645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:45.158645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:45.158645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:45.158645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:45.158645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:45.159062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:45.159062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:45.159062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.159062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:45.159062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.159062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:45.159062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:45.159062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:45.159062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:45.159062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:45.159062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.159062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:45.159062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:45.159062 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:45.159509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:45.159992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:45.159992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:45.159992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:45.159992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:45.159992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:45.159992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:45.159992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:45.159992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:45.159992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:45.159992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.159992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:45.160602 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:45.160916 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:45.161012 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:45.161127 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:45.161562 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:45.161887 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:45.162097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.162796 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:45.162796 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:45.162796 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:45.162796 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:45.162796 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:45.162796 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:45.162796 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.162796 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:45.163662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.163662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:45.163662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:45.163662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:45.163662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.163662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:45.163662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:45.163662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.163662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:45.163662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:45.163662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:45.163662 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.164010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:45.164010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:45.164010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:45.164010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:45.164010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:45.164010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:45.164010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:45.164010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:45.164010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:45.164010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:45.164010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:45.164010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:45.164010 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:45.164394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.164394 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:45.164610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.164610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:45.164610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:45.164610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:45.164610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:45.164610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:45.164610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.164610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:45.164610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:45.164610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.164610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:45.164610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:45.164610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.164610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:45.164610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:45.164610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:45.165055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:45.165594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:45.165594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:45.165594 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:49.911141 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:49.912246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:49.912246 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:49.913713 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:49.948151 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:49.948600 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:49.949573 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:49.949573 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:49.949573 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:49.949573 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:49.949573 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:49.949573 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:49.949573 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:49.949573 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:49.950467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:49.950467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:49.950467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:49.950467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:49.950467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:49.950467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:49.950467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:49.950467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:49.950467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:49.950467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:49.950467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:49.950467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:49.951076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:49.951076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:49.951076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:49.951076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:49.951076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:49.951076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:49.951076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:49.951076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:49.951076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:49.951076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:49.951076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:49.951076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:49.951076 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:49.951949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:49.951949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:49.951949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:49.951949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:49.951949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:49.951949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:49.951949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:49.951949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:49.951949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:49.951949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:49.951949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:49.951949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:49.951949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:49.951949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:49.951949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:49.952709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:49.954762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:49.954762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:49.954762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:49.954762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:49.954762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:49.954762 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:50.142944 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:50.143820 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:50.144021 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:50.145489 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:50.145872 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:50.146120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.147100 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:50.147100 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:50.147100 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:50.147100 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:50.147100 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:50.147100 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:50.147100 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.147100 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:50.148856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.148856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:50.148856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:50.148856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:50.148856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.148856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:50.148856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:50.148856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.148856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:50.148856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:50.148856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:50.148856 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.149467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:50.149467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:50.149467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:50.149467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:50.149467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:50.149467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:50.149467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:50.149467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:50.149467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:50.149467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:50.149467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:50.149467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:50.149467 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:50.149807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.149807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:50.150582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.150582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:50.150582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:50.150582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:50.150582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:50.150582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:50.150582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.150582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:50.150582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:50.150582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.150582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:50.150582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:50.150582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.150582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:50.150582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:50.150582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:50.151009 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:50.151517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:50.151517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.151517 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:50.151517 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:50.151517 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:50.151693 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:50.152084 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:59:50.152495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:50.152736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.153397 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:50.153397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:50.153397 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:50.153397 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:50.153397 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:50.153397 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:50.153397 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.153397 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:50.154170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.154170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:50.154170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:50.154170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:50.154170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.154170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:50.154170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:50.154170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:50.154170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.154170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:50.154170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:50.154170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:50.154170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:50.154170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:50.154170 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:50.155326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:50.155326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:50.155326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:50.155326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:50.155326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:50.155326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:50.155326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:50.155326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.155326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:50.155326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.155326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:50.155326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:50.155326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:50.155326 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.155988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:50.155988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:50.155988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:59:50.155988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:50.155988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:50.155988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.155988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:50.155988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:50.155988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:50.155988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.155988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:50.155988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:50.155988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:50.156311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:50.156311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:50.156311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:50.156311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:50.156311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:50.156311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:50.156311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:50.156311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:50.156311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:50.156311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:50.156311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.156311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:50.156621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.156621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:50.156621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:50.156621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:50.156621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:50.156621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:50.156621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.156621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:50.156621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:50.156621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.156621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:50.156621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:50.156621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.156621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:50.156621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:50.156621 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:50.157107 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:50.157601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:50.157601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:50.157601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:50.157601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:50.157601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:50.157601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.157601 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:50.157601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:50.157601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:50.157601 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:50.157891 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:50.157891 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:50.158543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.158892 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:50.158892 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:50.158892 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:50.158892 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:50.158892 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:50.158892 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:50.158892 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.158892 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:50.159672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.159672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:50.159672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:50.159672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:50.159672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.159672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:50.159672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:50.159672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:50.159672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.159672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:50.159672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:50.159672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:50.159672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:50.159672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:50.159672 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:50.160671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:50.160671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:50.160671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:50.160671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:50.160671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:50.160671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:50.160671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:50.160671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.160671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:50.160671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.160671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:50.160671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:50.160671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:50.160671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.161773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:50.161773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:50.161773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:50.161773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:50.161773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.161773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:50.161773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:50.161773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:50.161773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.161773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:50.161773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:50.161773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:50.161773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:50.162556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:50.162556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:50.162556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:50.162556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:50.162556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:50.162556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:50.162556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:50.162556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:50.162556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:50.162556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.162556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:50.162556 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:50.163254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.164162 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:50.165255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:50.165255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:50.165255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:50.165255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:50.165255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:50.165255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:50.165500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.165500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:50.165500 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:50.165500 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:50.165500 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:50.165500 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:50.165500 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:50.165500 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.165500 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:50.165500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.165500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:50.165500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:50.165500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:50.165500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.165500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:50.165882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:50.165882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.165882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:50.165882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:50.165882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:50.165882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.165882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:50.165882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:50.165882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:50.165882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:50.165882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:50.165882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:50.165882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:50.165882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:50.166254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:50.166254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:50.166254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:50.166254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:50.166254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:50.166254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.166254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:50.166254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.166254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:50.166254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:50.166254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:50.166254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:50.166254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:50.166618 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:50.167069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:50.167069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:50.167069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:50.167069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:50.167069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:50.167069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:50.167069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:50.167069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:50.167069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:50.167069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:50.167069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:50.167069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:54.911996 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:54.912850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:54.912995 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:54.914448 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:54.916733 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG dbcounter [-] [106381] Writing DB stats neutron:SELECT=240 {{(pid=106381) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 24 10:59:54.951449 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:54.951831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:54.952875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:54.952875 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:54.952875 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:54.952875 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:54.952875 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:54.952875 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:54.952875 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:54.952875 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:54.953583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:54.953583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:54.953583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:54.953583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:54.953583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:54.953583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:54.953583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:54.953583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:54.953583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:54.953583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:54.953583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:54.953583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:54.954069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:54.954069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:54.954069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:54.954069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:54.954069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:54.954069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:54.954069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:54.954069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:54.954069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:54.954069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:54.954069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:54.954069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:54.954069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:54.954585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:54.954585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:54.954585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:54.954585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:54.954585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:54.954585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:54.954585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:54.954585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:54.954585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:54.954585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:54.954585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:54.954585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:54.954585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:54.954585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:54.954585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:54.955114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:54.955880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:54.955880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:54.955880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:54.955880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:54.955880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:54.955880 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:55.143836 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:55.144498 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:55.144865 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:55.146024 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:55.146438 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:55.146693 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.147746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:55.147746 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:55.147746 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:55.147746 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:55.147746 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:55.147746 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:55.147746 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.147746 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:55.149280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.149280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:55.149280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:55.149280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:55.149280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.149280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:55.149280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:55.149280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.149280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:55.149280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:55.149280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:55.149280 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.150021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:55.150021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:55.150021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:55.150021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:55.150021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:55.150021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:55.150021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:55.150021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:55.150021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:55.150021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:55.150021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:55.150021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:55.150021 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:55.150698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.150698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:55.150952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.150952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:55.150952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:55.150952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:55.150952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:55.150952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:55.150952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.150952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:55.150952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:55.150952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.150952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:55.150952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:55.150952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.150952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:55.150952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:55.150952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:55.151780 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:55.152687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:55.152687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.152687 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:55.152687 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:55.152687 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:55.152687 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:55.152687 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 10:59:55.153559 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:55.153863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.154777 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:55.154777 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:55.154777 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:55.154777 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:55.154777 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:55.154777 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:55.154777 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.154777 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:55.155673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.155673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:55.155673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:55.155673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:55.155673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.155673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:55.155673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:55.155673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:55.155673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.155673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:55.155673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:55.155673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:55.155673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:55.155673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:55.155673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:55.156336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:55.156336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:55.156336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:55.156336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:55.156336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:55.156336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:55.156336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:55.156336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.156336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:55.156336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.156336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:55.156336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:55.156336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:55.156336 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.157186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:55.157186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:55.157186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 10:59:55.157186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:55.157186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:55.157186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.157186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:55.157186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:55.157186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:55.157186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.157186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:55.157186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:55.157186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:55.157705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:55.157705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:55.157705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:55.157705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:55.157705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:55.157705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:55.157705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:55.157705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:55.157705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:55.157705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:55.157705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.157705 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:55.158144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.158144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:55.158144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:55.158144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:55.158144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:55.158144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:55.158144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.158144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:55.158144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:55.158144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.158144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:55.158144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:55.158144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.158144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:55.158144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:55.158144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:55.158875 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:55.159564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:55.159564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:55.159564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:55.159564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:55.159564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:55.159564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.159564 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:55.159564 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:55.159564 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:55.159564 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:55.159935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:55.159935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:55.159935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.159935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:55.159935 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:55.159935 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:55.159935 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:55.159935 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:55.159935 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:55.159935 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.159935 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:55.160563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.160563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 10:59:55.160563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:55.160563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:55.160563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.160563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:55.160563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:55.160563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:55.160563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.160563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 10:59:55.160563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:55.160563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 10:59:55.160563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:55.160563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 10:59:55.160563 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 10:59:55.161200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:55.161200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 10:59:55.161200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:55.161200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 10:59:55.161200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 10:59:55.161200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:55.161200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 10:59:55.161200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.161200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 10:59:55.161536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.161536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:55.161536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:55.161536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:55.161536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.161536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:55.161536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:55.161536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:55.161536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:55.161536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.161536 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:55.161883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:55.161883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:55.161883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.161883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:55.161883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:55.161883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:55.161883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:55.161883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:55.161883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:55.161883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:55.161883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:55.161883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:55.161883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:55.161883 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:55.162332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:55.162332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:55.162332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.162332 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.162496 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:55.162936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:55.163437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:55.163437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:55.163437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.163437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:55.163437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:55.163437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:55.163437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:55.163437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:55.163746 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:55.163981 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:55.164130 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.164670 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:55.164670 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:55.164670 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:55.164670 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:55.164670 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:55.164670 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:55.164670 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.164670 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:55.165736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.165736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:55.165736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:55.165736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:55.165736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.165736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:55.165736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:55.165736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.165736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:55.165736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:55.165736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:55.165736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.166139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:55.166139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:55.166139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:55.166139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:55.166139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:55.166139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:55.166139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:55.166139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:55.166139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:55.166139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:55.166139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:55.166139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:55.166139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:55.166543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.166543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:55.166744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.166744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:55.166744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:55.166744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:55.166744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:55.166744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:55.166744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.166744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:55.166744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:55.166744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.166744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:55.166744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:55.166744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.166744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:55.166744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:55.166744 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:55.167201 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:55.167789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:55.167789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:55.167789 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 10:59:59.912788 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 10:59:59.914905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 10:59:59.914905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 10:59:59.915533 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 10:59:59.956247 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 10:59:59.956719 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:59.957725 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 10:59:59.957725 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:59.957725 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 10:59:59.957725 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 10:59:59.957725 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:59.957725 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 10:59:59.957725 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:59.957725 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 10:59:59.958872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.044 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:59.958872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 10:59:59.958872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:59.958872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 10:59:59.958872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:59.958872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:59.958872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:59.958872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:59.958872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:59.958872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:59.958872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:59.958872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:59.959595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 10:59:59.959595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:59.959595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 10:59:59.959595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:59.959595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 10:59:59.959595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 10:59:59.959595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:59.959595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 10:59:59.959595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:59.959595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 10:59:59.959595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 10:59:59.959595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:59.959595 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 10:59:59.960306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:59.960306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 10:59:59.960306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:59.960306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 10:59:59.960306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 10:59:59.960306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 10:59:59.960306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 10:59:59.960306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 10:59:59.960306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:59.960306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 10:59:59.960306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 10:59:59.960306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:59.960306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 10:59:59.960306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 10:59:59.960306 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 10:59:59.961353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 10:59:59.962402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 10:59:59.962402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 10:59:59.962402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 10:59:59.962402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 10:59:59.962402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 10:59:59.962402 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:00.144714 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:00.145644 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:00.145847 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:00.147397 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:00.147917 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:00.148203 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.149318 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:00.149318 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:00.149318 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:00.149318 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:00.149318 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:00.149318 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:00.149318 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.149318 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:00.151089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.151089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:00.151089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:00.151089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:00.151089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.151089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:00.151089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:00.151089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.151089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:00.151089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:00.151089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:00.151089 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.151788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:00.151788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:00.151788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:00.151788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:00.151788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:00.151788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:00.151788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:00.151788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:00.151788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:00.151788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:00.151788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:00.151788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:00.151788 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:00.152393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.152393 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:00.153173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.153173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:00.153173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:00.153173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:00.153173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:00.153173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:00.153173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.153173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:00.153173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:00.153173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.153173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:00.153173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:00.153173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.153173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:00.153173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:00.153173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:00.153690 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:00.154227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:00.154227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.154227 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:00.154227 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:00.154227 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:00.154227 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:00.154227 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 11:00:00.154772 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:00.155102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.155951 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:00.155951 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:00.155951 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:00.155951 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:00.155951 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:00.155951 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:00.155951 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.155951 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:00.156764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.156764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:00.156764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:00.156764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:00.156764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.156764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:00.156764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:00.156764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:00.156764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.156764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:00.156764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:00.156764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:00.156764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:00.156764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:00.156764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:00.157304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:00.157304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:00.157304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:00.157304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:00.157304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:00.157304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:00.157304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:00.157304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.157304 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:00.157659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.157659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:00.157659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:00.157659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:00.157659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.157659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:00.157659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:00.157659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 11:00:00.157659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:00.157659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:00.157659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.157659 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:00.158069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:00.158069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:00.158069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.158069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:00.158069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:00.158069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:00.158069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:00.158069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:00.158069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:00.158069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:00.158069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:00.158069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:00.158069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:00.158069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:00.158501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:00.158501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:00.158501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.158501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:00.158995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.158995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:00.158995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:00.158995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:00.158995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:00.158995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:00.158995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.158995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:00.158995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:00.158995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.158995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:00.158995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:00.158995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.158995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:00.158995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:00.158995 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:00.159522 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:00.160114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:00.160114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:00.160114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:00.160114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:00.160114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:00.160114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.160114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:00.160114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:00.160114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:00.160114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:00.160494 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:00.160494 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:00.160778 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.161520 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:00.161520 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:00.161520 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:00.161520 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:00.161520 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:00.161520 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:00.161520 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.161520 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:00.162269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.162269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:00.162269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:00.162269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:00.162269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.162269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:00.162269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:00.162269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:00.162269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.162269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:00.162269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:00.162269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:00.162269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:00.162269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:00.162269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:00.162753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:00.162753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:00.162753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:00.162753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:00.162753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:00.162753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:00.162753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:00.162753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.162753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:00.163193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.163193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:00.163193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:00.163193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:00.163193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.163193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:00.163193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:00.163193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:00.163193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:00.163193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.163193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:00.163645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:00.163645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:00.163645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.163645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:00.163645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:00.163645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:00.163645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:00.163645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:00.163645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:00.163645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:00.163645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:00.163645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:00.163645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:00.163645 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:00.164050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:00.164050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:00.164050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.164050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.164260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:00.164841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:00.165441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:00.165441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:00.165441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.165441 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:00.165441 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:00.165441 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:00.165441 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:00.165441 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:00.165737 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:00.165965 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:00.166147 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.166764 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:00.166764 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:00.166764 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:00.166764 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:00.166764 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:00.166764 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:00.166764 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.166764 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:00.167685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.167685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:00.167685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:00.167685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:00.167685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.167685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:00.167685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:00.167685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.167685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:00.167685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:00.167685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:00.167685 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.168101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:00.168101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:00.168101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:00.168101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:00.168101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:00.168101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:00.168101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:00.168101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:00.168101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:00.168101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:00.168101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:00.168101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:00.168101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:00.168498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.168498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:00.168709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.168709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:00.168709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:00.168709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:00.168709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:00.168709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:00.168709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.168709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:00.168709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:00.168709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.168709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:00.168709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:00.168709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.168709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:00.168709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:00.168709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:00.169194 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:00.169786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:00.169786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:00.169786 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:03.777053 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:03.778103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_for_inconsistencies {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:03.778103 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Checking Neutron and OVN revision consistency. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:03.789838 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:440}}
Apr 24 11:00:03.790003 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=106381) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:419}}
Apr 24 11:00:03.790122 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 412fe0fb-d3c8-41ef-b742-c7e091bf5e56 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 11:00:03.827263 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, resource={'id': '412fe0fb-d3c8-41ef-b742-c7e091bf5e56', 'name': 'private', 'tenant_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'project_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['bedea127-581a-4245-bdcf-823b49c82996', 'd98dd98c-3740-4b7b-9054-95b7f384275a'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:19:49Z', 'updated_at': '2026-04-24T10:19:53Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 21598}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:03.827813 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-412fe0fb-d3c8-41ef-b742-c7e091bf5e56, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:03.828342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-d9e6c44e-2c1f-4e1c-97fa-3abe15d536c8, external_ids_update=None, columns={'tag': 21598}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:03.828545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:03.829611 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:03.829611 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:03.829611 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:03.829611 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:03.829611 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:03.829611 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:03.829611 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:03.829611 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:03.832092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 412fe0fb-d3c8-41ef-b742-c7e091bf5e56 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:03.832092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:03.832092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 11:00:03.832092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 11:00:03.832092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 11:00:03.832092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 11:00:03.832092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 11:00:03.832092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:03.832092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:03.832092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:03.832092 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:03.832676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:03.832676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:03.832676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:03.832676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:03.832676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:03.832676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:03.832676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:03.832676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:03.832676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:03.832676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:03.832676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:03.832676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:03.832676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:03.832676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:03.833244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:03.833244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:03.833244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:03.833244 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 86c46bc9-7739-46e7-9c49-62d2723e0d83 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 11:00:03.866796 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, resource={'id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'name': 'public', 'tenant_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'project_id': '2e4d2661f2df4aad8f7fb706d4b7eb76', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['4daf396b-50dc-4100-9154-fd24fc0e5f1d', '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-24T10:19:55Z', 'updated_at': '2026-04-24T10:20:05Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:03.867190 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:03.867736 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-b792be55-4fbf-4e4f-a9dc-10cee932ceea, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:03.868159 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:03.869097 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:03.869097 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:03.869097 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:03.869097 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:03.869097 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:03.869097 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:03.869097 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:03.869097 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:03.870491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 86c46bc9-7739-46e7-9c49-62d2723e0d83 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:03.870491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:03.870491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 11:00:03.870491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 11:00:03.870491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 11:00:03.870491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 11:00:03.870491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 11:00:03.870491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:03.870491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:03.870491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:03.870491 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:03.871297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:03.871297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:03.871297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:03.871297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:03.871297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:03.871297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:03.871297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:03.871297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:03.871297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:03.871297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:03.871297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:03.871297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:03.871297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:03.871297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:03.872173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:03.872173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:03.872173 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:03.872173 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 64c3f969-5120-406a-afc1-20f8f45b7533 (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 11:00:03.897585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-64c3f969-5120-406a-afc1-20f8f45b7533, resource={'id': '64c3f969-5120-406a-afc1-20f8f45b7533', 'name': 'admin_net', 'tenant_id': '91bc93878b40449c8fd1c9924d8a3e8b', 'project_id': '91bc93878b40449c8fd1c9924d8a3e8b', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['18db2f65-6ba9-4ddd-8ab7-55370a16debc'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:23:22Z', 'updated_at': '2026-04-24T10:23:23Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 10837}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:03.897906 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-64c3f969-5120-406a-afc1-20f8f45b7533, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:03.898255 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-a26d15c8-ce05-4e3e-84bc-9aa33edf96fe, external_ids_update=None, columns={'tag': 10837}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:03.898433 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:03.899216 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:03.899216 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:03.899216 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:03.899216 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:03.899216 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:03.899216 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:03.899216 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:03.899216 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:03.900337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 64c3f969-5120-406a-afc1-20f8f45b7533 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:03.900337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:03.900337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 11:00:03.900337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 11:00:03.900337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 11:00:03.900337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 11:00:03.900337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 11:00:03.900337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:03.900337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:03.900337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:03.900337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:03.900985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:03.900985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:03.900985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:03.900985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:03.900985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:03.900985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:03.900985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:03.900985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:03.900985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:03.900985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:03.900985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:03.900985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:03.900985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:03.900985 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:03.901610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:03.901610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:03.901610 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:03.901610 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource b30b34a1-477c-4ef7-aea4-d9540988f10a (type: networks) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 11:00:03.937106 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a, resource={'id': 'b30b34a1-477c-4ef7-aea4-d9540988f10a', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'tenant_id': '277dd31c279b430f90665727a827242c', 'project_id': '277dd31c279b430f90665727a827242c', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['a3090689-5a84-48d5-9685-f418bb1fd559'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-24T10:24:04Z', 'updated_at': '2026-04-24T10:24:05Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 23713}, resource_type=networks, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:03.937499 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-b30b34a1-477c-4ef7-aea4-d9540988f10a, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:03.937865 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-6d5b7906-0378-49b8-88fc-e9fa642055e4, external_ids_update=None, columns={'tag': 23713}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:03.937998 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:03.938889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:03.938889 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:03.938889 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:03.938889 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:03.938889 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:03.938889 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:03.938889 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:03.938889 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:03.939983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource b30b34a1-477c-4ef7-aea4-d9540988f10a (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:03.939983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:03.939983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 11:00:03.939983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 11:00:03.939983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 11:00:03.939983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 11:00:03.939983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2327, in update_network
Apr 24 11:00:03.939983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:03.939983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:03.939983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:03.939983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:03.940589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:03.940589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:03.940589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:03.940589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:03.940589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:03.940589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:03.940589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:03.940589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:03.940589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:03.940589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:03.940589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:03.940589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:03.940589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:03.940589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:03.941235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:03.941235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:03.941235 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:03.941235 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 931f18d3-b7f8-4874-928b-3c06d4d5d355 (type: routers) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 11:00:04.022347 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, resource={'id': '931f18d3-b7f8-4874-928b-3c06d4d5d355', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'project_id': '277dd31c279b430f90665727a827242c', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'external_fixed_ips': [{'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7', 'ip_address': '172.24.5.167'}, {'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'ip_address': '2001:db8::1b3'}], 'enable_snat': True}, 'gw_port_id': '77659748-a2b4-448f-aa2d-e166be8f2be9', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-7ytfi', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'external_fixed_ips': [{'ip_address': '172.24.5.167', 'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7'}, {'ip_address': '2001:db8::1b3', 'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-24T10:24:05Z', 'updated_at': '2026-04-24T10:24:08Z', 'revision_number': 3, 'tenant_id': '277dd31c279b430f90665727a827242c'}, resource_type=routers, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:04.022839 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-7ytfi', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:04.023201 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "77659748-a2b4-448f-aa2d-e166be8f2be9"')], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:04.023503 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "77659748-a2b4-448f-aa2d-e166be8f2be9"')], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:04.023752 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:04.024962 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:04.024962 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:04.024962 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:04.024962 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:04.024962 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:04.024962 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:04.024962 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:04.024962 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:04.025341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Unable to update router 931f18d3-b7f8-4874-928b-3c06d4d5d355. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:04.026899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 931f18d3-b7f8-4874-928b-3c06d4d5d355 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:04.026899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:04.026899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 11:00:04.026899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 11:00:04.026899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 11:00:04.026899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 11:00:04.026899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1634, in update_router
Apr 24 11:00:04.026899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 24 11:00:04.026899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
Apr 24 11:00:04.026899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 24 11:00:04.026899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 24 11:00:04.027576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 24 11:00:04.027576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1568, in update_router
Apr 24 11:00:04.027576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:04.027576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:04.027576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:04.027576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:04.027576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:04.027576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:04.027576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:04.027576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:04.027576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:04.027576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:04.027576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:04.027576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:04.028207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:04.028207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:04.028207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:04.028207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:04.028207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:04.028207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:04.028207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:04.028207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:04.028207 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:04.028207 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Fixing resource 77659748-a2b4-448f-aa2d-e166be8f2be9 (type: router_ports) at create/update {{(pid=106381) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:449}}
Apr 24 11:00:04.134072 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, resource={'id': '77659748-a2b4-448f-aa2d-e166be8f2be9', 'name': '', 'network_id': '86c46bc9-7739-46e7-9c49-62d2723e0d83', 'project_id': '', 'mac_address': 'fa:16:3e:fa:98:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '931f18d3-b7f8-4874-928b-3c06d4d5d355', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7', 'ip_address': '172.24.5.167'}, {'subnet_id': '4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'ip_address': '2001:db8::1b3'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000170011', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-24T10:24:06Z', 'updated_at': '2026-04-24T10:24:07Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:04.134392 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '81338f3e-0c60-45ac-bdf7-9f2cef86ccf7 4daf396b-50dc-4100-9154-fd24fc0e5f1d', 'neutron:network_name': 'neutron-86c46bc9-7739-46e7-9c49-62d2723e0d83', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['172.24.5.167/24', '2001:db8::1b3/64'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:04.134933 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=77659748-a2b4-448f-aa2d-e166be8f2be9, lrouter_port=lrp-77659748-a2b4-448f-aa2d-e166be8f2be9, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:04.135440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:04.136512 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:04.136512 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:04.136512 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:04.136512 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:04.136512 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:04.136512 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:04.136512 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:04.136512 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:04.137545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Maintenance task: Failed to fix resource 77659748-a2b4-448f-aa2d-e166be8f2be9 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:04.137545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:04.137545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 462, in check_for_inconsistencies
Apr 24 11:00:04.137545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 24 11:00:04.137545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 370, in _fix_create_update
Apr 24 11:00:04.137545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 24 11:00:04.137545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1971, in update_router_port
Apr 24 11:00:04.137545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:04.137545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:04.137545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:04.137545 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:04.138074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:04.138074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:04.138074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:04.138074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:04.138074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:04.138074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:04.138074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:04.138074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:04.138074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:04.138074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:04.138074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:04.138074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:04.138074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:04.138074 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:04.138753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:04.138753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:04.138753 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:04.138753 np0000170011 neutron-ovn-maintenance-worker[106381]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_for_inconsistencies finished in 0.360 seconds
Apr 24 11:00:04.913717 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:04.914777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:04.914777 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:04.916273 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:04.961522 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:04.962008 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:04.963127 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:04.963127 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:04.963127 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:04.963127 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:04.963127 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:04.963127 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:04.963127 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:04.963127 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:04.964301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.048 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:04.964301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:04.964301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:04.964301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:04.964301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:04.964301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:04.964301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:04.964301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:04.964301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:04.964301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:04.964301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:04.964301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:04.965120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:04.965120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:04.965120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:04.965120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:04.965120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:04.965120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:04.965120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:04.965120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:04.965120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:04.965120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:04.965120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:04.965120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:04.965120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:04.965938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:04.965938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:04.965938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:04.965938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:04.965938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:04.965938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:04.965938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:04.965938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:04.965938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:04.965938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:04.965938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:04.965938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:04.965938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:04.965938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:04.965938 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:04.966899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:04.968293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:04.968293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:04.968293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:04.968293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:04.968293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:04.968293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:05.145724 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:05.146387 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:05.146668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:05.148275 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:05.148704 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:05.148949 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.149993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:05.149993 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:05.149993 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:05.149993 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:05.149993 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:05.149993 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:05.149993 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.149993 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:05.151861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.151861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:05.151861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:05.151861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:05.151861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.151861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:05.151861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:05.151861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.151861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:05.151861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:05.151861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:05.151861 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.152325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:05.152325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:05.152325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:05.152325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:05.152325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:05.152325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:05.152325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:05.152325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:05.152325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:05.152325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:05.152325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:05.152325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:05.152325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:05.152828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.152828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:05.154168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.154168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:05.154168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:05.154168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:05.154168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:05.154168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:05.154168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.154168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:05.154168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:05.154168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.154168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:05.154168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:05.154168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.154168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:05.154168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:05.154168 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:05.154703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:05.155572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:05.155572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.155572 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:05.155572 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:05.155572 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:05.155572 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:05.155572 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 11:00:05.155993 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:05.156328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.157091 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:05.157091 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:05.157091 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:05.157091 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:05.157091 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:05.157091 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:05.157091 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.157091 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:05.158014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.158014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:05.158014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:05.158014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:05.158014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.158014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:05.158014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:05.158014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:05.158014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.158014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:05.158014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:05.158014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:05.158014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:05.158014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:05.158014 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:05.158692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:05.158692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:05.158692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:05.158692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:05.158692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:05.158692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:05.158692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:05.158692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.158692 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:05.159200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.159200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:05.159200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:05.159200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:05.159200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.159200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:05.159200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:05.159200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 11:00:05.159200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:05.159200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:05.159200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.159200 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:05.159761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:05.159761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:05.159761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.159761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:05.159761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:05.159761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:05.159761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:05.159761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:05.159761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:05.159761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:05.159761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:05.159761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:05.159761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:05.159761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:05.160255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:05.160255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:05.160255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.160255 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:05.160726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.160726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:05.160726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:05.160726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:05.160726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:05.160726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:05.160726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.160726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:05.160726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:05.160726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.160726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:05.160726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:05.160726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.160726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:05.160726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:05.160726 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:05.161300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:05.162051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:05.162051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:05.162051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:05.162051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:05.162051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:05.162051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.162051 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:05.162051 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:05.162051 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:05.162051 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:05.162476 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:05.162476 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:05.162476 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.162767 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:05.162767 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:05.162767 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:05.162767 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:05.162767 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:05.162767 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:05.162767 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.162767 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:05.163940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.163940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:05.163940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:05.163940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:05.163940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.163940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:05.163940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:05.163940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:05.163940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.163940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:05.163940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:05.163940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:05.163940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:05.163940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:05.163940 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:05.164358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:05.164358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:05.164358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:05.164358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:05.164358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:05.164358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:05.164358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:05.164358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.164358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:05.165001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.165001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:05.165001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:05.165001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:05.165001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.165001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:05.165001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:05.165001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:05.165001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:05.165001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.165001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:05.165324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:05.165324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:05.165324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.165324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:05.165324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:05.165324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:05.165324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:05.165324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:05.165324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:05.165324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:05.165324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:05.165324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:05.165324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:05.165324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:05.165730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:05.165730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:05.165730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.165730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.166493 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:05.166982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:05.167569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:05.167569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:05.167569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.167569 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:05.167569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:05.167569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:05.167569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:05.167569 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:05.167850 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:05.168059 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:05.168403 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.169055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:05.169055 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:05.169055 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:05.169055 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:05.169055 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:05.169055 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:05.169055 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.169055 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:05.170050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.170050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:05.170050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:05.170050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:05.170050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.170050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:05.170050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:05.170050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.170050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:05.170050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:05.170050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:05.170050 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.170677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:05.170677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:05.170677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:05.170677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:05.170677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:05.170677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:05.170677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:05.170677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:05.170677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:05.170677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:05.170677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:05.170677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:05.170677 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:05.171244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.171244 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:05.171419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.171419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:05.171419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:05.171419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:05.171419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:05.171419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:05.171419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.171419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:05.171419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:05.171419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.171419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:05.171419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:05.171419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.171419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:05.171419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:05.171419 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:05.172144 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:05.172993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:05.172993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:05.172993 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:09.914623 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:09.915661 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:09.915744 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:09.917139 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:09.963105 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:09.963617 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:09.964664 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:09.964664 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:09.964664 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:09.964664 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:09.964664 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:09.964664 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:09.964664 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:09.964664 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:09.965800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.049 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:09.965800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:09.965800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:09.965800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:09.965800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:09.965800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:09.965800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:09.965800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:09.965800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:09.965800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:09.965800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:09.965800 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:09.966432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:09.966432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:09.966432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:09.966432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:09.966432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:09.966432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:09.966432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:09.966432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:09.966432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:09.966432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:09.966432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:09.966432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:09.966432 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:09.967018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:09.967018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:09.967018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:09.967018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:09.967018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:09.967018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:09.967018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:09.967018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:09.967018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:09.967018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:09.967018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:09.967018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:09.967018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:09.967018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:09.967018 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:09.967761 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:09.968629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:09.968629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:09.968629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:09.968629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:09.968629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:09.968629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:10.146591 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:10.147388 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:10.147615 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:10.148770 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:10.149167 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:10.149434 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.150337 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:10.150337 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:10.150337 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:10.150337 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:10.150337 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:10.150337 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:10.150337 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.150337 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:10.152139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.152139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:10.152139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:10.152139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:10.152139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.152139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:10.152139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:10.152139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.152139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:10.152139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:10.152139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:10.152139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.152773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:10.152773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:10.152773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:10.152773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:10.152773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:10.152773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:10.152773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:10.152773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:10.152773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:10.152773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:10.152773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:10.152773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:10.152773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:10.153358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.153358 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:10.153862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.153862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:10.153862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:10.153862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:10.153862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:10.153862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:10.153862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.153862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:10.153862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:10.153862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.153862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:10.153862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:10.153862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.153862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:10.153862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:10.153862 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:10.154730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:10.155413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:10.155413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.155413 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:10.155413 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:10.155585 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:10.155758 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:10.155975 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 11:00:10.156518 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:10.156807 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.157538 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:10.157538 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:10.157538 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:10.157538 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:10.157538 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:10.157538 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:10.157538 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.157538 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:10.158301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.158301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:10.158301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:10.158301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:10.158301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.158301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:10.158301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:10.158301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:10.158301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.158301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:10.158301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:10.158301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:10.158301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:10.158301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:10.158301 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:10.158737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:10.158737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:10.158737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:10.158737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:10.158737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:10.158737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:10.158737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:10.158737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.158737 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:10.159139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.159139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:10.159139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:10.159139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:10.159139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.159139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:10.159139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:10.159139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 11:00:10.159139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:10.159139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:10.159139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.159139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:10.159495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:10.159495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:10.159495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.159495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:10.159495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:10.159495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:10.159495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:10.159495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:10.159495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:10.159495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:10.159495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:10.159495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:10.159495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:10.159495 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:10.159872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:10.159872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:10.159872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.159872 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:10.160151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.160151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:10.160151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:10.160151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:10.160151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:10.160151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:10.160151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.160151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:10.160151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:10.160151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.160151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:10.160151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:10.160151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.160151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:10.160151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:10.160151 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:10.160628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:10.161101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:10.161101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:10.161101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:10.161101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:10.161101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:10.161101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.161101 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:10.161305 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:10.161495 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:10.161599 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:10.161735 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:10.162204 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:10.162589 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.163508 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:10.163508 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:10.163508 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:10.163508 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:10.163508 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:10.163508 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:10.163508 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.163508 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:10.164282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.164282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:10.164282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:10.164282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:10.164282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.164282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:10.164282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:10.164282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:10.164282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.164282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:10.164282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:10.164282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:10.164282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:10.164282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:10.164282 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:10.164858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:10.164858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:10.164858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:10.164858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:10.164858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:10.164858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:10.164858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:10.164858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.164858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:10.165156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.165156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:10.165156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:10.165156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:10.165156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.165156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:10.165156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:10.165156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:10.165156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:10.165156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.165156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:10.165528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:10.165528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:10.165528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.165528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:10.165528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:10.165528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:10.165528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:10.165528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:10.165528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:10.165528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:10.165528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:10.165528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:10.165528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:10.165528 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:10.166019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:10.166019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:10.166019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.166019 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.166550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:10.167093 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:10.167605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:10.167605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:10.167605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.167605 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:10.167605 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:10.167605 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:10.167605 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:10.167605 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:10.167994 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:10.168330 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:10.169013 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.169325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:10.169325 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:10.169325 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:10.169325 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:10.169325 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:10.169325 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:10.169325 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.169325 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:10.170180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.170180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:10.170180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:10.170180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:10.170180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.170180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:10.170180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:10.170180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.170180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:10.170180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:10.170180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:10.170180 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.170639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:10.170639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:10.170639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:10.170639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:10.170639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:10.170639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:10.170639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:10.170639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:10.170639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:10.170639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:10.170639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:10.170639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:10.170639 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:10.171037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.171037 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:10.171182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.171182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:10.171182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:10.171182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:10.171182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:10.171182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:10.171182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.171182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:10.171182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:10.171182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.171182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:10.171182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:10.171182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.171182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:10.171182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:10.171182 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:10.171810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:10.172391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:10.172391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:10.172391 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:14.915550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:14.916257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:14.916257 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:14.917192 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:14.957036 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:14.957629 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:14.958384 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:14.958384 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:14.958384 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:14.958384 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:14.958384 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:14.958384 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:14.958384 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:14.958384 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:14.959507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.042 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:14.959507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:14.959507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:14.959507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:14.959507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:14.959507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:14.959507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:14.959507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:14.959507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:14.959507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:14.959507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:14.959507 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:14.960361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:14.960361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:14.960361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:14.960361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:14.960361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:14.960361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:14.960361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:14.960361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:14.960361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:14.960361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:14.960361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:14.960361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:14.960361 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:14.961006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:14.961006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:14.961006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:14.961006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:14.961006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:14.961006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:14.961006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:14.961006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:14.961006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:14.961006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:14.961006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:14.961006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:14.961006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:14.961006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:14.961006 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:14.961810 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:14.962980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:14.962980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:14.962980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:14.962980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:14.962980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:14.962980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:15.148497 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:15.149184 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:15.149234 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:15.150607 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:15.151038 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:15.151308 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.152385 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:15.152385 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:15.152385 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:15.152385 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:15.152385 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:15.152385 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:15.152385 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.152385 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:15.153546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.153546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:15.153546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:15.153546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:15.153546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.153546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:15.153546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:15.153546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.153546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:15.153546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:15.153546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:15.153546 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.153819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:15.153819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:15.153819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:15.153819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:15.153819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:15.153819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:15.153819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:15.153819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:15.153819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:15.153819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:15.153819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:15.153819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:15.153819 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:15.154056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.154056 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:15.154619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.154619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:15.154619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:15.154619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:15.154619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:15.154619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:15.154619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.154619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:15.154619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:15.154619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.154619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:15.154619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:15.154619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.154619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:15.154619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:15.154619 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:15.154936 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:15.155404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:15.155404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.155404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:15.155901 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:15.155991 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:15.156090 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:15.156234 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 11:00:15.156774 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:15.157103 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.157906 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:15.157906 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:15.157906 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:15.157906 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:15.157906 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:15.157906 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:15.157906 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.157906 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:15.158745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.158745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:15.158745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:15.158745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:15.158745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.158745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:15.158745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:15.158745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:15.158745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.158745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:15.158745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:15.158745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:15.158745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:15.158745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:15.158745 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:15.159644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:15.159644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:15.159644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:15.159644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:15.159644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:15.159644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:15.159644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:15.159644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.159644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:15.159644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.159644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:15.159644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:15.159644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:15.159644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.160015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:15.160015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:15.160015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 11:00:15.160015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:15.160015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:15.160015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.160015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:15.160015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:15.160015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:15.160015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.160015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:15.160015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:15.160015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:15.160342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:15.160342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:15.160342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:15.160342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:15.160342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:15.160342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:15.160342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:15.160342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:15.160342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:15.160342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:15.160342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.160342 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:15.160682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.160682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:15.160682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:15.160682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:15.160682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:15.160682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:15.160682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.160682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:15.160682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:15.160682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.160682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:15.160682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:15.160682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.160682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:15.160682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:15.160682 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:15.162283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:15.163004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:15.163004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:15.163004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:15.163004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:15.163004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:15.163004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.163004 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:15.163004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:15.163004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:15.163004 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:15.163297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:15.163297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:15.163297 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.163527 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:15.163527 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:15.163527 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:15.163527 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:15.163527 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:15.163527 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:15.163527 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.163527 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:15.164165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.164165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:15.164165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:15.164165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:15.164165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.164165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:15.164165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:15.164165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:15.164165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.164165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:15.164165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:15.164165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:15.164165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:15.164165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:15.164165 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:15.164934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:15.164934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:15.164934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:15.164934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:15.164934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:15.164934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:15.164934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:15.164934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.164934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:15.165352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.165352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:15.165352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:15.165352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:15.165352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.165352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:15.165352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:15.165352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:15.165352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:15.165352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.165352 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:15.165843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:15.165843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:15.165843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.165843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:15.165843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:15.165843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:15.165843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:15.165843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:15.165843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:15.165843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:15.165843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:15.165843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:15.165843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:15.165843 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:15.166247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:15.166247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:15.166247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.166247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:15.166247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.166247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:15.166247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:15.166247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:15.166247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:15.166247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:15.166247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.166247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:15.166247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:15.166247 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:15.166667 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:15.167134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:15.167134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:15.167134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:15.167134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:15.167134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:15.167134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:15.167134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:15.167134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:15.167134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:15.167134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.167134 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:15.167696 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:15.168059 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:15.168337 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:15.168518 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:15.168883 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:15.169186 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:15.169488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.170283 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:15.170283 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:15.170283 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:15.170283 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:15.170283 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:15.170283 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:15.170283 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.170283 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:15.171156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.171156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:15.171156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:15.171156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:15.171156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.171156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:15.171156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:15.171156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.171156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:15.171156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:15.171156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:15.171156 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.171524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:15.171524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:15.171524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:15.171524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:15.171524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:15.171524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:15.171524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:15.171524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:15.171524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:15.171524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:15.171524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:15.171524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:15.171524 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:15.171897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.171897 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:15.172094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.172094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:15.172094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:15.172094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:15.172094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:15.172094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:15.172094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.172094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:15.172094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:15.172094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.172094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:15.172094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:15.172094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.172094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:15.172094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:15.172094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:15.172562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:15.173257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:15.173257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:15.173257 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:19.916513 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:19.917344 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:19.917344 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:19.918649 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:19.956876 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:19.957649 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:19.958658 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:19.958658 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:19.958658 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:19.958658 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:19.958658 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:19.958658 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:19.958658 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:19.958658 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:19.959803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.041 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:19.959803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:19.959803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:19.959803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:19.959803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:19.959803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:19.959803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:19.959803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:19.959803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:19.959803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:19.959803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:19.959803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:19.960730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:19.960730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:19.960730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:19.960730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:19.960730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:19.960730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:19.960730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:19.960730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:19.960730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:19.960730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:19.960730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:19.960730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:19.960730 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:19.961612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:19.961612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:19.961612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:19.961612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:19.961612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:19.961612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:19.961612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:19.961612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:19.961612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:19.961612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:19.961612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:19.961612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:19.961612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:19.961612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:19.961612 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:19.962635 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:19.963831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:19.963831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:19.963831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:19.963831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:19.963831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:19.963831 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:20.149324 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:20.150221 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:20.150407 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:20.151819 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:20.152308 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:20.154945 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.155772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:20.155772 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:20.155772 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:20.155772 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:20.155772 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:20.155772 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:20.155772 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.155772 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:20.160489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.005 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.160489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:20.160489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:20.160489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:20.160489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.160489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:20.160489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:20.160489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.160489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:20.160489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:20.160489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:20.160489 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.161145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:20.161145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:20.161145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:20.161145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:20.161145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:20.161145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:20.161145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:20.161145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:20.161145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:20.161145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:20.161145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:20.161145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:20.161145 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:20.161746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.161746 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:20.161746 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:20.162828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.162828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:20.162828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:20.162828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:20.162828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:20.162828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:20.162828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.162828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:20.162828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:20.162828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.162828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:20.162828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:20.162828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.162828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:20.162828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:20.162828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:20.163415 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:20.163924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:20.163924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.163924 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:20.163924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:20.163924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:20.163924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 11:00:20.163924 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:20.165294 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:20.165294 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.165582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:20.165582 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:20.165582 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:20.165582 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:20.165582 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:20.165582 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:20.165582 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.165582 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:20.166879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.166879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:20.166879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:20.166879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:20.166879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.166879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:20.166879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:20.166879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:20.166879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.166879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:20.166879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:20.166879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:20.166879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:20.166879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:20.166879 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:20.167348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:20.167348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:20.167348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:20.167348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:20.167348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:20.167348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:20.167348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:20.167348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.167348 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:20.168239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.168239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:20.168239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:20.168239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:20.168239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.168239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:20.168239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:20.168239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 11:00:20.168239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:20.168239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:20.168239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.168239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:20.168615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:20.168615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:20.168615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.168615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:20.168615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:20.168615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:20.168615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:20.168615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:20.168615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:20.168615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:20.168615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:20.168615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:20.168615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:20.168615 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:20.168984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:20.168984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:20.168984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.168984 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:20.168984 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:20.169939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.169939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:20.169939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:20.169939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:20.169939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:20.169939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:20.169939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.169939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:20.169939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:20.169939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.169939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:20.169939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:20.169939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.169939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:20.169939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:20.169939 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:20.170356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:20.172230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:20.172230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:20.172230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:20.172230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:20.172230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:20.172230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.172230 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:20.172230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:20.172230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:20.172230 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:20.172582 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:20.172582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.172582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:20.172582 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:20.172582 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:20.172582 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:20.172582 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:20.172582 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:20.172582 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.172582 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:20.173129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.173129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:20.173129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:20.173129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:20.173129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.173129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:20.173129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:20.173129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:20.173129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.173129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:20.173129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:20.173129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:20.173129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:20.173129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:20.173129 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:20.173588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:20.173588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:20.173588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:20.173588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:20.173588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:20.173588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:20.173588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:20.173588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.173588 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:20.174052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.174052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:20.174052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:20.174052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:20.174052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.174052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:20.174052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:20.174052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:20.174052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:20.174052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.174052 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:20.174400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:20.174400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:20.174400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.174400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:20.174400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:20.174400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:20.174400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:20.174400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:20.174400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:20.174400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:20.174400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:20.174400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:20.174400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:20.174400 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:20.174773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:20.174773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:20.174773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.174773 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.175190 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:20.175824 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:20.176303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:20.176303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:20.176303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.176303 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:20.176303 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:20.176303 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:20.176303 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:20.177264 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:20.177780 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:20.178028 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.178966 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:20.178966 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:20.178966 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:20.178966 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:20.178966 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:20.178966 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:20.178966 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.178966 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:20.179881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.179881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:20.179881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:20.179881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:20.179881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.179881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:20.179881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:20.179881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.179881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:20.179881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:20.179881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:20.179881 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.180242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:20.180242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:20.180242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:20.180242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:20.180242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:20.180242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:20.180242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:20.180242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:20.180242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:20.180242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:20.180242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:20.180242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:20.180242 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:20.180585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.180585 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:20.180896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.180896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:20.180896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:20.180896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:20.180896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:20.180896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:20.180896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.180896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:20.180896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:20.180896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.180896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:20.180896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:20.180896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.180896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:20.180896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:20.180896 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:20.181353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:20.181863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:20.181863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:20.181863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:24.917222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:24.918087 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:24.918266 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:24.919518 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:24.949846 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:24.950330 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:24.951389 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:24.951389 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:24.951389 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:24.951389 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:24.951389 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:24.951389 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:24.951389 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:24.951389 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:24.952241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:24.952241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:24.952241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:24.952241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:24.952241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:24.952241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:24.952241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:24.952241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:24.952241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:24.952241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:24.952241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:24.952241 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:24.953263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:24.953263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:24.953263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:24.953263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:24.953263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:24.953263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:24.953263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:24.953263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:24.953263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:24.953263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:24.953263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:24.953263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:24.953263 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:24.954269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:24.954269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:24.954269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:24.954269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:24.954269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:24.954269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:24.954269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:24.954269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:24.954269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:24.954269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:24.954269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:24.954269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:24.954269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:24.954269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:24.954269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:24.955315 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:24.956785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:24.956785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:24.956785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:24.956785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:24.956785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:24.956785 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:25.150203 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:25.151053 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:25.151242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:25.152598 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:25.152901 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:25.153030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.153922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:25.153922 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:25.153922 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:25.153922 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:25.153922 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:25.153922 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:25.153922 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.153922 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:25.155633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.155633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:25.155633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:25.155633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:25.155633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.155633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:25.155633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:25.155633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.155633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:25.155633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:25.155633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:25.155633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.156553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:25.156553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:25.156553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:25.156553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:25.156553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:25.156553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:25.156553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:25.156553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:25.156553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:25.156553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:25.156553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:25.156553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:25.156553 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:25.157450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.157450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:25.157450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.157450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:25.157450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:25.157450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:25.157450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:25.157450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:25.157450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.157450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:25.157450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:25.157450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.157450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:25.157450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:25.157450 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:25.158550 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:25.159932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:25.159932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:25.159932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:25.159932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:25.159932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.159932 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:25.163196 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:25.163513 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:25.163610 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:25.163743 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 11:00:25.164167 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:25.164494 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.165069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:25.165069 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:25.165069 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:25.165069 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:25.165069 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:25.165069 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:25.165069 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.165069 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:25.165952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.165952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:25.165952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:25.165952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:25.165952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.165952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:25.165952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:25.165952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:25.165952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.165952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:25.165952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:25.165952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:25.165952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:25.165952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:25.165952 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:25.166681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:25.166681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:25.166681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:25.166681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:25.166681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:25.166681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:25.166681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:25.166681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.166681 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:25.167412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.167412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:25.167412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:25.167412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:25.167412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.167412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:25.167412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:25.167412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 11:00:25.167412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:25.167412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:25.167412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.167412 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:25.167980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:25.167980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:25.167980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.167980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:25.167980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:25.167980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:25.167980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:25.167980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:25.167980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:25.167980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:25.167980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:25.167980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:25.167980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:25.167980 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:25.168644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:25.168644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:25.168644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.168644 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:25.169102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.169102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:25.169102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:25.169102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:25.169102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:25.169102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:25.169102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.169102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:25.169102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:25.169102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.169102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:25.169102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:25.169102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.169102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:25.169102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:25.169102 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:25.169849 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:25.170712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:25.170712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:25.170712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:25.170712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:25.170712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:25.170712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.170712 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:25.170712 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:25.171065 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:25.171065 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:25.171191 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:25.171649 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:25.171889 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.172552 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:25.172552 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:25.172552 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:25.172552 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:25.172552 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:25.172552 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:25.172552 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.172552 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:25.173828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.173828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:25.173828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:25.173828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:25.173828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.173828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:25.173828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:25.173828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:25.173828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.173828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:25.173828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:25.173828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:25.173828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:25.173828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:25.173828 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:25.174509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:25.174509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:25.174509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:25.174509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:25.174509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:25.174509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:25.174509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:25.174509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.174509 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:25.175185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.175185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:25.175185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:25.175185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:25.175185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.175185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:25.175185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:25.175185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:25.175185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:25.175185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.175185 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:25.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:25.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:25.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:25.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:25.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:25.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:25.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:25.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:25.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:25.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:25.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:25.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:25.175739 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:25.176311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:25.176311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:25.176311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.176311 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.176968 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:25.177759 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:25.178437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:25.178437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:25.178437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.178437 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:25.178437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:25.178437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:25.178437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:25.178437 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:25.178696 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:25.178696 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:25.178825 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.179353 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:25.179353 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:25.179353 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:25.179353 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:25.179353 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:25.179353 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:25.179353 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.179353 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:25.180204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.180204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:25.180204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:25.180204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:25.180204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.180204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:25.180204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:25.180204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.180204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:25.180204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:25.180204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:25.180204 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.180793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:25.180793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:25.180793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:25.180793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:25.180793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:25.180793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:25.180793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:25.180793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:25.180793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:25.180793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:25.180793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:25.180793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:25.180793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:25.181300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.181300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:25.181300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.181300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:25.181300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:25.181300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:25.181300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:25.181300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:25.181300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.181300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:25.181300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:25.181300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.181300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:25.181300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:25.181300 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:25.182404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:25.183324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:25.183324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:25.183324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:25.183324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:25.183324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:25.183324 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:29.932058 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:29.933558 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:29.933761 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:29.935152 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:29.976689 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:29.977049 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:29.977922 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:29.977922 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:29.977922 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:29.977922 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:29.977922 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:29.977922 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:29.977922 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:29.977922 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:29.978991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.044 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:29.978991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:29.978991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:29.978991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:29.978991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:29.978991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:29.978991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:29.978991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:29.978991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:29.978991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:29.978991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:29.978991 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:29.979931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:29.979931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:29.979931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:29.979931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:29.979931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:29.979931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:29.979931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:29.979931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:29.979931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:29.979931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:29.979931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:29.979931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:29.979931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:29.980501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:29.980501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:29.980501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:29.980501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:29.980501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:29.980501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:29.980501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:29.980501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:29.980501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:29.980501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:29.980501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:29.980501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:29.980501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:29.980501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:29.980501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:29.981022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:29.981624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:29.981624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:29.981624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:29.981624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:29.981624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:29.981624 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:30.151080 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:30.152067 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:30.152271 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:30.153769 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:30.154253 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:30.154608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.155748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:30.155748 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:30.155748 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:30.155748 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:30.155748 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:30.155748 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:30.155748 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.155748 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:30.157570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.157570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:30.157570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:30.157570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:30.157570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.157570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:30.157570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:30.157570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.157570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:30.157570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:30.157570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:30.157570 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.158399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:30.158399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:30.158399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:30.158399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:30.158399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:30.158399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:30.158399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:30.158399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:30.158399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:30.158399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:30.158399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:30.158399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:30.158399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:30.158971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.158971 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:30.159278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.159278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:30.159278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:30.159278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:30.159278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:30.159278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:30.159278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.159278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:30.159278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:30.159278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.159278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:30.159278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:30.159278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.159278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:30.159278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:30.159278 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:30.160069 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:30.160931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:30.160931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.160931 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:30.163842 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:30.164242 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:30.164328 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:30.164487 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 11:00:30.164911 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:30.165139 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.165717 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:30.165717 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:30.165717 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:30.165717 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:30.165717 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:30.165717 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:30.165717 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.165717 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:30.166660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.166660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:30.166660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:30.166660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:30.166660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.166660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:30.166660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:30.166660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:30.166660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.166660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:30.166660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:30.166660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:30.166660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:30.166660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:30.166660 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:30.167122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:30.167122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:30.167122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:30.167122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:30.167122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:30.167122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:30.167122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:30.167122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.167122 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:30.167582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.167582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:30.167582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:30.167582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:30.167582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.167582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:30.167582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:30.167582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 11:00:30.167582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:30.167582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:30.167582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.167582 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:30.167930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:30.167930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:30.167930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.167930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:30.167930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:30.167930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:30.167930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:30.167930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:30.167930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:30.167930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:30.167930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:30.167930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:30.167930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:30.167930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:30.168290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:30.168290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:30.168290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.168290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:30.168689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.168689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:30.168689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:30.168689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:30.168689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:30.168689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:30.168689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.168689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:30.168689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:30.168689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.168689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:30.168689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:30.168689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.168689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:30.168689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:30.168689 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:30.169095 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:30.169596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:30.169596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:30.169596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:30.169596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:30.169596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:30.169596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.169596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:30.170893 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:30.171232 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:30.171396 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:30.171553 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:30.171938 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:30.172169 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.172750 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:30.172750 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:30.172750 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:30.172750 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:30.172750 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:30.172750 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:30.172750 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.172750 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:30.173533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.173533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:30.173533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:30.173533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:30.173533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.173533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:30.173533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:30.173533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:30.173533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.173533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:30.173533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:30.173533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:30.173533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:30.173533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:30.173533 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:30.173935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:30.173935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:30.173935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:30.173935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:30.173935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:30.173935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:30.173935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:30.173935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.173935 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:30.174462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.174462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:30.174462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:30.174462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:30.174462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.174462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:30.174462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:30.174462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:30.174462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:30.174462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.174462 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:30.174820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:30.174820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:30.174820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.174820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:30.174820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:30.174820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:30.174820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:30.174820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:30.174820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:30.174820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:30.174820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:30.174820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:30.174820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:30.174820 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:30.175193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:30.175193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:30.175193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.175193 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.175521 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:30.175992 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:30.176484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:30.176484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:30.176484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.176484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:30.177678 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:30.178036 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:30.178297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:30.178297 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:30.178698 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:30.178916 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:30.179269 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.180090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:30.180090 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:30.180090 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:30.180090 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:30.180090 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:30.180090 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:30.180090 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.180090 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:30.180543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.180543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:30.180543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:30.180543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:30.180543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.180543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:30.180543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:30.180543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.180543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:30.180543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:30.180543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:30.180543 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.180911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:30.180911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:30.180911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:30.180911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:30.180911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:30.180911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:30.180911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:30.180911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:30.180911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:30.180911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:30.180911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:30.180911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:30.180911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:30.181229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.181229 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:30.181673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.181673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:30.181673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:30.181673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:30.181673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:30.181673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:30.181673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.181673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:30.181673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:30.181673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.181673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:30.181673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:30.181673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.181673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:30.181673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:30.181673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:30.183863 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:30.184392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:30.184392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:30.184392 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:34.939162 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:34.940892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:34.940892 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:34.941807 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:34.978727 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:34.979186 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:34.980292 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:34.980292 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:34.980292 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:34.980292 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:34.980292 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:34.980292 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:34.980292 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:34.980292 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:34.981484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.040 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:34.981484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:34.981484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:34.981484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:34.981484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:34.981484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:34.981484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:34.981484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:34.981484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:34.981484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:34.981484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:34.981484 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:34.982059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:34.982059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:34.982059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:34.982059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:34.982059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:34.982059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:34.982059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:34.982059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:34.982059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:34.982059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:34.982059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:34.982059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:34.982059 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:34.982586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:34.982586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:34.982702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:34.982702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:34.982702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:34.982702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:34.982702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:34.982702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:34.982702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:34.982702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:34.982702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:34.982702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:34.982702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:34.982702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:34.982702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:34.982702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:34.982702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:34.982702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:34.983198 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:34.983934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:34.983934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:34.983934 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:35.151939 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:35.152625 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:35.152965 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:35.154200 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:35.154681 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:35.155806 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.156902 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:35.156902 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:35.156902 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:35.156902 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:35.156902 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:35.156902 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:35.156902 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.156902 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:35.158504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.158504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:35.158504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:35.158504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:35.158504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.158504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:35.158504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:35.158504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.158504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:35.158504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:35.158504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:35.158504 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.158900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:35.158900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:35.158900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:35.158900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:35.158900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:35.158900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:35.158900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:35.158900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:35.158900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:35.158900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:35.158900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:35.158900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:35.158900 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:35.159258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.159258 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:35.159721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.159721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:35.159721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:35.159721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:35.159721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:35.159721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:35.159721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.159721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:35.159721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:35.159721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.159721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:35.159721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:35.159721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.159721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:35.159721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:35.159721 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:35.160160 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:35.160698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:35.160698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.160698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:35.164360 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:35.164705 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:35.164810 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:35.164935 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 11:00:35.165352 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:35.165642 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.166460 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:35.166460 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:35.166460 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:35.166460 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:35.166460 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:35.166460 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:35.166460 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.166460 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:35.167356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.167356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:35.167356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:35.167356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:35.167356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.167356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:35.167356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:35.167356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:35.167356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.167356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:35.167356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:35.167356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:35.167356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:35.167356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:35.167356 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:35.168032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:35.168032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:35.168032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:35.168032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:35.168032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:35.168032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:35.168032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:35.168032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.168032 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:35.168671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.168671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:35.168671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:35.168671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:35.168671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.168671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:35.168671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:35.168671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 11:00:35.168671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:35.168671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:35.168671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.168671 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:35.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:35.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:35.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:35.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:35.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:35.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:35.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:35.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:35.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:35.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:35.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:35.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:35.169211 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:35.169736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:35.169736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:35.169736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.169736 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:35.170256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.170256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:35.170256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:35.170256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:35.170256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:35.170256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:35.170256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.170256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:35.170256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:35.170256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.170256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:35.170256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:35.170256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.170256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:35.170256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:35.170256 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:35.170920 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:35.171596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:35.171596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:35.171596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:35.171596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:35.171596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:35.171596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.171596 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:35.171596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:35.171905 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:35.171977 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:35.172153 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:35.172728 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:35.173120 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.174001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:35.174001 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:35.174001 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:35.174001 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:35.174001 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:35.174001 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:35.174001 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.174001 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:35.175131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.175131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:35.175131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:35.175131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:35.175131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.175131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:35.175131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:35.175131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:35.175131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.175131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:35.175131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:35.175131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:35.175131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:35.175131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:35.175131 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:35.175675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:35.175675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:35.175675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:35.175675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:35.175675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:35.175675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:35.175675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:35.175675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.175675 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:35.176525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.176525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:35.176525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:35.176525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:35.176525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.176525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:35.176525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:35.176525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:35.176525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:35.176525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.176525 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:35.176983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:35.176983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:35.176983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.176983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:35.176983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:35.176983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:35.176983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:35.176983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:35.176983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:35.176983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:35.176983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:35.176983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:35.176983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:35.176983 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:35.177463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:35.177463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:35.177463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.177463 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.178217 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:35.178930 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:35.180000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:35.180000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:35.180000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.180000 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:35.180000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:35.180000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:35.180000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:35.180000 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:35.180523 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:35.180523 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:35.180523 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.180709 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:35.180709 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:35.180709 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:35.180709 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:35.180709 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:35.180709 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:35.180709 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.180709 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:35.181501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.181501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:35.181501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:35.181501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:35.181501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.181501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:35.181501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:35.181501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.181501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:35.181501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:35.181501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:35.181501 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.181982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:35.181982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:35.181982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:35.181982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:35.181982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:35.181982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:35.181982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:35.181982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:35.181982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:35.181982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:35.181982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:35.181982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:35.181982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:35.182500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.182500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:35.182500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.182500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:35.182500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:35.182500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:35.182500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:35.182500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:35.182500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.182500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:35.182500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:35.182500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.182500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:35.182500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:35.182500 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:35.183082 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:35.183793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:35.183793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:35.183793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:35.183793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:35.183793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:35.183793 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:39.940787 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:39.941700 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:39.941771 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:39.943195 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:39.978475 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:39.978957 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:39.980404 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:39.980404 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:39.980404 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:39.980404 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:39.980404 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:39.980404 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:39.980404 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:39.980404 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:39.981571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:39.981571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:39.981571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:39.981571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:39.981571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:39.981571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:39.981571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:39.981571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:39.981571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:39.981571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:39.981571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:39.981571 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:39.982153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:39.982153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:39.982153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:39.982153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:39.982153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:39.982153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:39.982153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:39.982153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:39.982153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:39.982153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:39.982153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:39.982153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:39.982153 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:39.982982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:39.982982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:39.982982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:39.982982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:39.982982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:39.982982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:39.982982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:39.982982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:39.982982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:39.982982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:39.982982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:39.982982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:39.982982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:39.982982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:39.982982 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:39.983858 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:39.985855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:39.985855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:39.985855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:39.985855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:39.985855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:39.985855 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:40.152807 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:40.154095 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:40.154316 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:40.155593 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:40.156007 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:40.156266 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.157293 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:40.157293 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:40.157293 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:40.157293 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:40.157293 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:40.157293 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:40.157293 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.157293 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:40.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:40.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:40.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:40.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:40.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:40.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:40.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:40.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:40.159017 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.160286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:40.160286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:40.160286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:40.160286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:40.160286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:40.160286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:40.160286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:40.160286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:40.160286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:40.160286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:40.160286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:40.160286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:40.160286 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:40.161055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.161055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:40.161055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.161055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:40.161055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:40.161055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:40.161055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:40.161055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:40.161055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.161055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:40.161055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:40.161055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.161055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:40.161055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:40.161055 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:40.161848 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:40.162841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:40.162841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:40.162841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:40.162841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:40.162841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.162841 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:40.164862 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:40.165216 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:40.165401 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:40.165825 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 11:00:40.166342 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:40.166680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.167382 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:40.167382 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:40.167382 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:40.167382 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:40.167382 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:40.167382 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:40.167382 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.167382 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:40.168157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.168157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:40.168157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:40.168157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:40.168157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.168157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:40.168157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:40.168157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:40.168157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.168157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:40.168157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:40.168157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:40.168157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:40.168157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:40.168157 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:40.168636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:40.168636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:40.168636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:40.168636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:40.168636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:40.168636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:40.168636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:40.168636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.168636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:40.168988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.168988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:40.168988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:40.168988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:40.168988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.168988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:40.168988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:40.168988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 11:00:40.168988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:40.168988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:40.168988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.168988 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:40.169399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:40.169399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:40.169399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.169399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:40.169399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:40.169399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:40.169399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:40.169399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:40.169399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:40.169399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:40.169399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:40.169399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:40.169399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:40.169399 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:40.169830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:40.169830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:40.169830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.169830 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:40.170628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.170628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:40.170628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:40.170628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:40.170628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:40.170628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:40.170628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.170628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:40.170628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:40.170628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.170628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:40.170628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:40.170628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.170628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:40.170628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:40.170628 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:40.171710 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:40.172526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:40.172526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:40.172526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:40.172526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:40.172526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:40.172526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.172526 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:40.172526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:40.172526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:40.172526 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:40.173081 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:40.173081 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:40.173081 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.174090 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:40.174090 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:40.174090 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:40.174090 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:40.174090 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:40.174090 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:40.174090 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.174090 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:40.175064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.175064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:40.175064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:40.175064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:40.175064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.175064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:40.175064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:40.175064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:40.175064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.175064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:40.175064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:40.175064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:40.175064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:40.175064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:40.175064 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:40.175586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:40.175586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:40.175586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:40.175586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:40.175586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:40.175586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:40.175586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:40.175586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.175586 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:40.175990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.175990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:40.175990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:40.175990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:40.175990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.175990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:40.175990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:40.175990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:40.175990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:40.175990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.175990 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:40.176279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:40.176279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:40.176279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.176279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:40.176279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:40.176279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:40.176279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:40.176279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:40.176279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:40.176279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:40.176279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:40.176279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:40.176279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:40.176279 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:40.176676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:40.176676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:40.176676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.176676 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.177772 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:40.178359 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:40.179114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:40.179114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:40.179114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.179114 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:40.179114 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:40.179268 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:40.179596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:40.179596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:40.179950 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:40.180160 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:40.180239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.180703 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:40.180703 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:40.180703 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:40.180703 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:40.180703 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:40.180703 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:40.180703 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.180703 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:40.181327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.181327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:40.181327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:40.181327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:40.181327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.181327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:40.181327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:40.181327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.181327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:40.181327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:40.181327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:40.181327 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.181702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:40.181702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:40.181702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:40.181702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:40.181702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:40.181702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:40.181702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:40.181702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:40.181702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:40.181702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:40.181702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:40.181702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:40.181702 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:40.182022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.182022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:40.182022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.182022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:40.182022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:40.182022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:40.182022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:40.182022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:40.182022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.182022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:40.182022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:40.182022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.182022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:40.182022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:40.182022 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:40.182583 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:40.183094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:40.183094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:40.183094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:40.183094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:40.183094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:40.183094 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:44.941587 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:44.943011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:44.943011 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:44.943827 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:44.977284 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:44.977284 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:44.978192 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:44.978192 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:44.978192 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:44.978192 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:44.978192 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:44.978192 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:44.978192 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:44.978192 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:44.978488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:44.978488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:44.978488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:44.978488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:44.978488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:44.978488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:44.978488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:44.978488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:44.978488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:44.978488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:44.978488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:44.978488 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:44.978899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:44.978899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:44.978899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:44.978899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:44.978899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:44.978899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:44.978899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:44.978899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:44.978899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:44.978899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:44.978899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:44.978899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:44.978899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:44.979290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:44.979290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:44.979290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:44.979290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:44.979290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:44.979290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:44.979290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:44.979290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:44.979290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:44.979290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:44.979290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:44.979290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:44.979290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:44.979290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:44.979290 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:44.979832 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:44.980426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:44.980426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:44.980426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:44.980426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:44.980426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:44.980426 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:45.154075 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:45.154596 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:45.154794 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:45.156911 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:45.156911 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:45.156911 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.157199 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:45.157199 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:45.157199 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:45.157199 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:45.157199 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:45.157199 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:45.157199 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.157199 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:45.158748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.158748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:45.158748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:45.158748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:45.158748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.158748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:45.158748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:45.158748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.158748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:45.158748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:45.158748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:45.158748 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.159228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:45.159228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:45.159228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:45.159228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:45.159228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:45.159228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:45.159228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:45.159228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:45.159228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:45.159228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:45.159228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:45.159228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:45.159228 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:45.159623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.159623 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:45.160562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.160562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:45.160562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:45.160562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:45.160562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:45.160562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:45.160562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.160562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:45.160562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:45.160562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.160562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:45.160562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:45.160562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.160562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:45.160562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:45.160562 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:45.161084 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:45.161654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:45.161654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.161654 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:45.165091 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:45.165293 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:45.165421 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:45.165542 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 11:00:45.165919 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:45.166254 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.166899 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:45.166899 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:45.166899 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:45.166899 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:45.166899 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:45.166899 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:45.166899 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.166899 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:45.167882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.167882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:45.167882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:45.167882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:45.167882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.167882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:45.167882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:45.167882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:45.167882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.167882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:45.167882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:45.167882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:45.167882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:45.167882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:45.167882 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:45.168784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:45.168784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:45.168784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:45.168784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:45.168784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:45.168784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:45.168784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:45.168784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.168784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:45.168784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.168784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:45.168784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:45.168784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:45.168784 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.169225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:45.169225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:45.169225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 11:00:45.169225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:45.169225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:45.169225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.169225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:45.169225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:45.169225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:45.169225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.169225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:45.169225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:45.169225 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:45.169648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:45.169648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:45.169648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:45.169648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:45.169648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:45.169648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:45.169648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:45.169648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:45.169648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:45.169648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:45.169648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.169648 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:45.169987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.169987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:45.169987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:45.169987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:45.169987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:45.169987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:45.169987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.169987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:45.169987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:45.169987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.169987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:45.169987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:45.169987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.169987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:45.169987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:45.169987 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:45.170490 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:45.171061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:45.171061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:45.171061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:45.171061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:45.171061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:45.171061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.171061 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:45.171992 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:45.172187 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:45.172288 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:45.172426 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:45.173357 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:45.173357 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.173567 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:45.173567 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:45.173567 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:45.173567 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:45.173567 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:45.173567 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:45.173567 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.173567 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:45.174239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.174239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:45.174239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:45.174239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:45.174239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.174239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:45.174239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:45.174239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:45.174239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.174239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:45.174239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:45.174239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:45.174239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:45.174239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:45.174239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:45.175251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:45.175251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:45.175251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:45.175251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:45.175251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:45.175251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:45.175251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:45.175251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.175251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:45.175251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.175251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:45.175251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:45.175251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:45.175251 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.176239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:45.176239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:45.176239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:45.176239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:45.176239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.176239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:45.176239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:45.176239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:45.176239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.176239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:45.176239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:45.176239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:45.176239 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:45.177138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:45.177138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:45.177138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:45.177138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:45.177138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:45.177138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:45.177138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:45.177138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:45.177138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:45.177138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.177138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:45.177138 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:45.177960 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.179325 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:45.179978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:45.179978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:45.179978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:45.179978 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:45.181051 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:45.181051 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:45.181704 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.183599 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:45.183599 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:45.183599 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:45.183599 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:45.183599 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:45.183599 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:45.183599 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.183599 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:45.184724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.184724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:45.184724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:45.184724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:45.184724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.184724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:45.184724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:45.184724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.184724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:45.184724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:45.184724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:45.184724 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.185245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:45.185245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:45.185245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:45.185245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:45.185245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:45.185245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:45.185245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:45.185245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:45.185245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:45.185245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:45.185245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:45.185245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:45.185245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:45.185722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.185722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:45.185722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.185722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:45.185722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:45.185722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:45.185722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:45.185722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:45.185722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.185722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:45.185722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:45.185722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.185722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:45.185722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:45.185722 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:45.186309 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:45.187015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:45.187015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:45.187015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:45.187015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:45.187015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:45.187015 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:49.942643 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:49.943345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:49.943345 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:49.944506 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:49.978143 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:49.978608 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:49.979498 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:49.979498 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:49.979498 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:49.979498 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:49.979498 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:49.979498 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:49.979498 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:49.979498 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:49.980328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:49.980328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:49.980328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:49.980328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:49.980328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:49.980328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:49.980328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:49.980328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:49.980328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:49.980328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:49.980328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:49.980328 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:49.981029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:49.981029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:49.981029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:49.981029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:49.981029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:49.981029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:49.981029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:49.981029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:49.981029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:49.981029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:49.981029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:49.981029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:49.981029 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:49.981823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:49.981823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:49.981823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:49.981823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:49.981823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:49.981823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:49.981823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:49.981823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:49.981823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:49.981823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:49.981823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:49.981823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:49.981823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:49.981823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:49.981823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:49.982711 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:49.983860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:49.983860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:49.983860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:49.983860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:49.983860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:49.983860 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:50.154668 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:50.155003 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:50.155180 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:50.156069 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-6ae0d4e8-0009-4462-b695-a01da30fdd3b, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:50.156436 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-931f18d3-b7f8-4874-928b-3c06d4d5d355, routes=[], if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:50.156680 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.157576 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:50.157576 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:50.157576 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:50.157576 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:50.157576 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:50.157576 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:50.157576 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.157576 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:50.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:50.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:50.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:50.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:50.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:50.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:50.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:50.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:50.159030 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.159673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:50.159673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:50.159673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:50.159673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:50.159673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:50.159673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:50.159673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:50.159673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:50.159673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:50.159673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:50.159673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:50.159673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:50.159673 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:50.160346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.160346 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:50.160636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.160636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:50.160636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:50.160636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:50.160636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:50.160636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:50.160636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.160636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:50.160636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:50.160636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.160636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:50.160636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:50.160636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.160636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:50.160636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:50.160636 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:50.161499 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:50.162547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:50.162547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.162547 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:50.165440 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:50.165738 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:50.165909 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:50.166057 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting fip-distributed flag in NB_Global to False {{(pid=106381) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}}
Apr 24 11:00:50.166566 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:50.166887 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.167633 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:50.167633 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:50.167633 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:50.167633 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:50.167633 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:50.167633 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:50.167633 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.167633 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:50.168341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.168341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:50.168341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:50.168341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:50.168341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.168341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:50.168341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:50.168341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:50.168341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.168341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:50.168341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:50.168341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:50.168341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:50.168341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:50.168341 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:50.168910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:50.168910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:50.168910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:50.168910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:50.168910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:50.168910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:50.168910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:50.168910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.168910 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:50.169245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.169245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:50.169245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:50.169245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:50.169245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.169245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:50.169245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:50.169245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                                                           ^^^^^^^^
Apr 24 11:00:50.169245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:50.169245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:50.169245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.169245 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:50.169698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:50.169698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:50.169698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.169698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:50.169698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:50.169698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:50.169698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:50.169698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:50.169698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:50.169698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:50.169698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:50.169698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:50.169698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:50.169698 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:50.170195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:50.170195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:50.170195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.170195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:50.170195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.170195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:50.170195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:50.170195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:50.170195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:50.170195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:50.170195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.170195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:50.170195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:50.170195 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:50.170749 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:50.171706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:50.171706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:50.171706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:50.171706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:50.171706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:50.171706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:50.171706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:50.171706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:50.171706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:50.171706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:50.171706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.171706 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:50.172222 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:50.172423 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_ha_failover {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:50.172535 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:50.172645 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:50.173025 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:50.173260 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.173803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:50.173803 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:50.173803 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:50.173803 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:50.173803 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:50.173803 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:50.173803 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.173803 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:50.174575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.174575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 24 11:00:50.174575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:50.174575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:50.174575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.174575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:50.174575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:50.174575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:50.174575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.174575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 24 11:00:50.174575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:50.174575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 24 11:00:50.174575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:50.174575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 24 11:00:50.174575 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 24 11:00:50.175106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:50.175106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 24 11:00:50.175106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:50.175106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 24 11:00:50.175106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 24 11:00:50.175106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:50.175106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 24 11:00:50.175106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.175106 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 24 11:00:50.175440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.175440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:50.175440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:50.175440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:50.175440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.175440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:50.175440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:50.175440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:50.175440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:50.175440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.175440 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:50.175823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:50.175823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:50.175823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.175823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:50.175823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:50.175823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:50.175823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:50.175823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:50.175823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:50.175823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:50.175823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:50.175823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:50.175823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:50.175823 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:50.176302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:50.176302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:50.176302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.176302 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.176468 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:50.177034 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:50.178003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:50.178003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:50.178003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.178003 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics 
Apr 24 11:00:50.179550 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=106381) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}}
Apr 24 11:00:50.179715 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Apr 24 11:00:50.179821 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=106381) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}}
Apr 24 11:00:50.179966 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=106381) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 24 11:00:50.180270 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:50.180467 np0000170011 neutron-ovn-maintenance-worker[106381]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=106381) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 24 11:00:50.180574 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.181001 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Traceback (most recent call last):
Apr 24 11:00:50.181001 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:50.181001 np0000170011 neutron-ovn-maintenance-worker[106381]:     txn.results.put(txn.do_commit())
Apr 24 11:00:50.181001 np0000170011 neutron-ovn-maintenance-worker[106381]:                     ^^^^^^^^^^^^^^^
Apr 24 11:00:50.181001 np0000170011 neutron-ovn-maintenance-worker[106381]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:50.181001 np0000170011 neutron-ovn-maintenance-worker[106381]:     raise RuntimeError(msg)
Apr 24 11:00:50.181001 np0000170011 neutron-ovn-maintenance-worker[106381]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.181001 np0000170011 neutron-ovn-maintenance-worker[106381]: 
Apr 24 11:00:50.181803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] OVN maintenance task update_mac_aging_settings failed after 0.001 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.181803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 24 11:00:50.181803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:50.181803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     result = f(*args, **kwargs)
Apr 24 11:00:50.181803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.181803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:50.181803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:50.181803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.181803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:50.181803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:50.181803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:50.181803 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.182253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 24 11:00:50.182253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:50.182253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 24 11:00:50.182253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:50.182253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 24 11:00:50.182253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 24 11:00:50.182253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:50.182253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 24 11:00:50.182253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:50.182253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 24 11:00:50.182253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 24 11:00:50.182253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:50.182253 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 24 11:00:50.182751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.182751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 24 11:00:50.182751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics [None req-184a7557-51c1-4580-b489-3c1b0ad3c307 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.182751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics Traceback (most recent call last):
Apr 24 11:00:50.182751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run
Apr 24 11:00:50.182751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     work()
Apr 24 11:00:50.182751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__
Apr 24 11:00:50.182751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 24 11:00:50.182751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.182751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator
Apr 24 11:00:50.182751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 24 11:00:50.182751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.182751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 24 11:00:50.182751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 24 11:00:50.182751 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     result = f(*args, **kwargs)
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics              ^^^^^^^^^^^^^^^^^^
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     next(self.gen)
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     with self.create_transaction(
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     self.result = self.commit()
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise result.ex
Apr 24 11:00:50.183277 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 24 11:00:50.183969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 24 11:00:50.183969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 24 11:00:50.183969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 24 11:00:50.183969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 24 11:00:50.183969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 24 11:00:50.183969 np0000170011 neutron-ovn-maintenance-worker[106381]: ERROR futurist.periodics